2024-09-11T22:08:44.533 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T22:08:44.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T22:08:44.648 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901417' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDivh6muOKhr3RdGpl7pUaGr5n/3hLku8NgZxrhmB2LY/xbUx5CXD+V6088UymLTARWlR/b+Awh6IBU6K2W2ung= smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKIEhxV94EyGMDKlntkkEZW/XYsvLOWmP68vc9pJ7279bYPoyR12zImjDzjdQQ0gHLkhVVSWQcR7lG4FqeldXgo= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB/KvvS/mGG/ok/niOv65KOYMi2403XpsuGRSRjfe/JQYZg82oACsJuFqwFcL8cvpee5jFOLl3HQsyM+Daa5sW0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T22:08:44.649 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T22:08:44.650 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T22:08:44.650 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T22:08:44.651 INFO:teuthology.task.internal:Checking packages... 2024-09-11T22:08:44.674 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T22:08:44.674 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T22:08:44.674 INFO:teuthology.packaging:ref: None 2024-09-11T22:08:44.674 INFO:teuthology.packaging:tag: None 2024-09-11T22:08:44.674 INFO:teuthology.packaging:branch: squid 2024-09-11T22:08:44.674 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:08:44.674 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T22:08:44.909 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T22:08:44.911 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T22:08:44.918 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T22:08:44.918 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T22:08:44.941 INFO:teuthology.task.internal:Saving configuration 2024-09-11T22:08:44.960 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T22:08:44.967 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T22:08:44.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:03:44.489978', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDivh6muOKhr3RdGpl7pUaGr5n/3hLku8NgZxrhmB2LY/xbUx5CXD+V6088UymLTARWlR/b+Awh6IBU6K2W2ung='} 2024-09-11T22:08:45.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:03:44.493452', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKIEhxV94EyGMDKlntkkEZW/XYsvLOWmP68vc9pJ7279bYPoyR12zImjDzjdQQ0gHLkhVVSWQcR7lG4FqeldXgo='} 2024-09-11T22:08:45.033 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:03:44.491779', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB/KvvS/mGG/ok/niOv65KOYMi2403XpsuGRSRjfe/JQYZg82oACsJuFqwFcL8cvpee5jFOLl3HQsyM+Daa5sW0='} 2024-09-11T22:08:45.033 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T22:08:45.039 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-11T22:08:45.039 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-11T22:08:45.039 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-11T22:08:45.039 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T22:08:45.113 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe713597520>, signals=[15]) 2024-09-11T22:08:45.113 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T22:08:45.119 INFO:teuthology.task.internal:Opening connections... 2024-09-11T22:08:45.119 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T22:08:45.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:08:45.197 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-09-11T22:08:45.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:08:45.273 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-09-11T22:08:45.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:08:45.348 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T22:08:45.355 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-09-11T22:08:45.374 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-09-11T22:08:45.374 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-09-11T22:08:45.431 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-09-11T22:08:45.431 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-09-11T22:08:45.431 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-09-11T22:08:45.431 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:08:45.432 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:08:45.433 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-09-11T22:08:45.460 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-09-11T22:08:45.479 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-09-11T22:08:45.479 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-09-11T22:08:45.537 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:08:45.538 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:08:45.539 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-09-11T22:08:45.560 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-09-11T22:08:45.579 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-09-11T22:08:45.579 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:08:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:08:45.639 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:08:45.639 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:08:45.639 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-09-11T22:08:45.660 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T22:08:45.670 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T22:08:45.699 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T22:08:45.699 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:08:45.702 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:08:45.705 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:08:45.722 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T22:08:45.728 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T22:08:45.728 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:08:45.760 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:08:45.763 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:08:45.878 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T22:08:45.957 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T22:08:45.971 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-11T22:08:45.971 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-11T22:08:45.971 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-11T22:08:45.971 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:08:45.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:08:45.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-11T22:08:46.171 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T22:08:46.171 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-11T22:08:46.171 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-11T22:08:46.189 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-503.el9.x86_64 2024-09-11T22:08:46.189 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T22:08:46.189 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-11T22:08:46.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum upgrade -y linux-firmware 2024-09-11T22:08:48.543 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-11T22:08:51.878 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 20 MB 00:02 2024-09-11T22:08:57.478 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-11T22:08:59.037 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-11T22:08:59.908 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-11T22:09:05.430 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T22:09:07.561 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-11T22:09:07.562 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-09-11T22:09:07.562 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-11T22:09:07.672 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-11T22:09:07.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T22:09:07.829 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-11T22:09:07.829 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-11T22:09:07.832 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi040.front.sepia.ceph.com to complete... 2024-09-11T22:09:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11 22:09:14 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-11T22:09:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:FINISHED --2024-09-11 22:09:14-- 2024-09-11T22:09:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:Total wall clock time: 6.3s 2024-09-11T22:09:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:Downloaded: 1 files, 343M in 6.0s (56.9 MB/s) 2024-09-11T22:09:14.169 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-11T22:09:14.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-11T22:09:16.381 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying... ######################################## 2024-09-11T22:09:16.538 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing... ######################################## 2024-09-11T22:09:16.646 INFO:teuthology.orchestra.run.smithi040.stdout:Updating / installing... 2024-09-11T22:09:25.047 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-11T22:10:05.122 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-11T22:10:05.122 DEBUG:teuthology.orchestra.run.smithi040:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-11T22:10:05.205 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:10:05.205 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:10:05.205 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:10:05.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-11T22:10:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-11T22:10:05.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-11T22:10:05.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-11T22:10:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-11T22:10:05.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-11T22:10:05.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-11T22:10:05.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-11T22:10:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-11T22:10:05.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-11T22:10:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-11T22:10:05.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-11T22:10:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-11T22:10:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-11T22:10:05.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-11T22:10:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-11T22:10:05.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-11T22:10:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-11T22:10:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-11T22:10:05.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-11T22:10:05.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-11T22:10:05.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-11T22:10:05.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-11T22:10:05.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-11T22:10:05.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-11T22:10:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-11T22:10:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-11T22:10:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-11T22:10:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-11T22:10:05.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-11T22:10:05.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-11T22:10:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-11T22:10:05.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-11T22:10:05.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-11T22:10:05.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-11T22:10:05.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-11T22:10:05.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-11T22:10:05.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-11T22:10:05.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-11T22:10:05.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-11T22:10:05.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-11T22:10:05.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-11T22:10:05.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-11T22:10:05.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-11T22:10:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-11T22:10:05.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-11T22:10:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-11T22:10:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-11T22:10:05.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-11T22:10:05.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-11T22:10:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-11T22:10:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-11T22:10:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-11T22:10:05.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-11T22:10:05.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-11T22:10:05.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-11T22:10:05.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-11T22:10:05.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-11T22:10:05.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-11T22:10:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-11T22:10:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-11T22:10:05.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-11T22:10:05.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-11T22:10:05.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-11T22:10:05.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-11T22:10:05.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-11T22:10:05.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-11T22:10:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-11T22:10:05.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-11T22:10:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-11T22:10:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-11T22:10:05.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-11T22:10:05.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-11T22:10:05.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-11T22:10:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-11T22:10:05.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-11T22:10:05.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-11T22:10:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-11T22:10:05.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-11T22:10:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-11T22:10:05.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-11T22:10:05.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-11T22:10:05.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-11T22:10:05.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-11T22:10:05.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-11T22:10:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-11T22:10:05.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-11T22:10:05.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-11T22:10:05.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-11T22:10:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-11T22:10:05.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-11T22:10:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-11T22:10:05.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-11T22:10:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-11T22:10:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-11T22:10:05.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-11T22:10:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-11T22:10:05.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-11T22:10:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-11T22:10:05.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-11T22:10:05.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-11T22:10:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-11T22:10:05.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-11T22:10:05.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-11T22:10:05.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-11T22:10:05.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-11T22:10:05.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-11T22:10:05.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-11T22:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-11T22:10:05.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-11T22:10:05.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-11T22:10:05.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-11T22:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-11T22:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-11T22:10:05.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-11T22:10:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-11T22:10:05.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-11T22:10:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-11T22:10:05.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-11T22:10:05.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-11T22:10:05.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-11T22:10:05.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-11T22:10:05.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-11T22:10:05.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-11T22:10:05.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-11T22:10:05.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-11T22:10:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-11T22:10:05.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-11T22:10:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-11T22:10:05.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-11T22:10:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-11T22:10:05.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-11T22:10:05.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-11T22:10:05.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-11T22:10:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-11T22:10:05.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-11T22:10:05.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-11T22:10:05.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-11T22:10:05.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-11T22:10:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-11T22:10:05.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-11T22:10:05.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-11T22:10:05.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T22:10:05.351 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:10:05.352 DEBUG:teuthology.orchestra.run.smithi040:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-11T22:10:05.374 INFO:teuthology.orchestra.run.smithi040.stdout:postinstall scriptlet (using /bin/sh): 2024-09-11T22:10:05.374 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T22:10:05.374 INFO:teuthology.orchestra.run.smithi040.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T22:10:05.374 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout:for file in vmlinuz System.map config; do 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout: fi 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout:done 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-09-11T22:10:05.375 INFO:teuthology.orchestra.run.smithi040.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-11T22:10:05.376 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T22:10:05.376 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:10:05.376 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2024-09-11T22:10:05.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2024-09-11T22:10:05.458 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2024-09-11T22:10:05.458 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2024-09-11T22:10:05.458 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.06 2024-09-11T22:10:05.458 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 82.el9 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Group : Unspecified 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 8274670 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : builder@centos.org 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T22:10:05.459 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2024-09-11T22:10:05.460 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2024-09-11T22:10:05.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:10:05.460 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T22:10:05.460 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T22:10:05.460 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T22:10:05.460 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2024-09-11T22:10:05.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:10:05.460 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T22:10:05.461 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T22:10:05.461 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:10:05.461 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T22:10:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-09-11T22:10:07.538 INFO:teuthology.orchestra.run.smithi040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T22:10:07.572 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-09-11T22:10:07.574 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-09-11T22:10:07.589 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.t3bfRuhuVk 2024-09-11T22:10:07.589 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.t3bfRuhuVk 2024-09-11T22:10:07.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.t3bfRuhuVk 2024-09-11T22:10:07.800 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.t3bfRuhuVk is 6KB 2024-09-11T22:10:07.848 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.t3bfRuhuVk 2024-09-11T22:10:07.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T22:10:07.925 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T22:10:07.925 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T22:10:07.926 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T22:10:07.926 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-11T22:10:07.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:10:08.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-09-11T22:10:38.075 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-11T22:10:38.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T22:10:38.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:11:38.079 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T22:11:47.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T22:11:47.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:11:50.588 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-11T22:11:51.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T22:11:51.117 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-11T22:11:51.117 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-11T22:11:51.151 INFO:teuthology.orchestra.run.smithi040.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:11:51.151 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T22:11:51.151 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T22:11:51.152 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T22:11:52.155 DEBUG:teuthology.parallel:result is None 2024-09-11T22:11:52.156 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T22:11:52.163 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T22:11:52.163 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:11:52.167 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:11:52.170 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:11:52.198 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T22:11:52.205 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T22:11:52.242 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T22:11:52.242 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:11:52.246 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:11:52.248 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:11:52.301 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T22:11:52.345 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T22:11:52.345 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:11:52.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:11:52.362 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:11:52.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:11:52.379 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:11:52.383 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:11:52.405 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:11:52.454 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:11:52.459 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:11:52.475 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:11:52.481 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:11:52.498 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:11:52.570 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:11:52.573 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T22:11:52.580 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T22:11:52.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:11:52.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:11:52.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:11:52.637 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T22:11:52.646 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T22:11:52.646 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:11:52.650 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:11:52.656 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:11:52.682 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:11:52.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:11:52.869 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:11:52.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:11:53.007 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:11:53.008 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:11:53.083 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:11:53.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:11:53.186 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:11:53.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:11:53.314 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:11:53.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:11:53.381 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:11:53.420 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:11:53.491 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:11:53.528 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:11:53.579 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:11:53.579 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:11:53.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-09-11T22:11:53.651 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-09-11T22:11:53.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-09-11T22:11:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:11:53.724 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:11:53.743 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:11:54.124 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T22:11:54.131 INFO:teuthology.task.internal:Starting timer... 2024-09-11T22:11:54.131 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T22:11:54.142 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T22:11:54.254 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-11T22:11:54.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-09-11T22:11:54.366 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-09-11T22:11:54.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-09-11T22:11:54.428 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-09-11T22:11:54.430 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-09-11T22:11:54.467 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-09-11T22:11:54.470 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T22:11:54.470 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-09-11T22:11:54.511 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-09-11T22:11:54.511 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-09-11T22:11:54.539 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-09-11T22:11:54.540 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-09-11T22:11:54.560 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-09-11T22:11:54.560 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-09-11T22:11:54.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:11:54.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:11:54.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:11:54.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:11:54.649 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:11:54.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:11:54.675 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T22:11:54.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:11:54.796 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:11:54.827 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:11:54.857 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T22:11:54.867 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T22:11:54.870 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T22:11:54.998 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T22:11:55.010 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T22:11:55.011 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi146.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T22:16:36.024 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-09-11T22:16:36.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T22:16:36.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:16:36.118 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-11T22:16:36.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-11T22:16:36.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-11T22:16:36.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:16:36.305 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-11T22:16:36.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-11T22:16:36.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-11T22:16:36.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:16:36.462 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-09-11T22:16:36.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-11T22:16:36.550 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T22:16:36.561 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T22:16:36.561 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:16:36.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:16:36.566 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:16:36.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:16:36.569 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:16:36.569 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:16:36.597 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:16:36.612 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:16:36.622 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:16:36.625 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:16:36.636 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-09-11T22:16:36.637 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:16:36.648 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-09-11T22:16:36.654 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:16:36.662 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:16:36.663 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-09-11T22:16:36.674 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-09-11T22:16:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:16:36.689 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:16:36.703 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:16:36.707 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-09-11T22:16:36.732 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-09-11T22:16:36.736 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:16:36.739 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:16:36.740 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-11T22:16:36.740 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.740 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.740 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.740 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.757 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:16:36.760 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:16:36.760 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-09-11T22:16:36.760 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.760 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.760 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.760 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:16:36.790 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:16:36.897 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:16:36.904 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:16:36.904 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-09-11T22:16:36.904 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.904 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.904 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.904 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:16:36.905 INFO:teuthology.run_tasks:Running task install... 2024-09-11T22:16:36.916 DEBUG:teuthology.task.install:project ceph 2024-09-11T22:16:36.917 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T22:16:36.917 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T22:16:36.917 INFO:teuthology.task.install:Using flavor: default 2024-09-11T22:16:36.923 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T22:16:36.923 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T22:16:36.923 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:16:36.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:16:36.926 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:16:36.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:16:36.927 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:16:36.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:16:37.077 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:16:37.077 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:16:37.083 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:16:37.083 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:16:37.088 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:16:37.088 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:16:37.191 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:16:37.191 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:16:37.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:16:37.196 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:16:37.196 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:16:37.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:16:37.204 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:16:37.205 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:16:37.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:16:37.224 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:16:37.224 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:16:37.230 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:16:37.230 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:16:37.247 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:16:37.247 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:16:37.290 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:16:37.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:16:37.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:16:37.365 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:16:37.369 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:16:37.423 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:16:37.429 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-09-11T22:16:37.431 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-09-11T22:16:37.433 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-09-11T22:16:37.435 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-09-11T22:16:37.478 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-09-11T22:16:37.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-09-11T22:16:37.656 INFO:teuthology.orchestra.run.smithi177.stdout:45 files removed 2024-09-11T22:16:37.660 INFO:teuthology.orchestra.run.smithi146.stdout:45 files removed 2024-09-11T22:16:37.683 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:16:37.687 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:16:37.764 INFO:teuthology.orchestra.run.smithi040.stdout:45 files removed 2024-09-11T22:16:37.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:16:38.233 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-11T22:16:38.239 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-11T22:16:38.492 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 292 kB/s | 84 kB 00:00 2024-09-11T22:16:38.509 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-11T22:16:38.531 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-11T22:16:38.776 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-11T22:16:38.776 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T22:16:38.807 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-11T22:16:39.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 6.6 kB/s | 1.9 kB 00:00 2024-09-11T22:16:39.768 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T22:16:40.382 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-11T22:16:40.759 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.2 MB 00:01 2024-09-11T22:16:42.283 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-11T22:16:43.253 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-11T22:16:46.609 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-11T22:16:47.429 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 3.1 MB/s | 20 MB 00:06 2024-09-11T22:16:48.326 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-11T22:16:48.761 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-11T22:16:49.113 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-11T22:16:50.236 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-11T22:16:51.390 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T22:16:54.145 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-11T22:16:54.736 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-11T22:16:55.929 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-11T22:16:56.758 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-11T22:16:56.813 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-11T22:16:57.013 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:16:57.013 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:16:57.025 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:16:57.025 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:16:57.026 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:16:57.027 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:16:57.029 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:16:57.031 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:16:57.032 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:16:57.095 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-11T22:16:57.112 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:16:57.113 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:16:57.114 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:16:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:16:57.116 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:16:57.117 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:16:57.118 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:16:57.119 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:16:57.120 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:16:57.121 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:16:57.122 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:16:57.123 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:16:57.124 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:16:57.125 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-09-11T22:16:57.126 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:16:57.126 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:16:57.126 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-11T22:16:57.126 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2024-09-11T22:16:57.126 INFO:teuthology.orchestra.run.smithi146.stdout:Install 148 Packages 2024-09-11T22:16:57.126 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 8 Packages 2024-09-11T22:16:57.126 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:16:57.127 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 226 M 2024-09-11T22:16:57.127 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-11T22:16:57.579 INFO:teuthology.orchestra.run.smithi146.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-11T22:16:57.812 INFO:teuthology.orchestra.run.smithi146.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.8 MB/s | 897 kB 00:00 2024-09-11T22:16:57.921 INFO:teuthology.orchestra.run.smithi146.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-11T22:16:57.946 INFO:teuthology.orchestra.run.smithi146.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.1 MB/s | 145 kB 00:00 2024-09-11T22:16:58.030 INFO:teuthology.orchestra.run.smithi146.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 22 MB/s | 2.4 MB 00:00 2024-09-11T22:16:58.163 INFO:teuthology.orchestra.run.smithi146.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 7.0 MB/s | 1.5 MB 00:00 2024-09-11T22:16:58.264 INFO:teuthology.orchestra.run.smithi146.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 20 MB/s | 4.7 MB 00:00 2024-09-11T22:16:58.739 INFO:teuthology.orchestra.run.smithi146.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 16 MB/s | 21 MB 00:01 2024-09-11T22:16:58.906 INFO:teuthology.orchestra.run.smithi146.stdout:(9/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 17 MB/s | 11 MB 00:00 2024-09-11T22:16:58.931 INFO:teuthology.orchestra.run.smithi146.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 131 kB/s | 25 kB 00:00 2024-09-11T22:16:58.998 INFO:teuthology.orchestra.run.smithi146.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 228 kB 00:00 2024-09-11T22:16:59.065 INFO:teuthology.orchestra.run.smithi146.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 405 kB/s | 27 kB 00:00 2024-09-11T22:16:59.125 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:16:59.126 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:16:59.132 INFO:teuthology.orchestra.run.smithi146.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 476 kB/s | 32 kB 00:00 2024-09-11T22:16:59.139 INFO:teuthology.orchestra.run.smithi177.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:16:59.140 INFO:teuthology.orchestra.run.smithi177.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:16:59.141 INFO:teuthology.orchestra.run.smithi177.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:16:59.142 INFO:teuthology.orchestra.run.smithi177.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:16:59.144 INFO:teuthology.orchestra.run.smithi177.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:16:59.147 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:16:59.148 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:16:59.211 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-09-11T22:16:59.226 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================== 2024-09-11T22:16:59.226 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-09-11T22:16:59.226 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================== 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:16:59.227 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:16:59.228 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:16:59.229 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:16:59.230 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:16:59.231 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:16:59.232 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:16:59.233 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:16:59.234 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:16:59.235 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:16:59.236 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:16:59.237 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:16:59.238 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:16:59.239 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:16:59.239 INFO:teuthology.orchestra.run.smithi177.stdout:Installing weak dependencies: 2024-09-11T22:16:59.239 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:16:59.239 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:16:59.239 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-09-11T22:16:59.239 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================== 2024-09-11T22:16:59.239 INFO:teuthology.orchestra.run.smithi177.stdout:Install 148 Packages 2024-09-11T22:16:59.239 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 8 Packages 2024-09-11T22:16:59.239 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:16:59.240 INFO:teuthology.orchestra.run.smithi146.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 752 kB 00:00 2024-09-11T22:16:59.240 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 226 M 2024-09-11T22:16:59.240 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-09-11T22:16:59.299 INFO:teuthology.orchestra.run.smithi146.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-11T22:16:59.383 INFO:teuthology.orchestra.run.smithi146.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-11T22:16:59.466 INFO:teuthology.orchestra.run.smithi146.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-11T22:16:59.808 INFO:teuthology.orchestra.run.smithi146.stdout:(18/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 17 MB 00:01 2024-09-11T22:16:59.822 INFO:teuthology.orchestra.run.smithi177.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 42 kB/s | 6.5 kB 00:00 2024-09-11T22:16:59.892 INFO:teuthology.orchestra.run.smithi146.stdout:(19/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-11T22:16:59.917 INFO:teuthology.orchestra.run.smithi146.stdout:(20/156): python3-ceph-argparse-19.1.1-298.gb53 416 kB/s | 45 kB 00:00 2024-09-11T22:16:59.951 INFO:teuthology.orchestra.run.smithi146.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-11T22:16:59.976 INFO:teuthology.orchestra.run.smithi146.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-11T22:17:00.031 INFO:teuthology.orchestra.run.smithi177.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.2 MB/s | 897 kB 00:00 2024-09-11T22:17:00.035 INFO:teuthology.orchestra.run.smithi146.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.7 MB/s | 321 kB 00:00 2024-09-11T22:17:00.068 INFO:teuthology.orchestra.run.smithi146.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.2 MB/s | 301 kB 00:00 2024-09-11T22:17:00.135 INFO:teuthology.orchestra.run.smithi146.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.0 MB/s | 100 kB 00:00 2024-09-11T22:17:00.160 INFO:teuthology.orchestra.run.smithi146.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 936 kB/s | 85 kB 00:00 2024-09-11T22:17:00.173 INFO:teuthology.orchestra.run.smithi177.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-11T22:17:00.198 INFO:teuthology.orchestra.run.smithi177.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 868 kB/s | 145 kB 00:00 2024-09-11T22:17:00.252 INFO:teuthology.orchestra.run.smithi146.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-11T22:17:00.344 INFO:teuthology.orchestra.run.smithi146.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 347 kB/s | 32 kB 00:00 2024-09-11T22:17:00.444 INFO:teuthology.orchestra.run.smithi146.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-11T22:17:00.444 INFO:teuthology.orchestra.run.smithi146.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.6 MB/s | 146 kB 00:00 2024-09-11T22:17:00.550 INFO:teuthology.orchestra.run.smithi177.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 6.5 MB/s | 2.4 MB 00:00 2024-09-11T22:17:00.583 INFO:teuthology.orchestra.run.smithi177.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 4.0 MB/s | 1.5 MB 00:00 2024-09-11T22:17:00.762 INFO:teuthology.orchestra.run.smithi146.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 10 MB/s | 3.6 MB 00:00 2024-09-11T22:17:00.899 INFO:teuthology.orchestra.run.smithi177.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-11T22:17:01.204 INFO:teuthology.orchestra.run.smithi146.stdout:(32/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 21 MB/s | 49 MB 00:02 2024-09-11T22:17:01.229 INFO:teuthology.orchestra.run.smithi146.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 534 kB/s | 249 kB 00:00 2024-09-11T22:17:01.263 INFO:teuthology.orchestra.run.smithi146.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 847 kB/s | 49 kB 00:00 2024-09-11T22:17:01.288 INFO:teuthology.orchestra.run.smithi146.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 281 kB/s | 16 kB 00:00 2024-09-11T22:17:01.338 INFO:teuthology.orchestra.run.smithi146.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 285 kB 00:00 2024-09-11T22:17:01.416 INFO:teuthology.orchestra.run.smithi177.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 21 MB/s | 11 MB 00:00 2024-09-11T22:17:01.430 INFO:teuthology.orchestra.run.smithi146.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 7.5 MB/s | 7.4 MB 00:00 2024-09-11T22:17:01.455 INFO:teuthology.orchestra.run.smithi146.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 156 kB/s | 18 kB 00:00 2024-09-11T22:17:01.497 INFO:teuthology.orchestra.run.smithi146.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.6 MB/s | 765 kB 00:00 2024-09-11T22:17:01.633 INFO:teuthology.orchestra.run.smithi177.stdout:(9/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 21 MB 00:01 2024-09-11T22:17:01.658 INFO:teuthology.orchestra.run.smithi177.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 104 kB/s | 25 kB 00:00 2024-09-11T22:17:01.664 INFO:teuthology.orchestra.run.smithi146.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 342 kB/s | 80 kB 00:00 2024-09-11T22:17:01.698 INFO:teuthology.orchestra.run.smithi146.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 954 kB/s | 191 kB 00:00 2024-09-11T22:17:01.708 INFO:teuthology.orchestra.run.smithi177.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-11T22:17:01.758 INFO:teuthology.orchestra.run.smithi177.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 542 kB/s | 27 kB 00:00 2024-09-11T22:17:01.773 INFO:teuthology.orchestra.run.smithi146.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-11T22:17:01.798 INFO:teuthology.orchestra.run.smithi146.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-11T22:17:01.809 INFO:teuthology.orchestra.run.smithi177.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 635 kB/s | 32 kB 00:00 2024-09-11T22:17:01.832 INFO:teuthology.orchestra.run.smithi146.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-11T22:17:01.857 INFO:teuthology.orchestra.run.smithi146.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-11T22:17:01.876 INFO:teuthology.orchestra.run.smithi177.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 752 kB 00:00 2024-09-11T22:17:01.899 INFO:teuthology.orchestra.run.smithi146.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-11T22:17:01.924 INFO:teuthology.orchestra.run.smithi146.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-11T22:17:01.934 INFO:teuthology.orchestra.run.smithi177.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-11T22:17:01.950 INFO:teuthology.orchestra.run.smithi146.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-11T22:17:01.984 INFO:teuthology.orchestra.run.smithi177.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-11T22:17:02.051 INFO:teuthology.orchestra.run.smithi177.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-11T22:17:02.091 INFO:teuthology.orchestra.run.smithi146.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 755 kB/s | 107 kB 00:00 2024-09-11T22:17:02.125 INFO:teuthology.orchestra.run.smithi146.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-11T22:17:02.150 INFO:teuthology.orchestra.run.smithi146.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-11T22:17:02.184 INFO:teuthology.orchestra.run.smithi146.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-09-11T22:17:02.209 INFO:teuthology.orchestra.run.smithi146.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-11T22:17:02.235 INFO:teuthology.orchestra.run.smithi146.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-11T22:17:02.260 INFO:teuthology.orchestra.run.smithi146.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-11T22:17:02.285 INFO:teuthology.orchestra.run.smithi146.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-11T22:17:02.310 INFO:teuthology.orchestra.run.smithi146.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-11T22:17:02.326 INFO:teuthology.orchestra.run.smithi177.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-11T22:17:02.336 INFO:teuthology.orchestra.run.smithi146.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-11T22:17:02.377 INFO:teuthology.orchestra.run.smithi177.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 905 kB/s | 45 kB 00:00 2024-09-11T22:17:02.395 INFO:teuthology.orchestra.run.smithi146.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-11T22:17:02.420 INFO:teuthology.orchestra.run.smithi146.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-11T22:17:02.435 INFO:teuthology.orchestra.run.smithi177.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-11T22:17:02.436 INFO:teuthology.orchestra.run.smithi146.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 589 kB/s | 24 kB 00:00 2024-09-11T22:17:02.470 INFO:teuthology.orchestra.run.smithi146.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-11T22:17:02.494 INFO:teuthology.orchestra.run.smithi177.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.7 MB/s | 162 kB 00:00 2024-09-11T22:17:02.504 INFO:teuthology.orchestra.run.smithi146.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-11T22:17:02.537 INFO:teuthology.orchestra.run.smithi146.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-11T22:17:02.553 INFO:teuthology.orchestra.run.smithi177.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-11T22:17:02.563 INFO:teuthology.orchestra.run.smithi146.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 656 kB/s | 38 kB 00:00 2024-09-11T22:17:02.588 INFO:teuthology.orchestra.run.smithi146.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-11T22:17:02.680 INFO:teuthology.orchestra.run.smithi146.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-11T22:17:02.722 INFO:teuthology.orchestra.run.smithi146.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-11T22:17:02.736 INFO:teuthology.orchestra.run.smithi177.stdout:(23/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 7.8 MB/s | 17 MB 00:02 2024-09-11T22:17:02.756 INFO:teuthology.orchestra.run.smithi146.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-11T22:17:02.761 INFO:teuthology.orchestra.run.smithi177.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 1.4 MB/s | 301 kB 00:00 2024-09-11T22:17:02.789 INFO:teuthology.orchestra.run.smithi146.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-11T22:17:02.808 INFO:teuthology.orchestra.run.smithi177.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.4 MB/s | 100 kB 00:00 2024-09-11T22:17:02.837 INFO:teuthology.orchestra.run.smithi177.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-11T22:17:02.865 INFO:teuthology.orchestra.run.smithi146.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-11T22:17:02.887 INFO:teuthology.orchestra.run.smithi177.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-11T22:17:02.906 INFO:teuthology.orchestra.run.smithi146.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-11T22:17:02.931 INFO:teuthology.orchestra.run.smithi146.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-11T22:17:02.937 INFO:teuthology.orchestra.run.smithi177.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 639 kB/s | 32 kB 00:00 2024-09-11T22:17:02.988 INFO:teuthology.orchestra.run.smithi177.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T22:17:03.024 INFO:teuthology.orchestra.run.smithi146.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-11T22:17:03.049 INFO:teuthology.orchestra.run.smithi146.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-11T22:17:03.074 INFO:teuthology.orchestra.run.smithi146.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-11T22:17:03.100 INFO:teuthology.orchestra.run.smithi146.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-11T22:17:03.125 INFO:teuthology.orchestra.run.smithi146.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-11T22:17:03.130 INFO:teuthology.orchestra.run.smithi177.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 9.6 MB/s | 3.1 MB 00:00 2024-09-11T22:17:03.150 INFO:teuthology.orchestra.run.smithi146.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-11T22:17:03.183 INFO:teuthology.orchestra.run.smithi146.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T22:17:03.197 INFO:teuthology.orchestra.run.smithi177.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 17 MB/s | 3.6 MB 00:00 2024-09-11T22:17:03.209 INFO:teuthology.orchestra.run.smithi146.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-11T22:17:03.247 INFO:teuthology.orchestra.run.smithi177.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-11T22:17:03.297 INFO:teuthology.orchestra.run.smithi177.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 991 kB/s | 49 kB 00:00 2024-09-11T22:17:03.301 INFO:teuthology.orchestra.run.smithi146.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-11T22:17:03.326 INFO:teuthology.orchestra.run.smithi146.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-11T22:17:03.356 INFO:teuthology.orchestra.run.smithi177.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 281 kB/s | 16 kB 00:00 2024-09-11T22:17:03.360 INFO:teuthology.orchestra.run.smithi146.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-11T22:17:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-11T22:17:03.386 INFO:teuthology.orchestra.run.smithi146.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-11T22:17:03.410 INFO:teuthology.orchestra.run.smithi146.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-11T22:17:03.415 INFO:teuthology.orchestra.run.smithi177.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-11T22:17:03.435 INFO:teuthology.orchestra.run.smithi146.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-11T22:17:03.477 INFO:teuthology.orchestra.run.smithi146.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-11T22:17:03.498 INFO:teuthology.orchestra.run.smithi177.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-11T22:17:03.503 INFO:teuthology.orchestra.run.smithi146.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-11T22:17:03.528 INFO:teuthology.orchestra.run.smithi146.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T22:17:03.553 INFO:teuthology.orchestra.run.smithi146.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-11T22:17:03.557 INFO:teuthology.orchestra.run.smithi177.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 312 kB/s | 18 kB 00:00 2024-09-11T22:17:03.629 INFO:teuthology.orchestra.run.smithi146.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-11T22:17:03.654 INFO:teuthology.orchestra.run.smithi146.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-11T22:17:03.679 INFO:teuthology.orchestra.run.smithi146.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-11T22:17:03.704 INFO:teuthology.orchestra.run.smithi146.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-11T22:17:03.730 INFO:teuthology.orchestra.run.smithi146.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-11T22:17:03.755 INFO:teuthology.orchestra.run.smithi146.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-11T22:17:03.780 INFO:teuthology.orchestra.run.smithi146.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-11T22:17:03.806 INFO:teuthology.orchestra.run.smithi146.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T22:17:03.831 INFO:teuthology.orchestra.run.smithi146.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-11T22:17:03.833 INFO:teuthology.orchestra.run.smithi177.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-11T22:17:03.856 INFO:teuthology.orchestra.run.smithi146.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T22:17:03.881 INFO:teuthology.orchestra.run.smithi146.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-11T22:17:03.965 INFO:teuthology.orchestra.run.smithi146.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-11T22:17:04.032 INFO:teuthology.orchestra.run.smithi146.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-11T22:17:04.066 INFO:teuthology.orchestra.run.smithi146.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T22:17:04.091 INFO:teuthology.orchestra.run.smithi146.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-11T22:17:04.125 INFO:teuthology.orchestra.run.smithi146.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-11T22:17:04.166 INFO:teuthology.orchestra.run.smithi146.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 655 kB/s | 26 kB 00:00 2024-09-11T22:17:04.192 INFO:teuthology.orchestra.run.smithi146.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T22:17:04.217 INFO:teuthology.orchestra.run.smithi146.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-11T22:17:04.250 INFO:teuthology.orchestra.run.smithi146.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-11T22:17:04.308 INFO:teuthology.orchestra.run.smithi177.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 18 MB/s | 49 MB 00:02 2024-09-11T22:17:04.333 INFO:teuthology.orchestra.run.smithi177.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 103 kB/s | 80 kB 00:00 2024-09-11T22:17:04.418 INFO:teuthology.orchestra.run.smithi146.stdout:(112/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-11T22:17:04.459 INFO:teuthology.orchestra.run.smithi146.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-09-11T22:17:04.485 INFO:teuthology.orchestra.run.smithi146.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.8 MB/s | 43 kB 00:00 2024-09-11T22:17:04.510 INFO:teuthology.orchestra.run.smithi146.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T22:17:04.535 INFO:teuthology.orchestra.run.smithi146.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-11T22:17:04.569 INFO:teuthology.orchestra.run.smithi146.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-11T22:17:04.594 INFO:teuthology.orchestra.run.smithi146.stdout:(118/156): python3-asyncssh-2.13.2-5.el9.noarch 3.0 MB/s | 548 kB 00:00 2024-09-11T22:17:04.628 INFO:teuthology.orchestra.run.smithi146.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T22:17:04.653 INFO:teuthology.orchestra.run.smithi146.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T22:17:04.679 INFO:teuthology.orchestra.run.smithi146.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T22:17:04.704 INFO:teuthology.orchestra.run.smithi146.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-11T22:17:04.717 INFO:teuthology.orchestra.run.smithi177.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 661 kB/s | 253 kB 00:00 2024-09-11T22:17:04.721 INFO:teuthology.orchestra.run.smithi146.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 651 kB/s | 11 kB 00:00 2024-09-11T22:17:04.738 INFO:teuthology.orchestra.run.smithi146.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-11T22:17:04.763 INFO:teuthology.orchestra.run.smithi146.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-11T22:17:04.780 INFO:teuthology.orchestra.run.smithi146.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-11T22:17:04.847 INFO:teuthology.orchestra.run.smithi146.stdout:(127/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-09-11T22:17:04.858 INFO:teuthology.orchestra.run.smithi177.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-11T22:17:04.864 INFO:teuthology.orchestra.run.smithi146.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-09-11T22:17:04.881 INFO:teuthology.orchestra.run.smithi146.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-11T22:17:04.906 INFO:teuthology.orchestra.run.smithi146.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T22:17:04.931 INFO:teuthology.orchestra.run.smithi146.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T22:17:04.965 INFO:teuthology.orchestra.run.smithi146.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-11T22:17:04.967 INFO:teuthology.orchestra.run.smithi177.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 106 kB 00:00 2024-09-11T22:17:05.007 INFO:teuthology.orchestra.run.smithi146.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-11T22:17:05.032 INFO:teuthology.orchestra.run.smithi146.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-09-11T22:17:05.057 INFO:teuthology.orchestra.run.smithi146.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-11T22:17:05.108 INFO:teuthology.orchestra.run.smithi146.stdout:(136/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-09-11T22:17:05.126 INFO:teuthology.orchestra.run.smithi177.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 620 kB/s | 801 kB 00:01 2024-09-11T22:17:05.133 INFO:teuthology.orchestra.run.smithi146.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-11T22:17:05.158 INFO:teuthology.orchestra.run.smithi146.stdout:(138/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 716 kB/s | 90 kB 00:00 2024-09-11T22:17:05.159 INFO:teuthology.orchestra.run.smithi177.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 704 kB/s | 135 kB 00:00 2024-09-11T22:17:05.184 INFO:teuthology.orchestra.run.smithi146.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-11T22:17:05.209 INFO:teuthology.orchestra.run.smithi146.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-11T22:17:05.234 INFO:teuthology.orchestra.run.smithi146.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-11T22:17:05.243 INFO:teuthology.orchestra.run.smithi177.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-11T22:17:05.259 INFO:teuthology.orchestra.run.smithi146.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-11T22:17:05.285 INFO:teuthology.orchestra.run.smithi146.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T22:17:05.310 INFO:teuthology.orchestra.run.smithi146.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T22:17:05.335 INFO:teuthology.orchestra.run.smithi146.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-11T22:17:05.360 INFO:teuthology.orchestra.run.smithi146.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T22:17:05.386 INFO:teuthology.orchestra.run.smithi146.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T22:17:05.401 INFO:teuthology.orchestra.run.smithi177.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 1.8 MB/s | 1.2 MB 00:00 2024-09-11T22:17:05.436 INFO:teuthology.orchestra.run.smithi146.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T22:17:05.443 INFO:teuthology.orchestra.run.smithi177.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 756 kB/s | 215 kB 00:00 2024-09-11T22:17:05.535 INFO:teuthology.orchestra.run.smithi177.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-11T22:17:05.586 INFO:teuthology.orchestra.run.smithi177.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-11T22:17:05.644 INFO:teuthology.orchestra.run.smithi177.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 533 kB/s | 107 kB 00:00 2024-09-11T22:17:05.678 INFO:teuthology.orchestra.run.smithi177.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-11T22:17:05.704 INFO:teuthology.orchestra.run.smithi177.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-11T22:17:05.738 INFO:teuthology.orchestra.run.smithi177.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-11T22:17:05.754 INFO:teuthology.orchestra.run.smithi177.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-09-11T22:17:05.779 INFO:teuthology.orchestra.run.smithi177.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 265 kB/s | 11 kB 00:00 2024-09-11T22:17:05.838 INFO:teuthology.orchestra.run.smithi177.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-11T22:17:05.854 INFO:teuthology.orchestra.run.smithi177.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-09-11T22:17:05.946 INFO:teuthology.orchestra.run.smithi177.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-11T22:17:05.952 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:17:05.953 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:17:05.965 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:17:05.966 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:17:05.967 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:17:05.967 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:17:05.969 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:17:05.970 INFO:teuthology.orchestra.run.smithi146.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 4.3 MB/s | 2.3 MB 00:00 2024-09-11T22:17:05.971 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:17:05.972 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:17:05.980 INFO:teuthology.orchestra.run.smithi177.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-11T22:17:05.997 INFO:teuthology.orchestra.run.smithi177.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-11T22:17:06.028 INFO:teuthology.orchestra.run.smithi146.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 5.1 MB/s | 3.4 MB 00:00 2024-09-11T22:17:06.030 INFO:teuthology.orchestra.run.smithi177.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-11T22:17:06.041 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-11T22:17:06.062 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================== 2024-09-11T22:17:06.062 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-09-11T22:17:06.062 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================== 2024-09-11T22:17:06.062 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-09-11T22:17:06.062 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:17:06.062 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:17:06.063 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:17:06.063 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:17:06.063 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:17:06.063 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:17:06.063 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:17:06.063 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:17:06.063 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:17:06.063 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:17:06.063 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:17:06.064 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:17:06.065 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:17:06.066 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:17:06.067 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:17:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:17:06.069 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:17:06.070 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:17:06.071 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:17:06.072 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:17:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:17:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:17:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:17:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:17:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:17:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:17:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:17:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:17:06.073 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:17:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:17:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:17:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:17:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:17:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:17:06.074 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:17:06.075 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:17:06.075 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:17:06.075 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:17:06.075 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:17:06.075 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:17:06.075 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:17:06.075 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:17:06.076 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:17:06.076 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:17:06.076 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:17:06.076 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:17:06.076 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:17:06.076 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:17:06.076 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-09-11T22:17:06.076 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:17:06.076 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:17:06.077 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-09-11T22:17:06.077 INFO:teuthology.orchestra.run.smithi040.stdout:====================================================================================== 2024-09-11T22:17:06.077 INFO:teuthology.orchestra.run.smithi040.stdout:Install 148 Packages 2024-09-11T22:17:06.077 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 8 Packages 2024-09-11T22:17:06.077 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:17:06.078 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 226 M 2024-09-11T22:17:06.078 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-09-11T22:17:06.097 INFO:teuthology.orchestra.run.smithi177.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.1 MB/s | 3.0 MB 00:00 2024-09-11T22:17:06.112 INFO:teuthology.orchestra.run.smithi146.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 490 kB/s | 41 kB 00:00 2024-09-11T22:17:06.122 INFO:teuthology.orchestra.run.smithi177.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-11T22:17:06.148 INFO:teuthology.orchestra.run.smithi177.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-11T22:17:06.173 INFO:teuthology.orchestra.run.smithi177.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-11T22:17:06.229 INFO:teuthology.orchestra.run.smithi146.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-11T22:17:06.332 INFO:teuthology.orchestra.run.smithi177.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-11T22:17:06.432 INFO:teuthology.orchestra.run.smithi177.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-11T22:17:06.491 INFO:teuthology.orchestra.run.smithi177.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-11T22:17:06.529 INFO:teuthology.orchestra.run.smithi146.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-11T22:17:06.651 INFO:teuthology.orchestra.run.smithi177.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 9.4 MB/s | 4.9 MB 00:00 2024-09-11T22:17:06.716 INFO:teuthology.orchestra.run.smithi177.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-09-11T22:17:06.775 INFO:teuthology.orchestra.run.smithi177.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T22:17:06.817 INFO:teuthology.orchestra.run.smithi177.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-09-11T22:17:06.884 INFO:teuthology.orchestra.run.smithi177.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 923 kB/s | 61 kB 00:00 2024-09-11T22:17:06.959 INFO:teuthology.orchestra.run.smithi177.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-09-11T22:17:06.963 INFO:teuthology.orchestra.run.smithi146.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:00 2024-09-11T22:17:06.984 INFO:teuthology.orchestra.run.smithi177.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-11T22:17:07.018 INFO:teuthology.orchestra.run.smithi177.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-11T22:17:07.043 INFO:teuthology.orchestra.run.smithi177.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-11T22:17:07.065 INFO:teuthology.orchestra.run.smithi040.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 22 kB/s | 6.5 kB 00:00 2024-09-11T22:17:07.068 INFO:teuthology.orchestra.run.smithi177.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-11T22:17:07.102 INFO:teuthology.orchestra.run.smithi177.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T22:17:07.127 INFO:teuthology.orchestra.run.smithi177.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-09-11T22:17:07.186 INFO:teuthology.orchestra.run.smithi177.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-11T22:17:07.261 INFO:teuthology.orchestra.run.smithi177.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-11T22:17:07.286 INFO:teuthology.orchestra.run.smithi177.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-11T22:17:07.320 INFO:teuthology.orchestra.run.smithi177.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-11T22:17:07.345 INFO:teuthology.orchestra.run.smithi177.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-11T22:17:07.387 INFO:teuthology.orchestra.run.smithi177.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-11T22:17:07.412 INFO:teuthology.orchestra.run.smithi177.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-11T22:17:07.446 INFO:teuthology.orchestra.run.smithi177.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-11T22:17:07.471 INFO:teuthology.orchestra.run.smithi177.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-11T22:17:07.538 INFO:teuthology.orchestra.run.smithi177.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-11T22:17:07.563 INFO:teuthology.orchestra.run.smithi177.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 458 kB/s | 54 kB 00:00 2024-09-11T22:17:07.605 INFO:teuthology.orchestra.run.smithi177.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-09-11T22:17:07.630 INFO:teuthology.orchestra.run.smithi177.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-09-11T22:17:07.664 INFO:teuthology.orchestra.run.smithi177.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T22:17:07.681 INFO:teuthology.orchestra.run.smithi177.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 712 kB/s | 36 kB 00:00 2024-09-11T22:17:07.713 INFO:teuthology.orchestra.run.smithi146.stdout:(155/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 3.2 MB 00:02 2024-09-11T22:17:07.714 INFO:teuthology.orchestra.run.smithi177.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-11T22:17:07.740 INFO:teuthology.orchestra.run.smithi177.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-11T22:17:07.765 INFO:teuthology.orchestra.run.smithi177.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T22:17:07.799 INFO:teuthology.orchestra.run.smithi177.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-11T22:17:07.804 INFO:teuthology.orchestra.run.smithi146.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-09-11T22:17:07.811 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:17:07.812 INFO:teuthology.orchestra.run.smithi146.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-11T22:17:07.816 INFO:teuthology.orchestra.run.smithi177.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T22:17:07.849 INFO:teuthology.orchestra.run.smithi177.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-11T22:17:07.866 INFO:teuthology.orchestra.run.smithi040.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 897 kB 00:00 2024-09-11T22:17:07.900 INFO:teuthology.orchestra.run.smithi177.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-09-11T22:17:07.950 INFO:teuthology.orchestra.run.smithi177.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-11T22:17:07.966 INFO:teuthology.orchestra.run.smithi040.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.4 MB/s | 145 kB 00:00 2024-09-11T22:17:07.984 INFO:teuthology.orchestra.run.smithi177.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-09-11T22:17:08.009 INFO:teuthology.orchestra.run.smithi177.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-11T22:17:08.076 INFO:teuthology.orchestra.run.smithi177.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-11T22:17:08.159 INFO:teuthology.orchestra.run.smithi177.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-11T22:17:08.185 INFO:teuthology.orchestra.run.smithi177.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T22:17:08.210 INFO:teuthology.orchestra.run.smithi177.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 194 kB/s | 26 kB 00:00 2024-09-11T22:17:08.227 INFO:teuthology.orchestra.run.smithi177.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-11T22:17:08.377 INFO:teuthology.orchestra.run.smithi177.stdout:(112/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-11T22:17:08.403 INFO:teuthology.orchestra.run.smithi177.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 788 kB/s | 151 kB 00:00 2024-09-11T22:17:08.436 INFO:teuthology.orchestra.run.smithi177.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.6 MB/s | 43 kB 00:00 2024-09-11T22:17:08.461 INFO:teuthology.orchestra.run.smithi177.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-11T22:17:08.486 INFO:teuthology.orchestra.run.smithi177.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-11T22:17:08.512 INFO:teuthology.orchestra.run.smithi177.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.9 MB/s | 839 kB 00:00 2024-09-11T22:17:08.537 INFO:teuthology.orchestra.run.smithi177.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T22:17:08.562 INFO:teuthology.orchestra.run.smithi177.stdout:(119/156): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-09-11T22:17:08.588 INFO:teuthology.orchestra.run.smithi177.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-11T22:17:08.670 INFO:teuthology.orchestra.run.smithi177.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-11T22:17:08.738 INFO:teuthology.orchestra.run.smithi177.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.2 MB/s | 220 kB 00:00 2024-09-11T22:17:08.763 INFO:teuthology.orchestra.run.smithi177.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-11T22:17:08.789 INFO:teuthology.orchestra.run.smithi177.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-11T22:17:08.814 INFO:teuthology.orchestra.run.smithi177.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-11T22:17:08.839 INFO:teuthology.orchestra.run.smithi177.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 464 kB/s | 23 kB 00:00 2024-09-11T22:17:08.864 INFO:teuthology.orchestra.run.smithi177.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-11T22:17:08.890 INFO:teuthology.orchestra.run.smithi177.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-11T22:17:08.915 INFO:teuthology.orchestra.run.smithi177.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T22:17:08.949 INFO:teuthology.orchestra.run.smithi177.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-11T22:17:08.974 INFO:teuthology.orchestra.run.smithi177.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T22:17:09.008 INFO:teuthology.orchestra.run.smithi177.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-11T22:17:09.033 INFO:teuthology.orchestra.run.smithi177.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 665 kB/s | 16 kB 00:00 2024-09-11T22:17:09.051 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-11T22:17:09.058 INFO:teuthology.orchestra.run.smithi177.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-11T22:17:09.083 INFO:teuthology.orchestra.run.smithi177.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T22:17:09.109 INFO:teuthology.orchestra.run.smithi177.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-11T22:17:09.167 INFO:teuthology.orchestra.run.smithi177.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-11T22:17:09.193 INFO:teuthology.orchestra.run.smithi177.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 283 kB/s | 31 kB 00:00 2024-09-11T22:17:09.201 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-11T22:17:09.201 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-11T22:17:09.218 INFO:teuthology.orchestra.run.smithi177.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-11T22:17:09.243 INFO:teuthology.orchestra.run.smithi177.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-11T22:17:09.269 INFO:teuthology.orchestra.run.smithi177.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-11T22:17:09.294 INFO:teuthology.orchestra.run.smithi177.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-11T22:17:09.299 INFO:teuthology.orchestra.run.smithi040.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 1.8 MB/s | 2.4 MB 00:01 2024-09-11T22:17:09.319 INFO:teuthology.orchestra.run.smithi177.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-11T22:17:09.344 INFO:teuthology.orchestra.run.smithi177.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T22:17:09.369 INFO:teuthology.orchestra.run.smithi177.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-11T22:17:09.395 INFO:teuthology.orchestra.run.smithi177.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T22:17:09.428 INFO:teuthology.orchestra.run.smithi177.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-11T22:17:09.479 INFO:teuthology.orchestra.run.smithi177.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T22:17:09.783 INFO:teuthology.orchestra.run.smithi040.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 1.8 MB/s | 5.4 MB 00:03 2024-09-11T22:17:09.812 INFO:teuthology.orchestra.run.smithi177.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 8.2 MB/s | 3.4 MB 00:00 2024-09-11T22:17:09.900 INFO:teuthology.orchestra.run.smithi040.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 1.5 MB 00:00 2024-09-11T22:17:10.387 INFO:teuthology.orchestra.run.smithi177.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 3.3 MB/s | 3.2 MB 00:00 2024-09-11T22:17:10.529 INFO:teuthology.orchestra.run.smithi177.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-09-11T22:17:10.646 INFO:teuthology.orchestra.run.smithi177.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-11T22:17:10.663 INFO:teuthology.orchestra.run.smithi177.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 148 kB/s | 41 kB 00:00 2024-09-11T22:17:10.788 INFO:teuthology.orchestra.run.smithi177.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 9.5 MB/s | 1.4 MB 00:00 2024-09-11T22:17:10.994 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-11T22:17:10.998 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-11T22:17:11.075 INFO:teuthology.orchestra.run.smithi040.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 3.6 MB/s | 4.7 MB 00:01 2024-09-11T22:17:11.330 INFO:teuthology.orchestra.run.smithi177.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 2.4 MB 00:00 2024-09-11T22:17:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:(156/156): NetworkManager-libnm-1.49.90-1.el9.x 1.0 MB/s | 1.8 MB 00:01 2024-09-11T22:17:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:17:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-11T22:17:12.876 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-09-11T22:17:12.909 INFO:teuthology.orchestra.run.smithi040.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 3.5 MB/s | 21 MB 00:06 2024-09-11T22:17:13.023 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-09-11T22:17:13.024 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-09-11T22:17:13.034 INFO:teuthology.orchestra.run.smithi040.stdout:(9/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 5.4 MB/s | 11 MB 00:01 2024-09-11T22:17:13.051 INFO:teuthology.orchestra.run.smithi040.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 178 kB/s | 25 kB 00:00 2024-09-11T22:17:13.118 INFO:teuthology.orchestra.run.smithi040.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.3 MB/s | 228 kB 00:00 2024-09-11T22:17:13.151 INFO:teuthology.orchestra.run.smithi040.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 813 kB/s | 27 kB 00:00 2024-09-11T22:17:13.260 INFO:teuthology.orchestra.run.smithi040.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 292 kB/s | 32 kB 00:00 2024-09-11T22:17:13.536 INFO:teuthology.orchestra.run.smithi040.stdout:(14/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 4.6 MB/s | 17 MB 00:03 2024-09-11T22:17:13.577 INFO:teuthology.orchestra.run.smithi040.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 2.3 MB/s | 752 kB 00:00 2024-09-11T22:17:13.603 INFO:teuthology.orchestra.run.smithi040.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-11T22:17:13.653 INFO:teuthology.orchestra.run.smithi040.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.6 MB/s | 127 kB 00:00 2024-09-11T22:17:13.703 INFO:teuthology.orchestra.run.smithi040.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.9 MB/s | 506 kB 00:00 2024-09-11T22:17:13.745 INFO:teuthology.orchestra.run.smithi040.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 1.1 MB/s | 45 kB 00:00 2024-09-11T22:17:13.796 INFO:teuthology.orchestra.run.smithi040.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.7 MB/s | 136 kB 00:00 2024-09-11T22:17:13.846 INFO:teuthology.orchestra.run.smithi040.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-11T22:17:13.921 INFO:teuthology.orchestra.run.smithi040.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.2 MB/s | 321 kB 00:00 2024-09-11T22:17:13.988 INFO:teuthology.orchestra.run.smithi040.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-11T22:17:14.030 INFO:teuthology.orchestra.run.smithi040.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 2.4 MB/s | 100 kB 00:00 2024-09-11T22:17:14.080 INFO:teuthology.orchestra.run.smithi040.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T22:17:14.380 INFO:teuthology.orchestra.run.smithi040.stdout:(26/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 7.4 MB/s | 5.3 MB 00:00 2024-09-11T22:17:14.431 INFO:teuthology.orchestra.run.smithi040.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.4 MB/s | 171 kB 00:00 2024-09-11T22:17:14.481 INFO:teuthology.orchestra.run.smithi040.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 641 kB/s | 32 kB 00:00 2024-09-11T22:17:14.531 INFO:teuthology.orchestra.run.smithi040.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T22:17:14.598 INFO:teuthology.orchestra.run.smithi040.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 6.0 MB/s | 3.1 MB 00:00 2024-09-11T22:17:14.825 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-09-11T22:17:14.825 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-09-11T22:17:14.990 INFO:teuthology.orchestra.run.smithi040.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.8 MB/s | 3.6 MB 00:00 2024-09-11T22:17:15.057 INFO:teuthology.orchestra.run.smithi040.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-11T22:17:15.116 INFO:teuthology.orchestra.run.smithi040.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 846 kB/s | 49 kB 00:00 2024-09-11T22:17:15.173 INFO:teuthology.orchestra.run.smithi040.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 287 kB/s | 16 kB 00:00 2024-09-11T22:17:15.250 INFO:teuthology.orchestra.run.smithi040.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 3.7 MB/s | 285 kB 00:00 2024-09-11T22:17:15.367 INFO:teuthology.orchestra.run.smithi040.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 6.4 MB/s | 765 kB 00:00 2024-09-11T22:17:15.417 INFO:teuthology.orchestra.run.smithi040.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 368 kB/s | 18 kB 00:00 2024-09-11T22:17:15.567 INFO:teuthology.orchestra.run.smithi040.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 7.6 MB/s | 7.4 MB 00:00 2024-09-11T22:17:15.592 INFO:teuthology.orchestra.run.smithi040.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 456 kB/s | 80 kB 00:00 2024-09-11T22:17:15.651 INFO:teuthology.orchestra.run.smithi040.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-11T22:17:15.701 INFO:teuthology.orchestra.run.smithi040.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-11T22:17:15.785 INFO:teuthology.orchestra.run.smithi040.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-11T22:17:15.827 INFO:teuthology.orchestra.run.smithi040.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-11T22:17:15.852 INFO:teuthology.orchestra.run.smithi040.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-11T22:17:15.877 INFO:teuthology.orchestra.run.smithi040.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T22:17:15.903 INFO:teuthology.orchestra.run.smithi040.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T22:17:15.936 INFO:teuthology.orchestra.run.smithi040.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-11T22:17:16.153 INFO:teuthology.orchestra.run.smithi040.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-09-11T22:17:16.212 INFO:teuthology.orchestra.run.smithi040.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-11T22:17:16.237 INFO:teuthology.orchestra.run.smithi040.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-09-11T22:17:16.254 INFO:teuthology.orchestra.run.smithi040.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 519 kB/s | 22 kB 00:00 2024-09-11T22:17:16.296 INFO:teuthology.orchestra.run.smithi040.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-11T22:17:16.313 INFO:teuthology.orchestra.run.smithi040.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-11T22:17:16.355 INFO:teuthology.orchestra.run.smithi040.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-11T22:17:16.405 INFO:teuthology.orchestra.run.smithi040.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 224 kB/s | 11 kB 00:00 2024-09-11T22:17:16.489 INFO:teuthology.orchestra.run.smithi040.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-11T22:17:16.514 INFO:teuthology.orchestra.run.smithi040.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-11T22:17:16.540 INFO:teuthology.orchestra.run.smithi040.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-11T22:17:16.581 INFO:teuthology.orchestra.run.smithi040.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-11T22:17:16.615 INFO:teuthology.orchestra.run.smithi040.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-11T22:17:16.641 INFO:teuthology.orchestra.run.smithi040.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-11T22:17:16.666 INFO:teuthology.orchestra.run.smithi040.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 939 kB/s | 47 kB 00:00 2024-09-11T22:17:16.699 INFO:teuthology.orchestra.run.smithi040.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T22:17:16.725 INFO:teuthology.orchestra.run.smithi040.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-11T22:17:16.750 INFO:teuthology.orchestra.run.smithi040.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-11T22:17:16.934 INFO:teuthology.orchestra.run.smithi040.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-11T22:17:17.001 INFO:teuthology.orchestra.run.smithi040.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-11T22:17:17.076 INFO:teuthology.orchestra.run.smithi040.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-11T22:17:17.118 INFO:teuthology.orchestra.run.smithi040.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-11T22:17:17.143 INFO:teuthology.orchestra.run.smithi040.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-11T22:17:17.218 INFO:teuthology.orchestra.run.smithi040.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-11T22:17:17.288 INFO:teuthology.orchestra.run.smithi040.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 87 kB 00:00 2024-09-11T22:17:17.330 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-11T22:17:17.411 INFO:teuthology.orchestra.run.smithi040.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-11T22:17:17.458 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:17:17.461 INFO:teuthology.orchestra.run.smithi040.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-11T22:17:17.496 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:17:17.553 INFO:teuthology.orchestra.run.smithi040.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2024-09-11T22:17:17.557 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:17:17.578 INFO:teuthology.orchestra.run.smithi040.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-11T22:17:17.600 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:17:17.612 INFO:teuthology.orchestra.run.smithi040.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-11T22:17:17.626 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:17:17.628 INFO:teuthology.orchestra.run.smithi040.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-11T22:17:17.654 INFO:teuthology.orchestra.run.smithi040.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-09-11T22:17:17.668 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:17:17.688 INFO:teuthology.orchestra.run.smithi040.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T22:17:17.704 INFO:teuthology.orchestra.run.smithi040.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-11T22:17:17.763 INFO:teuthology.orchestra.run.smithi040.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-11T22:17:17.822 INFO:teuthology.orchestra.run.smithi040.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-11T22:17:17.897 INFO:teuthology.orchestra.run.smithi040.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-11T22:17:17.922 INFO:teuthology.orchestra.run.smithi040.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 769 kB/s | 77 kB 00:00 2024-09-11T22:17:17.939 INFO:teuthology.orchestra.run.smithi040.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-11T22:17:17.981 INFO:teuthology.orchestra.run.smithi040.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-11T22:17:17.991 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:17:18.006 INFO:teuthology.orchestra.run.smithi040.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-11T22:17:18.040 INFO:teuthology.orchestra.run.smithi040.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-11T22:17:18.057 INFO:teuthology.orchestra.run.smithi040.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T22:17:18.083 INFO:teuthology.orchestra.run.smithi040.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2024-09-11T22:17:18.110 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:18.124 INFO:teuthology.orchestra.run.smithi040.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-11T22:17:18.175 INFO:teuthology.orchestra.run.smithi040.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-11T22:17:18.232 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:18.242 INFO:teuthology.orchestra.run.smithi040.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-11T22:17:18.261 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:18.351 INFO:teuthology.orchestra.run.smithi040.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-11T22:17:18.352 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:18.382 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:17:18.409 INFO:teuthology.orchestra.run.smithi040.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 818 kB/s | 47 kB 00:00 2024-09-11T22:17:18.532 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:17:18.593 INFO:teuthology.orchestra.run.smithi040.stdout:(97/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-11T22:17:18.595 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:17:18.618 INFO:teuthology.orchestra.run.smithi040.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-11T22:17:18.623 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:18.652 INFO:teuthology.orchestra.run.smithi040.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-11T22:17:18.672 INFO:teuthology.orchestra.run.smithi040.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-11T22:17:18.728 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:18.757 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:18.820 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:18.873 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:18.896 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:19.086 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:19.214 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:19.311 INFO:teuthology.orchestra.run.smithi040.stdout:(101/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x 7.8 MB/s | 49 MB 00:06 2024-09-11T22:17:19.332 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:17:19.336 INFO:teuthology.orchestra.run.smithi040.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 67 kB/s | 45 kB 00:00 2024-09-11T22:17:19.361 INFO:teuthology.orchestra.run.smithi040.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 90 kB/s | 64 kB 00:00 2024-09-11T22:17:19.420 INFO:teuthology.orchestra.run.smithi040.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-11T22:17:19.438 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:19.487 INFO:teuthology.orchestra.run.smithi040.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-11T22:17:19.512 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:19.512 INFO:teuthology.orchestra.run.smithi040.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-09-11T22:17:19.537 INFO:teuthology.orchestra.run.smithi040.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 792 kB/s | 19 kB 00:00 2024-09-11T22:17:19.562 INFO:teuthology.orchestra.run.smithi040.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T22:17:19.588 INFO:teuthology.orchestra.run.smithi040.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T22:17:19.621 INFO:teuthology.orchestra.run.smithi040.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-11T22:17:19.663 INFO:teuthology.orchestra.run.smithi040.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-11T22:17:19.705 INFO:teuthology.orchestra.run.smithi040.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-11T22:17:19.738 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:19.764 INFO:teuthology.orchestra.run.smithi040.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.5 MB/s | 548 kB 00:00 2024-09-11T22:17:19.789 INFO:teuthology.orchestra.run.smithi040.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T22:17:19.823 INFO:teuthology.orchestra.run.smithi040.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.2 MB/s | 839 kB 00:00 2024-09-11T22:17:19.849 INFO:teuthology.orchestra.run.smithi040.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 537 kB/s | 32 kB 00:00 2024-09-11T22:17:19.855 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:17:19.875 INFO:teuthology.orchestra.run.smithi040.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 273 kB/s | 14 kB 00:00 2024-09-11T22:17:19.900 INFO:teuthology.orchestra.run.smithi040.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T22:17:19.942 INFO:teuthology.orchestra.run.smithi040.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-11T22:17:19.957 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:17:19.967 INFO:teuthology.orchestra.run.smithi040.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-11T22:17:19.992 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:17:20.001 INFO:teuthology.orchestra.run.smithi040.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-11T22:17:20.027 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:17:20.034 INFO:teuthology.orchestra.run.smithi040.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-11T22:17:20.052 INFO:teuthology.orchestra.run.smithi040.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 645 kB/s | 11 kB 00:00 2024-09-11T22:17:20.069 INFO:teuthology.orchestra.run.smithi040.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-11T22:17:20.085 INFO:teuthology.orchestra.run.smithi040.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-11T22:17:20.100 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:17:20.102 INFO:teuthology.orchestra.run.smithi040.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-11T22:17:20.128 INFO:teuthology.orchestra.run.smithi040.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-09-11T22:17:20.144 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:17:20.184 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:17:20.203 INFO:teuthology.orchestra.run.smithi040.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-11T22:17:20.220 INFO:teuthology.orchestra.run.smithi040.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-11T22:17:20.236 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:17:20.245 INFO:teuthology.orchestra.run.smithi040.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T22:17:20.277 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:17:20.287 INFO:teuthology.orchestra.run.smithi040.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-09-11T22:17:20.305 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:17:20.321 INFO:teuthology.orchestra.run.smithi040.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 7.9 MB/s | 272 kB 00:00 2024-09-11T22:17:20.375 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:17:20.375 INFO:teuthology.orchestra.run.smithi040.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 304 kB/s | 16 kB 00:00 2024-09-11T22:17:20.413 INFO:teuthology.orchestra.run.smithi040.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 3.6 MB/s | 1.0 MB 00:00 2024-09-11T22:17:20.429 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:17:20.438 INFO:teuthology.orchestra.run.smithi040.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.4 MB/s | 90 kB 00:00 2024-09-11T22:17:20.457 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:17:20.463 INFO:teuthology.orchestra.run.smithi040.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-11T22:17:20.489 INFO:teuthology.orchestra.run.smithi040.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-11T22:17:20.493 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:17:20.515 INFO:teuthology.orchestra.run.smithi040.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T22:17:20.556 INFO:teuthology.orchestra.run.smithi040.stdout:(139/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-11T22:17:20.570 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:17:20.581 INFO:teuthology.orchestra.run.smithi040.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-11T22:17:20.603 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:17:20.606 INFO:teuthology.orchestra.run.smithi040.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 389 kB/s | 36 kB 00:00 2024-09-11T22:17:20.632 INFO:teuthology.orchestra.run.smithi040.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-11T22:17:20.646 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:17:20.657 INFO:teuthology.orchestra.run.smithi040.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-11T22:17:20.682 INFO:teuthology.orchestra.run.smithi040.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 812 kB/s | 20 kB 00:00 2024-09-11T22:17:20.684 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:17:20.708 INFO:teuthology.orchestra.run.smithi040.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T22:17:20.741 INFO:teuthology.orchestra.run.smithi040.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-11T22:17:20.763 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:17:20.766 INFO:teuthology.orchestra.run.smithi040.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-11T22:17:20.815 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:17:20.825 INFO:teuthology.orchestra.run.smithi040.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-11T22:17:20.890 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:17:21.017 INFO:teuthology.orchestra.run.smithi040.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-09-11T22:17:21.024 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:17:21.031 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-09-11T22:17:21.076 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:17:21.084 INFO:teuthology.orchestra.run.smithi040.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-11T22:17:21.109 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:17:21.126 INFO:teuthology.orchestra.run.smithi040.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 987 kB/s | 41 kB 00:00 2024-09-11T22:17:21.147 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:17:21.168 INFO:teuthology.orchestra.run.smithi040.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-11T22:17:21.200 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:17:21.218 INFO:teuthology.orchestra.run.smithi040.stdout:(153/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.0 MB/s | 3.2 MB 00:00 2024-09-11T22:17:21.243 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:17:21.260 INFO:teuthology.orchestra.run.smithi040.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-11T22:17:21.269 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:17:21.312 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:17:21.335 INFO:teuthology.orchestra.run.smithi040.stdout:(155/156): librados2-19.1.1-298.gb53b6d3e.el9.x 5.8 MB/s | 3.4 MB 00:00 2024-09-11T22:17:21.402 INFO:teuthology.orchestra.run.smithi040.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-09-11T22:17:21.409 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:17:21.409 INFO:teuthology.orchestra.run.smithi040.stdout:Total 15 MB/s | 226 MB 00:15 2024-09-11T22:17:21.614 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:17:21.697 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:17:21.725 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:17:21.751 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:17:21.784 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:17:21.839 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:17:21.869 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:21.881 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:17:21.994 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:22.036 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:17:22.045 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:22.100 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:17:22.128 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:22.155 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:17:22.158 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:17:22.227 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:17:22.259 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:17:22.295 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:17:22.308 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:17:22.351 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:17:22.364 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:17:22.391 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:22.394 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:17:22.438 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:17:22.480 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:17:22.497 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:22.525 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:22.580 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:22.601 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:22.617 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:17:22.621 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:22.820 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:22.899 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:17:22.967 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:23.059 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:17:23.083 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:17:23.166 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:17:23.191 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:23.198 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:17:23.246 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:17:23.268 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:23.271 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:17:23.296 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:17:23.373 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:17:23.483 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:23.499 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-09-11T22:17:23.507 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:17:23.570 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:17:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:17:23.598 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:17:23.632 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:17:23.671 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:17:23.696 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:17:23.699 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-09-11T22:17:23.699 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-09-11T22:17:23.704 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:17:23.733 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:17:23.739 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:17:23.774 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:17:23.775 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:17:23.826 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:17:23.848 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:17:23.868 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:17:23.901 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:17:23.902 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:17:23.940 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:17:23.987 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:17:23.989 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:17:24.028 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:17:24.032 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:17:24.056 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:17:24.064 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:17:24.125 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:17:24.168 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:17:24.178 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:17:24.209 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:17:24.223 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:17:24.253 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:17:24.329 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:17:24.363 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:17:24.407 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:17:24.435 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:17:24.513 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:17:24.566 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:17:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:17:24.772 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:17:24.827 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:17:24.957 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:17:25.012 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:17:25.045 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:17:25.144 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:17:25.192 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:17:25.245 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:17:25.336 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:17:25.348 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:17:25.365 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:17:25.430 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:17:25.461 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:17:25.495 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:17:25.533 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:17:25.549 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:17:25.574 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:17:25.587 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:17:25.665 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:17:25.730 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:17:25.803 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:17:25.880 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:17:25.964 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:17:25.996 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:17:26.031 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:17:26.078 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:17:26.114 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:17:26.157 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:17:26.187 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-09-11T22:17:26.187 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-09-11T22:17:26.199 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:17:26.317 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:17:26.335 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:17:26.394 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:17:26.434 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:17:26.444 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:17:26.536 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:17:26.743 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:17:26.783 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:17:26.808 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:17:26.833 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:17:26.910 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:17:27.043 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:17:27.074 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:17:27.101 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:17:27.135 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:17:27.175 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:17:27.206 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:17:27.236 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:17:27.271 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:17:27.304 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:17:27.346 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:17:27.381 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:17:27.467 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:17:27.519 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:17:27.550 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:17:27.652 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:17:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:17:27.701 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:17:27.766 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:17:27.802 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:17:27.843 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:17:28.161 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:17:28.206 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:28.389 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:28.414 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:17:28.419 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:17:28.455 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:17:28.465 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:17:28.499 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:17:28.596 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:17:28.653 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:17:28.698 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:17:28.778 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:17:28.818 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:17:28.935 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:17:28.976 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:29.008 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:17:29.030 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:29.032 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:17:29.061 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:17:29.109 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:17:29.751 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:17:29.864 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:17:31.087 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:17:31.169 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:17:31.197 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:17:31.230 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:17:31.353 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:31.392 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:31.573 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:17:31.618 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:31.693 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:31.723 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:17:31.759 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:17:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:31.971 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:32.059 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:32.059 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:17:32.060 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:17:32.060 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:32.088 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:32.249 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:17:32.305 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:32.376 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:32.406 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:17:33.156 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-09-11T22:17:33.349 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:17:33.400 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:17:33.466 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:17:33.509 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:17:33.541 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:17:33.603 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:17:34.004 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:17:34.100 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:34.249 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:17:34.276 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:34.391 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:17:34.448 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:17:34.665 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:17:34.729 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:17:34.755 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:34.775 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:34.811 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:34.867 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:17:34.898 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:34.972 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:17:34.999 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:17:35.276 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:35.367 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:35.414 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:35.459 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:17:35.507 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:35.507 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:17:35.508 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:17:35.508 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:35.543 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:35.623 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:17:35.755 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:35.882 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:36.173 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:17:36.312 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:17:36.428 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:17:36.469 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:17:36.509 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:17:36.593 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:17:36.653 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:17:36.692 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:17:36.746 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:17:36.784 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:17:36.818 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:17:36.909 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:17:36.971 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:17:37.025 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:17:37.075 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:17:37.160 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:17:37.192 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:17:37.238 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:17:37.273 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:17:37.366 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:17:37.418 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:17:37.521 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:17:37.692 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:17:37.763 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:17:38.431 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:17:38.531 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:17:38.574 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:17:38.617 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:17:38.656 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:17:38.709 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:17:39.031 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:17:39.092 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:17:39.162 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:17:39.248 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:17:39.284 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:17:39.321 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:17:39.380 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:17:39.420 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:17:39.470 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:17:39.519 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:17:39.731 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:17:39.785 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:17:39.830 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:17:39.961 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:17:40.002 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:17:40.045 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:17:40.075 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:17:40.099 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:17:40.222 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:17:40.382 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:17:40.423 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:17:40.461 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:17:40.505 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:17:40.552 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:17:40.592 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:17:40.628 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:17:40.663 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:17:40.696 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:17:40.741 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:17:40.772 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:17:40.876 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:17:40.950 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:17:40.986 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:17:41.115 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:17:41.175 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:17:42.110 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:17:42.168 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:17:42.201 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:17:42.320 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:17:42.385 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:17:42.439 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:17:42.548 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:17:42.595 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:17:42.842 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:17:42.875 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:17:42.975 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:17:43.829 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:17:43.968 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:17:44.099 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:44.099 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-09-11T22:17:44.099 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-09-11T22:17:44.100 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-09-11T22:17:44.100 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-09-11T22:17:44.100 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-09-11T22:17:44.100 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-09-11T22:17:44.100 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-09-11T22:17:44.100 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:44.282 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:17:44.298 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:17:44.298 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:44.298 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:17:44.299 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:45.623 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:17:45.730 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:17:45.767 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:17:45.784 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:17:45.799 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:17:45.811 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:17:45.812 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:45.812 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:17:45.812 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:17:45.812 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:17:45.812 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:46.035 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:17:46.058 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:17:46.058 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:46.059 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:17:46.059 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:17:46.059 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:17:46.059 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:46.161 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:17:46.203 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:46.299 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:17:46.333 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:17:46.392 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:17:46.494 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:17:46.518 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:17:46.518 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:46.518 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:17:46.518 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:17:46.519 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:17:46.519 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:46.632 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:17:46.689 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:17:46.745 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:17:46.931 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:17:46.952 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:17:46.980 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:17:47.071 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:17:47.072 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:17:47.099 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:17:47.168 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:47.168 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-09-11T22:17:47.168 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-09-11T22:17:47.169 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-09-11T22:17:47.169 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-09-11T22:17:47.169 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-09-11T22:17:47.169 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /root 2024-09-11T22:17:47.169 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-09-11T22:17:47.169 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:47.169 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:17:47.309 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:17:47.345 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:17:47.361 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:17:47.362 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:17:47.362 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:47.362 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:17:47.363 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:47.393 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:17:47.421 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:17:47.846 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:17:47.878 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:17:47.909 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:17:47.971 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:17:48.000 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:17:48.890 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:17:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:17:48.917 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:48.917 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:17:48.917 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:17:48.917 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:17:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:49.047 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:17:49.085 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:17:49.149 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:17:49.172 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:17:49.172 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:49.173 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:17:49.173 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:17:49.173 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:17:49.173 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:49.616 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:17:49.640 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:17:49.640 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:49.640 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:17:49.640 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:17:49.640 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:17:49.640 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:49.746 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:17:49.755 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:49.795 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:17:49.813 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:49.850 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:17:50.034 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:17:50.055 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:17:50.083 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:17:50.085 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:17:50.161 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:17:50.190 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:17:50.267 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:17:50.349 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:17:50.380 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:17:50.404 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:17:50.404 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:17:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:17:50.405 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:17:50.405 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:50.407 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:17:50.455 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:17:50.458 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:17:50.467 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:17:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:17:50.490 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:17:50.518 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:17:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:50.567 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:17:50.620 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:17:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:17:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:17:50.920 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:17:50.950 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:17:50.981 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:17:51.044 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:17:51.073 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:17:51.545 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:17:51.574 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:17:51.598 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:17:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:17:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:17:51.598 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:17:51.599 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:51.641 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:17:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:17:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:51.664 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:17:51.664 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:51.717 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:17:51.740 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:17:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:17:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:17:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:17:51.741 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:52.042 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:17:52.066 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:17:52.066 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:17:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:17:52.067 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:17:52.067 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:17:52.120 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:17:52.183 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:17:53.164 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:17:53.192 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:17:53.293 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:17:53.465 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:17:53.502 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:17:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:17:53.527 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:53.527 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:17:53.527 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:17:53.527 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:17:53.527 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:53.578 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:17:53.590 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:17:53.689 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:17:53.752 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:17:54.697 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:17:54.730 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:17:54.756 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:17:54.756 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:54.756 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:17:54.756 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:17:54.756 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:17:54.757 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:54.798 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:17:54.821 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:17:54.821 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:54.821 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:17:54.821 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:17:54.896 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:17:54.897 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:54.897 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:17:54.897 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:17:54.897 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:17:54.897 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:55.207 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:17:55.231 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:17:55.231 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:17:55.231 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:17:55.231 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:17:55.231 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:17:55.232 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:17:56.613 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:17:56.654 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:17:56.695 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:17:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:17:56.754 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:17:56.939 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:17:56.992 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:17:57.022 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:17:57.052 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:17:57.098 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:17:57.697 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:17:57.738 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:17:57.759 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:17:58.601 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:17:58.692 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:17:58.733 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:17:58.814 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:17:58.845 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:17:58.870 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:17:58.896 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:17:58.896 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:17:58.981 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:17:58.981 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:17:59.056 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:17:59.081 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:17:59.086 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:17:59.087 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:17:59.274 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:17:59.275 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:17:59.367 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:17:59.430 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:17:59.911 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:17:59.961 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:18:00.001 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:18:00.033 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:18:00.061 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:18:00.241 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:18:00.283 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:18:00.313 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:18:00.342 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:18:00.393 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:18:00.991 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:01.028 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:01.048 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:01.873 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:18:01.957 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:18:01.998 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:18:02.078 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:18:02.135 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:18:02.160 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:18:02.187 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:18:02.187 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:02.271 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:02.271 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:02.363 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:02.396 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:18:02.402 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:02.402 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:02.582 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:02.657 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:02.720 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:03.977 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:18:03.977 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2024-09-11T22:18:03.978 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2024-09-11T22:18:03.978 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2024-09-11T22:18:03.978 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2024-09-11T22:18:03.978 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2024-09-11T22:18:03.978 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2024-09-11T22:18:03.978 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2024-09-11T22:18:03.978 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:04.181 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:18:04.218 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:18:04.218 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:04.218 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:18:04.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:05.078 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:18:05.079 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:18:05.081 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:18:05.081 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:18:05.081 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:18:05.093 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:18:05.094 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:18:05.095 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:18:05.096 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:18:05.097 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:18:05.098 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:18:05.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:18:05.100 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:18:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:18:05.102 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:18:05.103 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:18:05.103 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:18:05.103 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:18:05.103 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:18:05.103 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:18:05.103 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:18:05.103 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:18:05.103 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:18:05.876 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:18:05.935 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:18:05.935 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:05.935 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:18:05.935 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:18:05.935 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:18:05.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:06.196 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:18:06.245 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:18:06.245 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:06.245 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:18:06.245 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:18:06.245 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:18:06.245 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:06.753 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:18:06.804 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:18:06.804 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:06.805 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:18:06.805 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:18:06.805 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:18:06.805 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:06.945 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:18:07.015 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:18:07.088 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:18:07.324 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:18:07.391 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:18:07.479 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:18:07.585 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:07.585 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:18:07.585 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-09-11T22:18:07.585 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:07.585 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:07.585 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:07.585 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:07.585 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.587 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:18:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:18:07.589 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:18:07.591 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:18:07.592 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:18:07.593 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:18:07.594 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:18:07.595 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.596 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:18:07.597 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-11T22:18:07.598 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:18:07.768 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:18:07.822 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:18:07.863 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:18:07.889 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:18:08.028 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:08.244 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:08.244 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:18:08.244 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:18:08.244 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:18:08.244 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:18:08.244 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:18:08.245 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:18:08.246 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:18:08.246 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:18:08.246 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:18:08.246 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:18:08.246 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:18:08.246 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:18:08.246 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:18:08.246 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:18:08.260 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:18:08.260 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:18:08.260 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:18:08.260 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:18:08.261 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:18:08.262 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:18:08.263 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:18:08.263 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:18:08.263 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:18:08.263 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:18:08.263 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:18:08.263 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:18:08.263 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:18:08.263 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:18:08.263 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:18:08.264 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:18:08.265 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:18:08.266 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:18:08.267 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:18:08.268 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:18:08.269 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:18:08.270 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:18:08.271 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:18:08.271 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:18:08.271 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:18:08.271 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:18:08.419 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:08.447 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:08.523 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:18:08.609 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:18:08.635 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:09.940 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:09.996 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:10.900 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-09-11T22:18:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:18:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:18:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:18:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:18:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:18:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:18:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:18:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:18:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:18:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:18:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:18:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:18:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:18:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:18:10.914 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:18:10.914 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-09-11T22:18:11.150 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:11.179 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:11.317 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:11.323 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:11.510 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:18:11.540 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:11.592 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:11.592 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:11.593 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:18:11.593 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:11.593 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:11.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:11.649 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:11.675 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:11.786 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:18:11.853 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:18:12.912 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:18:12.943 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:12.995 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:12.995 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:18:12.995 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:12.995 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:12.995 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:13.043 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:13.093 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:13.093 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:13.094 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:18:13.094 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:13.152 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:13.204 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:13.204 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:18:13.204 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:13.204 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:13.204 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:13.553 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:13.605 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:13.605 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:18:13.605 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:13.605 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:13.605 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:18.851 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:18:18.893 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:18:18.945 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:18:18.981 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:18:19.017 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:18:19.268 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:18:19.330 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:18:19.360 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:18:19.392 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:18:19.435 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:18:20.220 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:20.267 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:20.309 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:18:21.690 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:18:21.798 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:18:21.854 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:18:21.973 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:18:22.008 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:18:22.034 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:18:22.070 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:18:22.071 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:22.161 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:18:22.161 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:22.270 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:18:22.294 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:18:22.310 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:22.311 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:22.555 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:18:22.555 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:22.665 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:18:22.741 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:22.944 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:22.944 INFO:teuthology.orchestra.run.smithi040.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-11T22:18:22.944 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:28.780 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:18:28.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:18:28.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:18:28.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:18:28.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:18:28.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:18:28.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:18:28.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:28.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:28.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:18:28.782 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:18:28.783 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:18:28.783 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:18:28.783 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:18:28.783 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:18:28.783 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:18:28.797 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:18:28.797 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:18:28.797 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:18:28.797 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:18:28.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:18:28.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:18:28.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:18:28.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:18:28.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:18:28.803 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:18:28.804 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:18:28.805 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:18:28.806 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:18:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:18:28.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:18:28.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:18:28.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:18:28.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:18:28.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:18:28.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:18:28.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:18:28.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:18:28.808 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:18:30.958 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:18:30.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-09-11T22:18:30.958 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:30.958 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.959 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.960 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:18:30.961 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.962 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:18:30.963 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:18:30.964 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:18:30.965 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:18:30.966 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:18:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:18:30.968 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:18:30.969 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:18:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:18:30.971 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:18:30.972 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:18:30.972 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-11T22:18:31.577 DEBUG:teuthology.parallel:result is None 2024-09-11T22:18:31.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:31.715 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:18:31.765 INFO:teuthology.orchestra.run.smithi040.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:31.766 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:31.766 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:18:31.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:31.902 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:18:31.930 INFO:teuthology.orchestra.run.smithi146.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:31.930 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:31.930 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:18:31.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:32.071 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:18:32.097 INFO:teuthology.orchestra.run.smithi177.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:32.098 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:18:32.098 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:18:32.100 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T22:18:32.100 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:18:32.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:18:32.161 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:18:32.161 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:18:32.195 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:18:32.195 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:18:32.226 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T22:18:32.226 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:18:32.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:18:32.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:18:32.383 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:18:32.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:18:32.413 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:18:32.483 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:18:32.483 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:18:32.525 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:18:32.593 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T22:18:32.593 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:18:32.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:18:32.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:18:32.746 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:18:32.746 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:18:32.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:18:32.836 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:18:32.837 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:18:32.862 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:18:32.928 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T22:18:32.929 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:18:32.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:18:32.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:18:33.082 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:18:33.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:18:33.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:18:33.171 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:18:33.172 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:18:33.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:18:33.262 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T22:18:33.357 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-11T22:18:33.357 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:33.358 INFO:tasks.cephadm:Cluster fsid is c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:18:33.358 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T22:18:33.358 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.40', 'mon.b': '172.21.15.146', 'mon.c': '172.21.15.177'} 2024-09-11T22:18:33.358 INFO:tasks.cephadm:First mon is mon.a on smithi040 2024-09-11T22:18:33.359 INFO:tasks.cephadm:First mgr is x 2024-09-11T22:18:33.359 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T22:18:33.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname $(hostname -s) 2024-09-11T22:18:33.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname $(hostname -s) 2024-09-11T22:18:33.443 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname $(hostname -s) 2024-09-11T22:18:33.468 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-11T22:18:33.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:33.617 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-11T22:18:33.757 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:18:33.759 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T22:18:33.759 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T22:18:33.759 DEBUG:teuthology.orchestra.run.smithi040:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:34.148 INFO:teuthology.orchestra.run.smithi040.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 22:18 /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:34.149 DEBUG:teuthology.orchestra.run.smithi146:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:34.506 INFO:teuthology.orchestra.run.smithi146.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 22:18 /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:34.506 DEBUG:teuthology.orchestra.run.smithi177:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:34.886 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 22:18 /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:34.887 DEBUG:teuthology.orchestra.run.smithi040:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:34.929 DEBUG:teuthology.orchestra.run.smithi146:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:34.950 DEBUG:teuthology.orchestra.run.smithi177:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T22:18:34.985 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-11T22:18:34.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T22:18:34.991 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T22:18:34.993 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T22:18:36.518 INFO:teuthology.orchestra.run.smithi177.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:18:36.534 INFO:teuthology.orchestra.run.smithi146.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:18:37.010 INFO:teuthology.orchestra.run.smithi040.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:19:25.383 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:19:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T22:19:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T22:19:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: "repo_digests": [ 2024-09-11T22:19:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T22:19:25.384 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:19:25.384 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:19:43.834 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-11T22:19:43.834 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T22:19:43.834 INFO:teuthology.orchestra.run.smithi177.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T22:19:43.834 INFO:teuthology.orchestra.run.smithi177.stdout: "repo_digests": [ 2024-09-11T22:19:43.834 INFO:teuthology.orchestra.run.smithi177.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T22:19:43.834 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2024-09-11T22:19:43.834 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-11T22:19:46.162 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-11T22:19:46.162 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T22:19:46.162 INFO:teuthology.orchestra.run.smithi146.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T22:19:46.162 INFO:teuthology.orchestra.run.smithi146.stdout: "repo_digests": [ 2024-09-11T22:19:46.162 INFO:teuthology.orchestra.run.smithi146.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T22:19:46.162 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-11T22:19:46.163 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-11T22:19:46.186 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph 2024-09-11T22:19:46.257 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph 2024-09-11T22:19:46.284 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph 2024-09-11T22:19:46.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /etc/ceph 2024-09-11T22:19:46.376 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /etc/ceph 2024-09-11T22:19:46.401 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /etc/ceph 2024-09-11T22:19:46.430 INFO:tasks.cephadm:Writing seed config... 2024-09-11T22:19:46.431 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-11T22:19:46.431 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-11T22:19:46.431 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-11T22:19:46.431 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-11T22:19:46.431 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-11T22:19:46.431 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-11T22:19:46.432 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-11T22:19:46.433 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T22:19:46.434 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-11T22:19:46.435 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:19:46.435 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T22:19:46.472 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c836ee3e-708b-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-11T22:19:46.473 DEBUG:teuthology.orchestra.run.smithi040:mon.a> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T22:19:46.517 DEBUG:teuthology.orchestra.run.smithi040:mgr.x> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T22:19:46.561 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T22:19:46.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid c836ee3e-708b-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.40 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:19:46.828 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:19:46.828 INFO:teuthology.orchestra.run.smithi040.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', 'c836ee3e-708b-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.40', '--skip-admin-label'] 2024-09-11T22:19:46.829 INFO:teuthology.orchestra.run.smithi040.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T22:19:46.829 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying podman|docker is present... 2024-09-11T22:19:48.490 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stdout 5.2.2 2024-09-11T22:19:48.491 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying lvm2 is present... 2024-09-11T22:19:48.491 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying time synchronization is in place... 2024-09-11T22:19:48.509 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T22:19:48.509 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T22:19:48.525 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T22:19:48.525 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-09-11T22:19:48.547 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout enabled 2024-09-11T22:19:48.561 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout active 2024-09-11T22:19:48.561 INFO:teuthology.orchestra.run.smithi040.stdout:Unit chronyd.service is enabled and running 2024-09-11T22:19:48.561 INFO:teuthology.orchestra.run.smithi040.stdout:Repeating the final host check... 2024-09-11T22:19:48.609 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stdout 5.2.2 2024-09-11T22:19:48.609 INFO:teuthology.orchestra.run.smithi040.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T22:19:48.609 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl is present 2024-09-11T22:19:48.609 INFO:teuthology.orchestra.run.smithi040.stdout:lvcreate is present 2024-09-11T22:19:48.622 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T22:19:48.622 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T22:19:48.635 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T22:19:48.635 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-09-11T22:19:48.649 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout enabled 2024-09-11T22:19:48.662 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout active 2024-09-11T22:19:48.662 INFO:teuthology.orchestra.run.smithi040.stdout:Unit chronyd.service is enabled and running 2024-09-11T22:19:48.662 INFO:teuthology.orchestra.run.smithi040.stdout:Host looks OK 2024-09-11T22:19:48.662 INFO:teuthology.orchestra.run.smithi040.stdout:Cluster fsid: c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:19:48.662 INFO:teuthology.orchestra.run.smithi040.stdout:Acquiring lock 140052030510080 on /run/cephadm/c836ee3e-708b-11ef-bcea-c7b262605968.lock 2024-09-11T22:19:48.663 INFO:teuthology.orchestra.run.smithi040.stdout:Lock 140052030510080 acquired on /run/cephadm/c836ee3e-708b-11ef-bcea-c7b262605968.lock 2024-09-11T22:19:48.663 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying IP 172.21.15.40 port 3300 ... 2024-09-11T22:19:48.663 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying IP 172.21.15.40 port 6789 ... 2024-09-11T22:19:48.663 INFO:teuthology.orchestra.run.smithi040.stdout:Base mon IP(s) is [172.21.15.40:3300, 172.21.15.40:6789], mon addrv is [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-09-11T22:19:48.670 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.40 metric 100 2024-09-11T22:19:48.670 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.40 metric 100 2024-09-11T22:19:48.677 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T22:19:48.677 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-11T22:19:48.677 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1764sec hoplimit 64 pref medium 2024-09-11T22:19:48.682 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T22:19:48.682 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T22:19:48.683 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T22:19:48.683 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-11T22:19:48.683 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-11T22:19:48.683 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T22:19:48.683 INFO:teuthology.orchestra.run.smithi040.stdout:Mon IP `172.21.15.40` is in CIDR network `172.21.0.0/20` 2024-09-11T22:19:48.683 INFO:teuthology.orchestra.run.smithi040.stdout:Mon IP `172.21.15.40` is in CIDR network `172.21.0.0/20` 2024-09-11T22:19:48.684 INFO:teuthology.orchestra.run.smithi040.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T22:19:48.684 INFO:teuthology.orchestra.run.smithi040.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T22:19:48.685 INFO:teuthology.orchestra.run.smithi040.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:19:55.281 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T22:19:55.281 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T22:19:55.281 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T22:19:55.281 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-11T22:19:55.281 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T22:19:55.281 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T22:19:55.282 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T22:19:56.361 INFO:teuthology.orchestra.run.smithi040.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T22:19:56.361 INFO:teuthology.orchestra.run.smithi040.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T22:19:56.361 INFO:teuthology.orchestra.run.smithi040.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T22:19:57.548 INFO:teuthology.orchestra.run.smithi040.stdout:stat: stdout 167 167 2024-09-11T22:19:57.549 INFO:teuthology.orchestra.run.smithi040.stdout:Creating initial keys... 2024-09-11T22:19:58.579 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph-authtool: stdout AQCNF+Jm+5xiNxAAF8ewW5dPQeyaF0ICmFfHfQ== 2024-09-11T22:19:59.584 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph-authtool: stdout AQCOF+JmZsIvOBAAFt5brmJjOxDMJSlGjk1llA== 2024-09-11T22:20:00.696 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph-authtool: stdout AQCPF+JmamCKORAAINnnakMSy3iWymSNRAc2Xw== 2024-09-11T22:20:00.696 INFO:teuthology.orchestra.run.smithi040.stdout:Creating initial monmap... 2024-09-11T22:20:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T22:20:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-11T22:20:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T22:20:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool for a [v2:172.21.15.40:3300,v1:172.21.15.40:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T22:20:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = quincy 2024-09-11T22:20:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: set fsid to c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T22:20:02.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:20:02.222 INFO:teuthology.orchestra.run.smithi040.stdout:Creating mon... 2024-09-11T22:20:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:create mon.a on 2024-09-11T22:20:03.874 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T22:20:04.101 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T22:20:04.359 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c836ee3e-708b-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c836ee3e-708b-11ef-bcea-c7b262605968.target. 2024-09-11T22:20:04.359 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c836ee3e-708b-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-c836ee3e-708b-11ef-bcea-c7b262605968.target. 2024-09-11T22:20:04.690 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.a 2024-09-11T22:20:04.691 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T22:20:04.973 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c836ee3e-708b-11ef-bcea-c7b262605968.target.wants/ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c836ee3e-708b-11ef-bcea-c7b262605968@.service. 2024-09-11T22:20:05.566 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:05 smithi040 podman[30408]: 2024-09-11 22:20:05.559098845 +0000 UTC m=+0.363701041 container init 3789cea1ebb0cfe61af00da9fdb93ac65f28ea8d4b8b71d42a1dbdcaae87f2a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T22:20:05.566 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:05 smithi040 podman[30408]: 2024-09-11 22:20:05.565972674 +0000 UTC m=+0.370574859 container start 3789cea1ebb0cfe61af00da9fdb93ac65f28ea8d4b8b71d42a1dbdcaae87f2a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T22:20:05.686 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout disabled 2024-09-11T22:20:05.700 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T22:20:05.700 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-09-11T22:20:05.700 INFO:teuthology.orchestra.run.smithi040.stdout:firewalld.service is not enabled 2024-09-11T22:20:05.700 INFO:teuthology.orchestra.run.smithi040.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T22:20:05.700 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mon to start... 2024-09-11T22:20:05.700 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mon... 2024-09-11T22:20:05.841 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:05 smithi040 ceph-mon[30427]: mkfs c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:05.841 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:05 smithi040 ceph-mon[30427]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T22:20:05.842 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:05 smithi040 bash[30408]: 3789cea1ebb0cfe61af00da9fdb93ac65f28ea8d4b8b71d42a1dbdcaae87f2a6 2024-09-11T22:20:05.842 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:05 smithi040 systemd[1]: Started Ceph mon.a for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:20:06.882 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: monmap epoch 1 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: last_changed 2024-09-11T22:20:01.413928+0000 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: min_mon_release 19 (squid) 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: election_strategy: 1 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: fsmap 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: mgrmap e1: no daemons active 2024-09-11T22:20:06.883 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:06 smithi040 ceph-mon[30427]: from='client.? 172.21.15.40:0/528358039' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-11T22:20:06.887 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout id: c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout services: 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.658577s) 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout data: 2024-09-11T22:20:06.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.204+0000 7f9df7e00640 1 Processor -- start 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.204+0000 7f9df7e00640 1 -- start start 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.204+0000 7f9df7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df8109c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.204+0000 7f9df7e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9df810a200 con 0x7f9df8109810 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.205+0000 7f9df6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df8109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.205+0000 7f9df6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df8109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40094/0 (socket says 172.21.15.40:40094) 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.205+0000 7f9df6a00640 1 -- 172.21.15.40:0/1276500855 learned_addr learned my addr 172.21.15.40:0/1276500855 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.205+0000 7f9df6a00640 1 -- 172.21.15.40:0/1276500855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df810a380 con 0x7f9df8109810 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.208+0000 7f9df6a00640 1 --2- 172.21.15.40:0/1276500855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df8109c30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009820 tx=0x7f9de802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630d224c5a73e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df5600640 1 -- 172.21.15.40:0/1276500855 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de8037070 con 0x7f9df8109810 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df5600640 1 -- 172.21.15.40:0/1276500855 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de8032440 con 0x7f9df8109810 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df5600640 1 -- 172.21.15.40:0/1276500855 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de8032740 con 0x7f9df8109810 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df7e00640 1 -- 172.21.15.40:0/1276500855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 msgr2=0x7f9df8109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df7e00640 1 --2- 172.21.15.40:0/1276500855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df8109c30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009820 tx=0x7f9de802a270 comp rx=0 tx=0).stop 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df7e00640 1 -- 172.21.15.40:0/1276500855 shutdown_connections 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df7e00640 1 --2- 172.21.15.40:0/1276500855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df8109c30 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df7e00640 1 -- 172.21.15.40:0/1276500855 >> 172.21.15.40:0/1276500855 conn(0x7f9df807cbd0 msgr2=0x7f9df807d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df7e00640 1 -- 172.21.15.40:0/1276500855 shutdown_connections 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.209+0000 7f9df7e00640 1 -- 172.21.15.40:0/1276500855 wait complete. 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.210+0000 7f9df7e00640 1 Processor -- start 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.211+0000 7f9df7e00640 1 -- start start 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.211+0000 7f9df7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.211+0000 7f9df7e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9df810ac00 con 0x7f9df8109810 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.211+0000 7f9df6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.211+0000 7f9df6a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40096/0 (socket says 172.21.15.40:40096) 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.211+0000 7f9df6a00640 1 -- 172.21.15.40:0/528358039 learned_addr learned my addr 172.21.15.40:0/528358039 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.212+0000 7f9df6a00640 1 -- 172.21.15.40:0/528358039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df819d310 con 0x7f9df8109810 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.212+0000 7f9df6a00640 1 --2- 172.21.15.40:0/528358039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df819cdd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9de80090b0 tx=0x7f9de80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.212+0000 7f9def400640 1 -- 172.21.15.40:0/528358039 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de8041070 con 0x7f9df8109810 2024-09-11T22:20:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.212+0000 7f9def400640 1 -- 172.21.15.40:0/528358039 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de803c7a0 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.212+0000 7f9def400640 1 -- 172.21.15.40:0/528358039 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de8037040 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.212+0000 7f9df7e00640 1 -- 172.21.15.40:0/528358039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df819d5a0 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.212+0000 7f9df7e00640 1 -- 172.21.15.40:0/528358039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df81a0290 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.213+0000 7f9def400640 1 -- 172.21.15.40:0/528358039 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9de8044070 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.213+0000 7f9def400640 1 -- 172.21.15.40:0/528358039 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9de803d3f0 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.214+0000 7f9df7e00640 1 -- 172.21.15.40:0/528358039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df8109cb0 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.217+0000 7f9def400640 1 -- 172.21.15.40:0/528358039 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9de8046450 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.281+0000 7f9df7e00640 1 -- 172.21.15.40:0/528358039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f9df81a07e0 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.281+0000 7f9def400640 1 -- 172.21.15.40:0/528358039 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f9de8046630 con 0x7f9df8109810 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.282+0000 7f9df7e00640 1 -- 172.21.15.40:0/528358039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 msgr2=0x7f9df819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.282+0000 7f9df7e00640 1 --2- 172.21.15.40:0/528358039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df819cdd0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9de80090b0 tx=0x7f9de80046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.282+0000 7f9df7e00640 1 -- 172.21.15.40:0/528358039 shutdown_connections 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.282+0000 7f9df7e00640 1 --2- 172.21.15.40:0/528358039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df8109810 0x7f9df819cdd0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.897 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.282+0000 7f9df7e00640 1 -- 172.21.15.40:0/528358039 >> 172.21.15.40:0/528358039 conn(0x7f9df807cbd0 msgr2=0x7f9df8191020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:06.898 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.282+0000 7f9df7e00640 1 -- 172.21.15.40:0/528358039 shutdown_connections 2024-09-11T22:20:06.898 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:06.282+0000 7f9df7e00640 1 -- 172.21.15.40:0/528358039 wait complete. 2024-09-11T22:20:06.898 INFO:teuthology.orchestra.run.smithi040.stdout:mon is available 2024-09-11T22:20:06.898 INFO:teuthology.orchestra.run.smithi040.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T22:20:07.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:07 smithi040 ceph-mon[30427]: from='client.? 172.21.15.40:0/2677252952' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T22:20:07.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:07 smithi040 ceph-mon[30427]: from='client.? 172.21.15.40:0/2677252952' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T22:20:08.008 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:08.008 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T22:20:08.008 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout fsid = c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-11T22:20:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.410+0000 7f3ecfc00640 1 Processor -- start 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.410+0000 7f3ecfc00640 1 -- start start 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.410+0000 7f3ecfc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec8107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.410+0000 7f3ecfc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec8108000 con 0x7f3ec8107630 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.411+0000 7f3ecd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec8107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.411+0000 7f3ecd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec8107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40112/0 (socket says 172.21.15.40:40112) 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.411+0000 7f3ecd200640 1 -- 172.21.15.40:0/4044291612 learned_addr learned my addr 172.21.15.40:0/4044291612 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.411+0000 7f3ecd200640 1 -- 172.21.15.40:0/4044291612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec8108830 con 0x7f3ec8107630 2024-09-11T22:20:08.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.412+0000 7f3ecd200640 1 --2- 172.21.15.40:0/4044291612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec8107a30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009820 tx=0x7f3ebc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f343e48d8f984511 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ec7400640 1 -- 172.21.15.40:0/4044291612 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc037070 con 0x7f3ec8107630 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ec7400640 1 -- 172.21.15.40:0/4044291612 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc032440 con 0x7f3ec8107630 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ec7400640 1 -- 172.21.15.40:0/4044291612 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc032740 con 0x7f3ec8107630 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ecfc00640 1 -- 172.21.15.40:0/4044291612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 msgr2=0x7f3ec8107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ecfc00640 1 --2- 172.21.15.40:0/4044291612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec8107a30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009820 tx=0x7f3ebc02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ecfc00640 1 -- 172.21.15.40:0/4044291612 shutdown_connections 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ecfc00640 1 --2- 172.21.15.40:0/4044291612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec8107a30 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ecfc00640 1 -- 172.21.15.40:0/4044291612 >> 172.21.15.40:0/4044291612 conn(0x7f3ec8102d80 msgr2=0x7f3ec8105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ecfc00640 1 -- 172.21.15.40:0/4044291612 shutdown_connections 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.413+0000 7f3ecfc00640 1 -- 172.21.15.40:0/4044291612 wait complete. 2024-09-11T22:20:08.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.414+0000 7f3ecfc00640 1 Processor -- start 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.415+0000 7f3ecfc00640 1 -- start start 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.415+0000 7f3ecfc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec819adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.415+0000 7f3ecfc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec8108d60 con 0x7f3ec8107630 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.415+0000 7f3ecd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec819adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.416+0000 7f3ecd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec819adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40114/0 (socket says 172.21.15.40:40114) 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.416+0000 7f3ecd200640 1 -- 172.21.15.40:0/2677252952 learned_addr learned my addr 172.21.15.40:0/2677252952 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.416+0000 7f3ecd200640 1 -- 172.21.15.40:0/2677252952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec819b300 con 0x7f3ec8107630 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.416+0000 7f3ecd200640 1 --2- 172.21.15.40:0/2677252952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec819adc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0090b0 tx=0x7f3ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.416+0000 7f3ec5600640 1 -- 172.21.15.40:0/2677252952 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc041070 con 0x7f3ec8107630 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.416+0000 7f3ec5600640 1 -- 172.21.15.40:0/2677252952 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc03c7a0 con 0x7f3ec8107630 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.416+0000 7f3ec5600640 1 -- 172.21.15.40:0/2677252952 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ebc037040 con 0x7f3ec8107630 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.416+0000 7f3ecfc00640 1 -- 172.21.15.40:0/2677252952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec819b590 con 0x7f3ec8107630 2024-09-11T22:20:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.417+0000 7f3ecfc00640 1 -- 172.21.15.40:0/2677252952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec819e280 con 0x7f3ec8107630 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.417+0000 7f3ec5600640 1 -- 172.21.15.40:0/2677252952 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3ebc044070 con 0x7f3ec8107630 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.417+0000 7f3ec5600640 1 -- 172.21.15.40:0/2677252952 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3ebc03d3f0 con 0x7f3ec8107630 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.418+0000 7f3ecfc00640 1 -- 172.21.15.40:0/2677252952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec81093b0 con 0x7f3ec8107630 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.420+0000 7f3ec5600640 1 -- 172.21.15.40:0/2677252952 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3ebc046450 con 0x7f3ec8107630 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.483+0000 7f3ecfc00640 1 -- 172.21.15.40:0/2677252952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3ec819f950 con 0x7f3ec8107630 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.487+0000 7f3ec5600640 1 -- 172.21.15.40:0/2677252952 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+454 (secure 0 0 0) 0x7f3ebc046630 con 0x7f3ec8107630 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.488+0000 7f3ec5600640 1 -- 172.21.15.40:0/2677252952 <== mon.0 v2:172.21.15.40:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ebc0584d0 con 0x7f3ec8107630 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.488+0000 7f3ecfc00640 1 -- 172.21.15.40:0/2677252952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 msgr2=0x7f3ec819adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.488+0000 7f3ecfc00640 1 --2- 172.21.15.40:0/2677252952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec819adc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0090b0 tx=0x7f3ebc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.489+0000 7f3ecfc00640 1 -- 172.21.15.40:0/2677252952 shutdown_connections 2024-09-11T22:20:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.489+0000 7f3ecfc00640 1 --2- 172.21.15.40:0/2677252952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ec8107630 0x7f3ec819adc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:08.014 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.489+0000 7f3ecfc00640 1 -- 172.21.15.40:0/2677252952 >> 172.21.15.40:0/2677252952 conn(0x7f3ec8102d80 msgr2=0x7f3ec818f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:08.014 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.489+0000 7f3ecfc00640 1 -- 172.21.15.40:0/2677252952 shutdown_connections 2024-09-11T22:20:08.014 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:07.489+0000 7f3ecfc00640 1 -- 172.21.15.40:0/2677252952 wait complete. 2024-09-11T22:20:08.014 INFO:teuthology.orchestra.run.smithi040.stdout:Generating new minimal ceph.conf... 2024-09-11T22:20:08.868 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:08 smithi040 ceph-mon[30427]: from='client.? 172.21.15.40:0/2346382981' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:20:09.131 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.458+0000 7f406ba00640 1 Processor -- start 2024-09-11T22:20:09.131 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.458+0000 7f406ba00640 1 -- start start 2024-09-11T22:20:09.131 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.458+0000 7f406ba00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f4064107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:09.131 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.458+0000 7f406ba00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4064108000 con 0x7f4064107630 2024-09-11T22:20:09.131 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.459+0000 7f4069000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f4064107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:09.131 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.459+0000 7f4069000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f4064107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40124/0 (socket says 172.21.15.40:40124) 2024-09-11T22:20:09.131 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.459+0000 7f4069000640 1 -- 172.21.15.40:0/3127776298 learned_addr learned my addr 172.21.15.40:0/3127776298 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.459+0000 7f4069000640 1 -- 172.21.15.40:0/3127776298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4064108830 con 0x7f4064107630 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.460+0000 7f4069000640 1 --2- 172.21.15.40:0/3127776298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f4064107a30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4054009820 tx=0x7f405402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba8ece3100f5fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.460+0000 7f4063e00640 1 -- 172.21.15.40:0/3127776298 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4054037070 con 0x7f4064107630 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.461+0000 7f4063e00640 1 -- 172.21.15.40:0/3127776298 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4054032900 con 0x7f4064107630 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.461+0000 7f4063e00640 1 -- 172.21.15.40:0/3127776298 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4054030850 con 0x7f4064107630 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.461+0000 7f406ba00640 1 -- 172.21.15.40:0/3127776298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 msgr2=0x7f4064107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.461+0000 7f406ba00640 1 --2- 172.21.15.40:0/3127776298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f4064107a30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4054009820 tx=0x7f405402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.461+0000 7f406ba00640 1 -- 172.21.15.40:0/3127776298 shutdown_connections 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.461+0000 7f406ba00640 1 --2- 172.21.15.40:0/3127776298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f4064107a30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.461+0000 7f406ba00640 1 -- 172.21.15.40:0/3127776298 >> 172.21.15.40:0/3127776298 conn(0x7f4064102d80 msgr2=0x7f4064105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.461+0000 7f406ba00640 1 -- 172.21.15.40:0/3127776298 shutdown_connections 2024-09-11T22:20:09.132 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.461+0000 7f406ba00640 1 -- 172.21.15.40:0/3127776298 wait complete. 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.462+0000 7f406ba00640 1 Processor -- start 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.462+0000 7f406ba00640 1 -- start start 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.463+0000 7f406ba00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f406419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.463+0000 7f406ba00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f406410bbe0 con 0x7f4064107630 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.463+0000 7f4069000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f406419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.463+0000 7f4069000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f406419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40132/0 (socket says 172.21.15.40:40132) 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.463+0000 7f4069000640 1 -- 172.21.15.40:0/2346382981 learned_addr learned my addr 172.21.15.40:0/2346382981 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.463+0000 7f4069000640 1 -- 172.21.15.40:0/2346382981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406419bb90 con 0x7f4064107630 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.463+0000 7f4069000640 1 --2- 172.21.15.40:0/2346382981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f406419b650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f40540097f0 tx=0x7f4054030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:09.133 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.464+0000 7f4062000640 1 -- 172.21.15.40:0/2346382981 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4054042070 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.464+0000 7f4062000640 1 -- 172.21.15.40:0/2346382981 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4054032ca0 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.464+0000 7f406ba00640 1 -- 172.21.15.40:0/2346382981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f406419be20 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.464+0000 7f4062000640 1 -- 172.21.15.40:0/2346382981 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4054037040 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.464+0000 7f406ba00640 1 -- 172.21.15.40:0/2346382981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f406419eb10 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.464+0000 7f4062000640 1 -- 172.21.15.40:0/2346382981 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4054045070 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.464+0000 7f4062000640 1 -- 172.21.15.40:0/2346382981 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4054047a30 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.465+0000 7f406ba00640 1 -- 172.21.15.40:0/2346382981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4064107ab0 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.468+0000 7f4062000640 1 -- 172.21.15.40:0/2346382981 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f405403da60 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.530+0000 7f406ba00640 1 -- 172.21.15.40:0/2346382981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f406419f080 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.531+0000 7f4062000640 1 -- 172.21.15.40:0/2346382981 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f405403d430 con 0x7f4064107630 2024-09-11T22:20:09.134 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.532+0000 7f406ba00640 1 -- 172.21.15.40:0/2346382981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 msgr2=0x7f406419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:09.135 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.532+0000 7f406ba00640 1 --2- 172.21.15.40:0/2346382981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f406419b650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f40540097f0 tx=0x7f4054030ec0 comp rx=0 tx=0).stop 2024-09-11T22:20:09.135 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.532+0000 7f406ba00640 1 -- 172.21.15.40:0/2346382981 shutdown_connections 2024-09-11T22:20:09.135 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.532+0000 7f406ba00640 1 --2- 172.21.15.40:0/2346382981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4064107630 0x7f406419b650 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:09.135 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.532+0000 7f406ba00640 1 -- 172.21.15.40:0/2346382981 >> 172.21.15.40:0/2346382981 conn(0x7f4064102d80 msgr2=0x7f40641039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:09.135 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.532+0000 7f406ba00640 1 -- 172.21.15.40:0/2346382981 shutdown_connections 2024-09-11T22:20:09.135 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:08.532+0000 7f406ba00640 1 -- 172.21.15.40:0/2346382981 wait complete. 2024-09-11T22:20:09.135 INFO:teuthology.orchestra.run.smithi040.stdout:Restarting the monitor... 2024-09-11T22:20:09.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:09 smithi040 systemd[1]: Stopping Ceph mon.a for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:20:09.812 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:09 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a[30423]: 2024-09-11T22:20:09.492+0000 7f300e600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:20:09.812 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:09 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a[30423]: 2024-09-11T22:20:09.492+0000 7f300e600640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T22:20:09.812 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:09 smithi040 podman[30665]: 2024-09-11 22:20:09.575242547 +0000 UTC m=+0.197454560 container died 3789cea1ebb0cfe61af00da9fdb93ac65f28ea8d4b8b71d42a1dbdcaae87f2a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T22:20:10.150 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:09 smithi040 podman[30665]: 2024-09-11 22:20:09.897600505 +0000 UTC m=+0.519812518 container cleanup 3789cea1ebb0cfe61af00da9fdb93ac65f28ea8d4b8b71d42a1dbdcaae87f2a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T22:20:10.151 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:09 smithi040 bash[30665]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a 2024-09-11T22:20:10.151 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 podman[30677]: 2024-09-11 22:20:10.048380134 +0000 UTC m=+0.463574647 container remove 3789cea1ebb0cfe61af00da9fdb93ac65f28ea8d4b8b71d42a1dbdcaae87f2a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:20:10.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 systemd[1]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T22:20:10.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 systemd[1]: Stopped Ceph mon.a for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:20:10.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 systemd[1]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.237s CPU time. 2024-09-11T22:20:10.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 systemd[1]: Starting Ceph mon.a for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:20:10.901 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 podman[30768]: 2024-09-11 22:20:10.615986494 +0000 UTC m=+0.107928228 container create 7e01a1771198d7dc269364cb391fef43de3cd86e11ced3b7778fc974d7f176c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-11T22:20:10.901 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 podman[30768]: 2024-09-11 22:20:10.535586852 +0000 UTC m=+0.027528591 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:20:10.901 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 podman[30768]: 2024-09-11 22:20:10.785180273 +0000 UTC m=+0.277122014 container init 7e01a1771198d7dc269364cb391fef43de3cd86e11ced3b7778fc974d7f176c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T22:20:10.901 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 podman[30768]: 2024-09-11 22:20:10.791635416 +0000 UTC m=+0.283577144 container start 7e01a1771198d7dc269364cb391fef43de3cd86e11ced3b7778fc974d7f176c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-11T22:20:10.901 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T22:20:10.901 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T22:20:10.901 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: pidfile_write: ignore empty --pid-file 2024-09-11T22:20:10.901 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: load: jerasure load: lrc 2024-09-11T22:20:10.901 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: RocksDB version: 7.9.2 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Git sha 0 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: DB SUMMARY 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: DB Session ID: YDDRE90VSJGCI4JRLXWX 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: CURRENT file: CURRENT 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104684 ; 2024-09-11T22:20:10.902 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.error_if_exists: 0 2024-09-11T22:20:10.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.create_if_missing: 0 2024-09-11T22:20:10.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.paranoid_checks: 1 2024-09-11T22:20:10.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T22:20:10.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T22:20:10.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T22:20:10.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.env: 0x55a8f1064940 2024-09-11T22:20:10.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T22:20:10.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.info_log: 0x55a9271b56a0 2024-09-11T22:20:10.904 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.statistics: (nil) 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.use_fsync: 0 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_log_file_size: 0 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.allow_fallocate: 1 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.use_direct_reads: 0 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T22:20:10.905 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.db_log_dir: 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.wal_dir: 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.write_buffer_manager: 0x55a9271c4dc0 2024-09-11T22:20:10.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.unordered_write: 0 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T22:20:10.907 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.row_cache: None 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.wal_filter: None 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.two_write_queues: 0 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.wal_compression: 0 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.atomic_flush: 0 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T22:20:10.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.log_readahead_size: 0 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_background_jobs: 2 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_background_compactions: -1 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_subcompactions: 1 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T22:20:10.909 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_open_files: -1 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_background_flushes: -1 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Compression algorithms supported: 2024-09-11T22:20:10.910 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: kZSTD supported: 0 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: kXpressCompression supported: 0 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: kBZip2Compression supported: 0 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: kLZ4Compression supported: 1 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: kZlibCompression supported: 1 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: kSnappyCompression supported: 1 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T22:20:10.911 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.merge_operator: 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_filter: None 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a9271b5300) 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout: cache_index_and_filter_blocks: 1 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout: pin_top_level_index_and_filter: 1 2024-09-11T22:20:10.912 INFO:journalctl@ceph.mon.a.smithi040.stdout: index_type: 0 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: data_block_index_type: 0 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: index_shortening: 1 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: checksum: 4 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: no_block_cache: 0 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_cache: 0x55a9271a91f0 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_cache_name: BinnedLRUCache 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_cache_options: 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: capacity : 536870912 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: num_shard_bits : 4 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: strict_capacity_limit : 0 2024-09-11T22:20:10.913 INFO:journalctl@ceph.mon.a.smithi040.stdout: high_pri_pool_ratio: 0.000 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_cache_compressed: (nil) 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: persistent_cache: (nil) 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_size: 4096 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_size_deviation: 10 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_restart_interval: 16 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: index_block_restart_interval: 1 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: metadata_block_size: 4096 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: partition_filters: 0 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: use_delta_encoding: 1 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: filter_policy: bloomfilter 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: whole_key_filtering: 1 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: verify_compression: 0 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: read_amp_bytes_per_bit: 0 2024-09-11T22:20:10.914 INFO:journalctl@ceph.mon.a.smithi040.stdout: format_version: 5 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout: enable_index_compression: 1 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout: block_align: 0 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout: max_auto_readahead_size: 262144 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout: prepopulate_block_cache: 0 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout: initial_auto_readahead_size: 8192 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression: NoCompression 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T22:20:10.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.num_levels: 7 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T22:20:10.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T22:20:10.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T22:20:10.918 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T22:20:10.919 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.inplace_update_support: 0 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.bloom_locality: 0 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.max_successive_merges: 0 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T22:20:10.920 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.ttl: 2592000 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.enable_blob_files: false 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.min_blob_size: 0 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T22:20:10.921 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a756a92b-4915-49c7-a015-d1bb81236d2c 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093210835016, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093210836682, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99843, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97729, "index_size": 306, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14165, "raw_average_key_size": 49, "raw_value_size": 90024, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726093210, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a756a92b-4915-49c7-a015-d1bb81236d2c", "db_session_id": "YDDRE90VSJGCI4JRLXWX", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093210836881, "job": 1, "event": "recovery_finished"} 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a9271d8e00 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: DB pointer 0x55a9272d4000 2024-09-11T22:20:10.922 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: ** DB Stats ** 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: ** Compaction Stats [default] ** 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T22:20:10.923 INFO:journalctl@ceph.mon.a.smithi040.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: L0 2/0 99.36 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 92.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: Sum 2/0 99.36 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 92.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 92.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: ** Compaction Stats [default] ** 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 92.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T22:20:10.924 INFO:journalctl@ceph.mon.a.smithi040.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: Cumulative compaction: 0.00 GB write, 16.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: Interval compaction: 0.00 GB write, 16.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: Block cache BinnedLRUCache@0x55a9271a91f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: starting mon.a rank 0 at public addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] at bind addrs [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mon.a@-1(???) e1 preinit fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:10.925 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mon.a@-1(???).mds e1 new map 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mon.a@-1(???).mds e1 print_map 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout: e1 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout: btime 2024-09-11T22:20:05:624820+0000 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout: legacy client fscid: -1 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout: 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout: No filesystems configured 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T22:20:10.926 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: monmap epoch 1 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: last_changed 2024-09-11T22:20:01.413928+0000 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: min_mon_release 19 (squid) 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: election_strategy: 1 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: fsmap 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T22:20:10.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 ceph-mon[30787]: mgrmap e1: no daemons active 2024-09-11T22:20:10.936 INFO:teuthology.orchestra.run.smithi040.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T22:20:11.160 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 bash[30768]: 7e01a1771198d7dc269364cb391fef43de3cd86e11ced3b7778fc974d7f176c7 2024-09-11T22:20:11.161 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:10 smithi040 systemd[1]: Started Ceph mon.a for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:20:12.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.383+0000 7f359c400640 1 Processor -- start 2024-09-11T22:20:12.009 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.384+0000 7f359c400640 1 -- start start 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.384+0000 7f359c400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f3594107a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.384+0000 7f359c400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3594108030 con 0x7f3594107660 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.385+0000 7f3599a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f3594107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.385+0000 7f3599a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f3594107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40148/0 (socket says 172.21.15.40:40148) 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.385+0000 7f3599a00640 1 -- 172.21.15.40:0/1146690977 learned_addr learned my addr 172.21.15.40:0/1146690977 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.385+0000 7f3599a00640 1 -- 172.21.15.40:0/1146690977 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35941087c0 con 0x7f3594107660 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.387+0000 7f3599a00640 1 --2- 172.21.15.40:0/1146690977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f3594107a60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3588009820 tx=0x7f358802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bde5055719cf38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.388+0000 7f3593e00640 1 -- 172.21.15.40:0/1146690977 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3588037070 con 0x7f3594107660 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.388+0000 7f3593e00640 1 -- 172.21.15.40:0/1146690977 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3588032900 con 0x7f3594107660 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.388+0000 7f3593e00640 1 -- 172.21.15.40:0/1146690977 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3588030850 con 0x7f3594107660 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.388+0000 7f359c400640 1 -- 172.21.15.40:0/1146690977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 msgr2=0x7f3594107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:12.010 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.388+0000 7f359c400640 1 --2- 172.21.15.40:0/1146690977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f3594107a60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3588009820 tx=0x7f358802a270 comp rx=0 tx=0).stop 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.388+0000 7f359c400640 1 -- 172.21.15.40:0/1146690977 shutdown_connections 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.388+0000 7f359c400640 1 --2- 172.21.15.40:0/1146690977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f3594107a60 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.388+0000 7f359c400640 1 -- 172.21.15.40:0/1146690977 >> 172.21.15.40:0/1146690977 conn(0x7f3594102db0 msgr2=0x7f3594105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.389+0000 7f359c400640 1 -- 172.21.15.40:0/1146690977 shutdown_connections 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.389+0000 7f359c400640 1 -- 172.21.15.40:0/1146690977 wait complete. 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.390+0000 7f359c400640 1 Processor -- start 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.390+0000 7f359c400640 1 -- start start 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.390+0000 7f359c400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f359419d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.390+0000 7f359c400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f359410bb70 con 0x7f3594107660 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.390+0000 7f3599a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f359419d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.390+0000 7f3599a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f359419d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40164/0 (socket says 172.21.15.40:40164) 2024-09-11T22:20:12.011 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.390+0000 7f3599a00640 1 -- 172.21.15.40:0/1814591863 learned_addr learned my addr 172.21.15.40:0/1814591863 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.391+0000 7f3599a00640 1 -- 172.21.15.40:0/1814591863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359419ddc0 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.391+0000 7f3599a00640 1 --2- 172.21.15.40:0/1814591863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f359419d880 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f35880097f0 tx=0x7f3588030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.391+0000 7f3592000640 1 -- 172.21.15.40:0/1814591863 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3588042070 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.391+0000 7f3592000640 1 -- 172.21.15.40:0/1814591863 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3588032ca0 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.391+0000 7f359c400640 1 -- 172.21.15.40:0/1814591863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359419e050 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.391+0000 7f3592000640 1 -- 172.21.15.40:0/1814591863 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3588037040 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.391+0000 7f359c400640 1 -- 172.21.15.40:0/1814591863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35941a0d40 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.392+0000 7f3592000640 1 -- 172.21.15.40:0/1814591863 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3588045070 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.392+0000 7f3592000640 1 -- 172.21.15.40:0/1814591863 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3588047a30 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.392+0000 7f359c400640 1 -- 172.21.15.40:0/1814591863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359410bcf0 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.395+0000 7f3592000640 1 -- 172.21.15.40:0/1814591863 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f358803da60 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.457+0000 7f359c400640 1 -- 172.21.15.40:0/1814591863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f35941a1330 con 0x7f3594107660 2024-09-11T22:20:12.012 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.459+0000 7f3592000640 1 -- 172.21.15.40:0/1814591863 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f358803d430 con 0x7f3594107660 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.460+0000 7f359c400640 1 -- 172.21.15.40:0/1814591863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 msgr2=0x7f359419d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.460+0000 7f359c400640 1 --2- 172.21.15.40:0/1814591863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f359419d880 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f35880097f0 tx=0x7f3588030ec0 comp rx=0 tx=0).stop 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.461+0000 7f359c400640 1 -- 172.21.15.40:0/1814591863 shutdown_connections 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.461+0000 7f359c400640 1 --2- 172.21.15.40:0/1814591863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3594107660 0x7f359419d880 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.461+0000 7f359c400640 1 -- 172.21.15.40:0/1814591863 >> 172.21.15.40:0/1814591863 conn(0x7f3594102db0 msgr2=0x7f35941039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.461+0000 7f359c400640 1 -- 172.21.15.40:0/1814591863 shutdown_connections 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:11.461+0000 7f359c400640 1 -- 172.21.15.40:0/1814591863 wait complete. 2024-09-11T22:20:12.013 INFO:teuthology.orchestra.run.smithi040.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T22:20:12.032 INFO:teuthology.orchestra.run.smithi040.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:20:12.032 INFO:teuthology.orchestra.run.smithi040.stdout:Creating mgr... 2024-09-11T22:20:12.033 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T22:20:12.033 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T22:20:12.384 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.x 2024-09-11T22:20:12.384 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-11T22:20:12.615 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c836ee3e-708b-11ef-bcea-c7b262605968.target.wants/ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c836ee3e-708b-11ef-bcea-c7b262605968@.service. 2024-09-11T22:20:12.649 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:12 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1814591863' entity='client.admin' 2024-09-11T22:20:12.649 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:12 smithi040 systemd[1]: Starting Ceph mgr.x for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:20:13.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:12 smithi040 podman[30994]: 2024-09-11 22:20:12.951784009 +0000 UTC m=+0.117152784 container create 1eadf4c36052ffdaddb7846b6bc2f8e11cbaf73073f49677e773afa1562ff85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T22:20:13.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:12 smithi040 podman[30994]: 2024-09-11 22:20:12.861887729 +0000 UTC m=+0.027256530 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:20:13.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:13 smithi040 podman[30994]: 2024-09-11 22:20:13.179240912 +0000 UTC m=+0.344609689 container init 1eadf4c36052ffdaddb7846b6bc2f8e11cbaf73073f49677e773afa1562ff85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T22:20:13.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:13 smithi040 podman[30994]: 2024-09-11 22:20:13.185473847 +0000 UTC m=+0.350842624 container start 1eadf4c36052ffdaddb7846b6bc2f8e11cbaf73073f49677e773afa1562ff85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T22:20:13.299 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T22:20:13.299 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout disabled 2024-09-11T22:20:13.313 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T22:20:13.313 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-09-11T22:20:13.313 INFO:teuthology.orchestra.run.smithi040.stdout:firewalld.service is not enabled 2024-09-11T22:20:13.313 INFO:teuthology.orchestra.run.smithi040.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T22:20:13.330 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T22:20:13.331 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout disabled 2024-09-11T22:20:13.345 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T22:20:13.345 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-09-11T22:20:13.345 INFO:teuthology.orchestra.run.smithi040.stdout:firewalld.service is not enabled 2024-09-11T22:20:13.345 INFO:teuthology.orchestra.run.smithi040.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T22:20:13.345 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mgr to start... 2024-09-11T22:20:13.345 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mgr... 2024-09-11T22:20:13.620 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:13 smithi040 bash[30994]: 1eadf4c36052ffdaddb7846b6bc2f8e11cbaf73073f49677e773afa1562ff85b 2024-09-11T22:20:13.621 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:13 smithi040 systemd[1]: Started Ceph mgr.x for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:20:13.621 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:13 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:13.356+0000 7f1fbac2f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:20:13.621 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:13 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:13.434+0000 7f1fbac2f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:20:13.905 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:13 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:13.634+0000 7f1fbac2f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:20:13.905 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:13 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:13.717+0000 7f1fbac2f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:20:13.905 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:13 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:13.904+0000 7f1fbac2f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:20:14.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:13 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/272155996' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T22:20:14.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:14 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:14.082+0000 7f1fbac2f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:20:14.602 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:14 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:14.478+0000 7f1fbac2f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:20:14.602 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:14 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:14.552+0000 7f1fbac2f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:20:14.611 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:14.611 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:14.611 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:20:14.611 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 0 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:20:14.612 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-11T22:20:14.613 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T22:20:14.613 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:14.613 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T22:20:14.613 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T22:20:14.613 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:14.613 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T22:20:14.613 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:14.613 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T22:20:14.614 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T22:20:14.614 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T22:20:14.621 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T22:20:14.621 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T22:20:05:624820+0000", 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:20:14.623 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T22:20:05.625626+0000", 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.858+0000 7fea20400640 1 Processor -- start 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.858+0000 7fea20400640 1 -- start start 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.858+0000 7fea20400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea1807c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.858+0000 7fea20400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fea1807c8b0 con 0x7fea1807de30 2024-09-11T22:20:14.624 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.859+0000 7fea1da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea1807c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.859+0000 7fea1da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea1807c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48590/0 (socket says 172.21.15.40:48590) 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.859+0000 7fea1da00640 1 -- 172.21.15.40:0/345594175 learned_addr learned my addr 172.21.15.40:0/345594175 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.859+0000 7fea1da00640 1 -- 172.21.15.40:0/345594175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1807ca30 con 0x7fea1807de30 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.860+0000 7fea1da00640 1 --2- 172.21.15.40:0/345594175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea1807c2e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009820 tx=0x7fea0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ce8f1b9ef27642 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.861+0000 7fea17e00640 1 -- 172.21.15.40:0/345594175 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea0c037070 con 0x7fea1807de30 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.861+0000 7fea17e00640 1 -- 172.21.15.40:0/345594175 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea0c032900 con 0x7fea1807de30 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.861+0000 7fea17e00640 1 -- 172.21.15.40:0/345594175 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea0c030850 con 0x7fea1807de30 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.861+0000 7fea20400640 1 -- 172.21.15.40:0/345594175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 msgr2=0x7fea1807c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.861+0000 7fea20400640 1 --2- 172.21.15.40:0/345594175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea1807c2e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009820 tx=0x7fea0c02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.861+0000 7fea20400640 1 -- 172.21.15.40:0/345594175 shutdown_connections 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.861+0000 7fea20400640 1 --2- 172.21.15.40:0/345594175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea1807c2e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:14.625 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.861+0000 7fea20400640 1 -- 172.21.15.40:0/345594175 >> 172.21.15.40:0/345594175 conn(0x7fea18102db0 msgr2=0x7fea181051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.862+0000 7fea20400640 1 -- 172.21.15.40:0/345594175 shutdown_connections 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.862+0000 7fea20400640 1 -- 172.21.15.40:0/345594175 wait complete. 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.863+0000 7fea20400640 1 Processor -- start 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.863+0000 7fea20400640 1 -- start start 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.863+0000 7fea20400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea181a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.863+0000 7fea20400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fea181097e0 con 0x7fea1807de30 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.863+0000 7fea1da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea181a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.863+0000 7fea1da00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea181a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48606/0 (socket says 172.21.15.40:48606) 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.863+0000 7fea1da00640 1 -- 172.21.15.40:0/272155996 learned_addr learned my addr 172.21.15.40:0/272155996 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.864+0000 7fea1da00640 1 -- 172.21.15.40:0/272155996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea181a2140 con 0x7fea1807de30 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.864+0000 7fea1da00640 1 --2- 172.21.15.40:0/272155996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea181a1c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fea0c032ce0 tx=0x7fea0c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.864+0000 7fea16000640 1 -- 172.21.15.40:0/272155996 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea0c042070 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.864+0000 7fea16000640 1 -- 172.21.15.40:0/272155996 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea0c0308c0 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.864+0000 7fea16000640 1 -- 172.21.15.40:0/272155996 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea0c037040 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.864+0000 7fea20400640 1 -- 172.21.15.40:0/272155996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea181a23d0 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.864+0000 7fea20400640 1 -- 172.21.15.40:0/272155996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea181a50c0 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.865+0000 7fea16000640 1 -- 172.21.15.40:0/272155996 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fea0c045070 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.865+0000 7fea16000640 1 -- 172.21.15.40:0/272155996 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fea0c047b80 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.866+0000 7fea20400640 1 -- 172.21.15.40:0/272155996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea1807c360 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.868+0000 7fea16000640 1 -- 172.21.15.40:0/272155996 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fea0c03c720 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.934+0000 7fea20400640 1 -- 172.21.15.40:0/272155996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fea181a5290 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.935+0000 7fea16000640 1 -- 172.21.15.40:0/272155996 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fea0c03c900 con 0x7fea1807de30 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.936+0000 7fea20400640 1 -- 172.21.15.40:0/272155996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 msgr2=0x7fea181a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:14.627 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.936+0000 7fea20400640 1 --2- 172.21.15.40:0/272155996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea181a1c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fea0c032ce0 tx=0x7fea0c032d10 comp rx=0 tx=0).stop 2024-09-11T22:20:14.628 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.936+0000 7fea20400640 1 -- 172.21.15.40:0/272155996 shutdown_connections 2024-09-11T22:20:14.628 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.936+0000 7fea20400640 1 --2- 172.21.15.40:0/272155996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1807de30 0x7fea181a1c00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:14.628 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.936+0000 7fea20400640 1 -- 172.21.15.40:0/272155996 >> 172.21.15.40:0/272155996 conn(0x7fea18102db0 msgr2=0x7fea181051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:14.628 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.936+0000 7fea20400640 1 -- 172.21.15.40:0/272155996 shutdown_connections 2024-09-11T22:20:14.628 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:13.936+0000 7fea20400640 1 -- 172.21.15.40:0/272155996 wait complete. 2024-09-11T22:20:14.628 INFO:teuthology.orchestra.run.smithi040.stdout:mgr not available, waiting (1/15)... 2024-09-11T22:20:14.984 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:14 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:14.773+0000 7f1fbac2f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:20:16.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:15 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:15.927+0000 7f1fbac2f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:20:16.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:16 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:16.010+0000 7f1fbac2f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:20:17.275 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:17 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:17.013+0000 7f1fbac2f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:20:17.275 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:17 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:17.161+0000 7f1fbac2f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:20:17.592 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:17 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1123932487' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T22:20:17.593 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:17 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:17.337+0000 7f1fbac2f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:20:17.593 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:17 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:17.412+0000 7f1fbac2f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:20:17.593 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:17 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:17.592+0000 7f1fbac2f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:20:17.859 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:17 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:17.677+0000 7f1fbac2f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:20:17.859 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:17 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:17.751+0000 7f1fbac2f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:20:17.866 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:17.866 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:17.866 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 0 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:20:17.867 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T22:20:17.868 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T22:20:17.876 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T22:20:17.876 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T22:20:17.877 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T22:20:05:624820+0000", 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T22:20:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T22:20:05.625626+0000", 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:17.879 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.147+0000 7f6b52600640 1 Processor -- start 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.147+0000 7f6b52600640 1 -- start start 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.148+0000 7f6b52600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.148+0000 7f6b52600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c10a1a0 con 0x7f6b4c1097d0 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.148+0000 7f6b4b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.148+0000 7f6b4b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48614/0 (socket says 172.21.15.40:48614) 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.148+0000 7f6b4b400640 1 -- 172.21.15.40:0/1797214902 learned_addr learned my addr 172.21.15.40:0/1797214902 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.149+0000 7f6b4b400640 1 -- 172.21.15.40:0/1797214902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c10a9e0 con 0x7f6b4c1097d0 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.150+0000 7f6b4b400640 1 --2- 172.21.15.40:0/1797214902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c109bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009820 tx=0x7f6b3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2b627e41f4b7d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.150+0000 7f6b4a000640 1 -- 172.21.15.40:0/1797214902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c037070 con 0x7f6b4c1097d0 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.150+0000 7f6b4a000640 1 -- 172.21.15.40:0/1797214902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b3c032900 con 0x7f6b4c1097d0 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.150+0000 7f6b4a000640 1 -- 172.21.15.40:0/1797214902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c030850 con 0x7f6b4c1097d0 2024-09-11T22:20:17.880 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.151+0000 7f6b52600640 1 -- 172.21.15.40:0/1797214902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 msgr2=0x7f6b4c109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.151+0000 7f6b52600640 1 --2- 172.21.15.40:0/1797214902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c109bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009820 tx=0x7f6b3c02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.151+0000 7f6b52600640 1 -- 172.21.15.40:0/1797214902 shutdown_connections 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.151+0000 7f6b52600640 1 --2- 172.21.15.40:0/1797214902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c109bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.151+0000 7f6b52600640 1 -- 172.21.15.40:0/1797214902 >> 172.21.15.40:0/1797214902 conn(0x7f6b4c07cde0 msgr2=0x7f6b4c07d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.151+0000 7f6b52600640 1 -- 172.21.15.40:0/1797214902 shutdown_connections 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.151+0000 7f6b52600640 1 -- 172.21.15.40:0/1797214902 wait complete. 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.152+0000 7f6b52600640 1 Processor -- start 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.152+0000 7f6b52600640 1 -- start start 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.152+0000 7f6b52600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.152+0000 7f6b52600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c10dd90 con 0x7f6b4c1097d0 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.153+0000 7f6b4b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.153+0000 7f6b4b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c19d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48622/0 (socket says 172.21.15.40:48622) 2024-09-11T22:20:17.881 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.153+0000 7f6b4b400640 1 -- 172.21.15.40:0/1123932487 learned_addr learned my addr 172.21.15.40:0/1123932487 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:17.882 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.153+0000 7f6b4b400640 1 -- 172.21.15.40:0/1123932487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c19dd70 con 0x7f6b4c1097d0 2024-09-11T22:20:17.882 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.153+0000 7f6b4b400640 1 --2- 172.21.15.40:0/1123932487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c19d830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0097f0 tx=0x7f6b3c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.882 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.154+0000 7f6b43e00640 1 -- 172.21.15.40:0/1123932487 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c037040 con 0x7f6b4c1097d0 2024-09-11T22:20:17.882 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.154+0000 7f6b43e00640 1 -- 172.21.15.40:0/1123932487 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b3c040070 con 0x7f6b4c1097d0 2024-09-11T22:20:17.882 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.154+0000 7f6b43e00640 1 -- 172.21.15.40:0/1123932487 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b3c03a390 con 0x7f6b4c1097d0 2024-09-11T22:20:17.882 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.154+0000 7f6b52600640 1 -- 172.21.15.40:0/1123932487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c19e000 con 0x7f6b4c1097d0 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.154+0000 7f6b52600640 1 -- 172.21.15.40:0/1123932487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c1a0cf0 con 0x7f6b4c1097d0 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.154+0000 7f6b43e00640 1 -- 172.21.15.40:0/1123932487 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6b3c03a5a0 con 0x7f6b4c1097d0 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.154+0000 7f6b43e00640 1 -- 172.21.15.40:0/1123932487 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6b3c045910 con 0x7f6b4c1097d0 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.155+0000 7f6b52600640 1 -- 172.21.15.40:0/1123932487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4c109bd0 con 0x7f6b4c1097d0 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.158+0000 7f6b43e00640 1 -- 172.21.15.40:0/1123932487 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6b3c045460 con 0x7f6b4c1097d0 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.223+0000 7f6b52600640 1 -- 172.21.15.40:0/1123932487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6b4c1a0ec0 con 0x7f6b4c1097d0 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.224+0000 7f6b43e00640 1 -- 172.21.15.40:0/1123932487 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f6b3c03b430 con 0x7f6b4c1097d0 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.225+0000 7f6b52600640 1 -- 172.21.15.40:0/1123932487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 msgr2=0x7f6b4c19d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.225+0000 7f6b52600640 1 --2- 172.21.15.40:0/1123932487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c19d830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0097f0 tx=0x7f6b3c030d80 comp rx=0 tx=0).stop 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.225+0000 7f6b52600640 1 -- 172.21.15.40:0/1123932487 shutdown_connections 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.225+0000 7f6b52600640 1 --2- 172.21.15.40:0/1123932487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c1097d0 0x7f6b4c19d830 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.225+0000 7f6b52600640 1 -- 172.21.15.40:0/1123932487 >> 172.21.15.40:0/1123932487 conn(0x7f6b4c07cde0 msgr2=0x7f6b4c1074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.884 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.225+0000 7f6b52600640 1 -- 172.21.15.40:0/1123932487 shutdown_connections 2024-09-11T22:20:17.884 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:17.225+0000 7f6b52600640 1 -- 172.21.15.40:0/1123932487 wait complete. 2024-09-11T22:20:17.884 INFO:teuthology.orchestra.run.smithi040.stdout:mgr not available, waiting (2/15)... 2024-09-11T22:20:18.208 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:17 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:17.944+0000 7f1fbac2f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:20:18.208 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:18 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:18.025+0000 7f1fbac2f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:20:18.208 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:18 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:18.107+0000 7f1fbac2f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:20:18.209 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:18 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:18.207+0000 7f1fbac2f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:20:18.484 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:18 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:18.281+0000 7f1fbac2f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:20:18.484 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:18 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:18.354+0000 7f1fbac2f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:20:19.734 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:19.309+0000 7f1fbac2f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:20:19.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: Activating manager daemon x 2024-09-11T22:20:19.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: mgrmap e2: x(active, starting, since 0.00393157s) 2024-09-11T22:20:19.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:20:19.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:20:19.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:20:19.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:20:19.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:20:19.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: Manager daemon x is now available 2024-09-11T22:20:19.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:20:19.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' 2024-09-11T22:20:19.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:20:19.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' 2024-09-11T22:20:19.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:19 smithi040 ceph-mon[30787]: from='mgr.14100 172.21.15.40:0/3947387772' entity='mgr.x' 2024-09-11T22:20:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:20:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T22:20:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T22:20:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T22:20:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T22:20:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 0 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T22:20:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T22:20:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T22:20:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T22:20:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T22:20:05:624820+0000", 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T22:20:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ], 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T22:20:05.625626+0000", 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout }, 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T22:20:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.344+0000 7fe08d000640 1 Processor -- start 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.345+0000 7fe08d000640 1 -- start start 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.345+0000 7fe08d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe088109d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.345+0000 7fe08d000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe08810a2e0 con 0x7fe088109910 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.345+0000 7fe087400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe088109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.345+0000 7fe087400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe088109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48712/0 (socket says 172.21.15.40:48712) 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.345+0000 7fe087400640 1 -- 172.21.15.40:0/2052530733 learned_addr learned my addr 172.21.15.40:0/2052530733 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.346+0000 7fe087400640 1 -- 172.21.15.40:0/2052530733 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08810a800 con 0x7fe088109910 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.347+0000 7fe087400640 1 --2- 172.21.15.40:0/2052530733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe088109d10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe078009820 tx=0x7fe07802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160d1eb0167f4725 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.347+0000 7fe086a00640 1 -- 172.21.15.40:0/2052530733 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe078037070 con 0x7fe088109910 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.347+0000 7fe086a00640 1 -- 172.21.15.40:0/2052530733 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe078032900 con 0x7fe088109910 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.347+0000 7fe086a00640 1 -- 172.21.15.40:0/2052530733 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe078030850 con 0x7fe088109910 2024-09-11T22:20:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.348+0000 7fe08d000640 1 -- 172.21.15.40:0/2052530733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 msgr2=0x7fe088109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.348+0000 7fe08d000640 1 --2- 172.21.15.40:0/2052530733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe088109d10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe078009820 tx=0x7fe07802a270 comp rx=0 tx=0).stop 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.348+0000 7fe08d000640 1 -- 172.21.15.40:0/2052530733 shutdown_connections 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.348+0000 7fe08d000640 1 --2- 172.21.15.40:0/2052530733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe088109d10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.348+0000 7fe08d000640 1 -- 172.21.15.40:0/2052530733 >> 172.21.15.40:0/2052530733 conn(0x7fe08807cce0 msgr2=0x7fe08807d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.348+0000 7fe08d000640 1 -- 172.21.15.40:0/2052530733 shutdown_connections 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.348+0000 7fe08d000640 1 -- 172.21.15.40:0/2052530733 wait complete. 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.349+0000 7fe08d000640 1 Processor -- start 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.349+0000 7fe08d000640 1 -- start start 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.349+0000 7fe08d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe08819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.349+0000 7fe08d000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe08810dbb0 con 0x7fe088109910 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.350+0000 7fe087400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe08819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.350+0000 7fe087400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe08819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48724/0 (socket says 172.21.15.40:48724) 2024-09-11T22:20:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.350+0000 7fe087400640 1 -- 172.21.15.40:0/3343324431 learned_addr learned my addr 172.21.15.40:0/3343324431 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.350+0000 7fe087400640 1 -- 172.21.15.40:0/3343324431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08819db80 con 0x7fe088109910 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.350+0000 7fe087400640 1 --2- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe08819d640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe0780097f0 tx=0x7fe078032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.350+0000 7fe084c00640 1 -- 172.21.15.40:0/3343324431 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe078042070 con 0x7fe088109910 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.351+0000 7fe084c00640 1 -- 172.21.15.40:0/3343324431 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0780308e0 con 0x7fe088109910 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.351+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08819de10 con 0x7fe088109910 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.351+0000 7fe084c00640 1 -- 172.21.15.40:0/3343324431 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe078037040 con 0x7fe088109910 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.351+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0881a0b00 con 0x7fe088109910 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.352+0000 7fe084c00640 1 -- 172.21.15.40:0/3343324431 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7fe078045070 con 0x7fe088109910 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.352+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08810dd30 con 0x7fe088109910 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.352+0000 7fe084c00640 1 --2- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fe06c038e60 0x7fe06c03b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.352+0000 7fe084c00640 1 -- 172.21.15.40:0/3343324431 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe07806bcb0 con 0x7fe088109910 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.353+0000 7fe07fe00640 1 --2- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fe06c038e60 0x7fe06c03b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.353+0000 7fe07fe00640 1 --2- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fe06c038e60 0x7fe06c03b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe0700098c0 tx=0x7fe070006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.358+0000 7fe084c00640 1 -- 172.21.15.40:0/3343324431 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe07803db60 con 0x7fe088109910 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.613+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe0881a1190 con 0x7fe088109910 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.613+0000 7fe084c00640 1 -- 172.21.15.40:0/3343324431 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fe07802fd90 con 0x7fe088109910 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fe06c038e60 msgr2=0x7fe06c03b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 --2- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fe06c038e60 0x7fe06c03b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe0700098c0 tx=0x7fe070006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 msgr2=0x7fe08819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 --2- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe08819d640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe0780097f0 tx=0x7fe078032ce0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 shutdown_connections 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 --2- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fe06c038e60 0x7fe06c03b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 --2- 172.21.15.40:0/3343324431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe088109910 0x7fe08819d640 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 >> 172.21.15.40:0/3343324431 conn(0x7fe08807cce0 msgr2=0x7fe088107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 shutdown_connections 2024-09-11T22:20:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:20.616+0000 7fe08d000640 1 -- 172.21.15.40:0/3343324431 wait complete. 2024-09-11T22:20:21.466 INFO:teuthology.orchestra.run.smithi040.stdout:mgr is available 2024-09-11T22:20:21.590 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:21 smithi040 ceph-mon[30787]: mgrmap e3: x(active, since 1.00809s) 2024-09-11T22:20:21.590 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:21 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3343324431' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T22:20:22.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:22 smithi040 ceph-mon[30787]: mgrmap e4: x(active, since 2s) 2024-09-11T22:20:22.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:22 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1652169180' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T22:20:22.766 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:22.766 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T22:20:22.766 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout fsid = c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:22.766 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.40:3300,v1:172.21.15.40:6789] 2024-09-11T22:20:22.766 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T22:20:22.767 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.934+0000 7f67a6000640 1 Processor -- start 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.934+0000 7f67a6000640 1 -- start start 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.934+0000 7f67a6000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a0107800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.934+0000 7f67a6000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0107dd0 con 0x7f67a0107400 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.934+0000 7f67a4c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a0107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.934+0000 7f67a4c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a0107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45542/0 (socket says 172.21.15.40:45542) 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.934+0000 7f67a4c00640 1 -- 172.21.15.40:0/649133483 learned_addr learned my addr 172.21.15.40:0/649133483 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.935+0000 7f67a4c00640 1 -- 172.21.15.40:0/649133483 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a0108600 con 0x7f67a0107400 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.936+0000 7f67a4c00640 1 --2- 172.21.15.40:0/649133483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a0107800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6794009820 tx=0x7f679402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e50715b4d4b1c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:22.768 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.936+0000 7f679f400640 1 -- 172.21.15.40:0/649133483 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6794037070 con 0x7f67a0107400 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.936+0000 7f679f400640 1 -- 172.21.15.40:0/649133483 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6794032900 con 0x7f67a0107400 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.936+0000 7f679f400640 1 -- 172.21.15.40:0/649133483 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6794030850 con 0x7f67a0107400 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.936+0000 7f67a6000640 1 -- 172.21.15.40:0/649133483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 msgr2=0x7f67a0107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.936+0000 7f67a6000640 1 --2- 172.21.15.40:0/649133483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a0107800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6794009820 tx=0x7f679402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.937+0000 7f67a6000640 1 -- 172.21.15.40:0/649133483 shutdown_connections 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.937+0000 7f67a6000640 1 --2- 172.21.15.40:0/649133483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a0107800 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.937+0000 7f67a6000640 1 -- 172.21.15.40:0/649133483 >> 172.21.15.40:0/649133483 conn(0x7f67a0102c10 msgr2=0x7f67a0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.937+0000 7f67a6000640 1 -- 172.21.15.40:0/649133483 shutdown_connections 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.937+0000 7f67a6000640 1 -- 172.21.15.40:0/649133483 wait complete. 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.938+0000 7f67a6000640 1 Processor -- start 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.938+0000 7f67a6000640 1 -- start start 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.938+0000 7f67a6000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.769 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.938+0000 7f67a6000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f67a010b9b0 con 0x7f67a0107400 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.938+0000 7f67a4c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.938+0000 7f67a4c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a019b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45556/0 (socket says 172.21.15.40:45556) 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.938+0000 7f67a4c00640 1 -- 172.21.15.40:0/1652169180 learned_addr learned my addr 172.21.15.40:0/1652169180 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.939+0000 7f67a4c00640 1 -- 172.21.15.40:0/1652169180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a019b940 con 0x7f67a0107400 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.939+0000 7f67a4c00640 1 --2- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a019b400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67940097f0 tx=0x7f6794030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.939+0000 7f679d600640 1 -- 172.21.15.40:0/1652169180 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6794037040 con 0x7f67a0107400 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.939+0000 7f679d600640 1 -- 172.21.15.40:0/1652169180 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6794040070 con 0x7f67a0107400 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.939+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a019bbd0 con 0x7f67a0107400 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.939+0000 7f679d600640 1 -- 172.21.15.40:0/1652169180 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f679403a390 con 0x7f67a0107400 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.939+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a019e8c0 con 0x7f67a0107400 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.940+0000 7f679d600640 1 -- 172.21.15.40:0/1652169180 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f6794032900 con 0x7f67a0107400 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.940+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a0107880 con 0x7f67a0107400 2024-09-11T22:20:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.941+0000 7f679d600640 1 --2- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f6788038f20 0x7f678803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.941+0000 7f679d600640 1 -- 172.21.15.40:0/1652169180 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f679406c0c0 con 0x7f67a0107400 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.941+0000 7f679fe00640 1 --2- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f6788038f20 0x7f678803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.942+0000 7f679fe00640 1 --2- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f6788038f20 0x7f678803b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f678c0098c0 tx=0x7f678c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:21.946+0000 7f679d600640 1 -- 172.21.15.40:0/1652169180 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f679406be20 con 0x7f67a0107400 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.133+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f67a019c050 con 0x7f67a0107400 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.134+0000 7f679d600640 1 -- 172.21.15.40:0/1652169180 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+454 (secure 0 0 0) 0x7f6794032bf0 con 0x7f67a0107400 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f6788038f20 msgr2=0x7f678803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 --2- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f6788038f20 0x7f678803b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f678c0098c0 tx=0x7f678c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 msgr2=0x7f67a019b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 --2- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a019b400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67940097f0 tx=0x7f6794030d80 comp rx=0 tx=0).stop 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 shutdown_connections 2024-09-11T22:20:22.771 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 --2- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f6788038f20 0x7f678803b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.772 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 --2- 172.21.15.40:0/1652169180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67a0107400 0x7f67a019b400 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.772 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 >> 172.21.15.40:0/1652169180 conn(0x7f67a0102c10 msgr2=0x7f67a0103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:22.772 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 shutdown_connections 2024-09-11T22:20:22.772 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:22.136+0000 7f67a6000640 1 -- 172.21.15.40:0/1652169180 wait complete. 2024-09-11T22:20:22.772 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling cephadm module... 2024-09-11T22:20:23.874 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:23 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1107025355' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-11T22:20:23.874 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:23 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: ignoring --setuser ceph since I am not root 2024-09-11T22:20:23.874 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:23 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: ignoring --setgroup ceph since I am not root 2024-09-11T22:20:23.874 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:23 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:23.801+0000 7fa7455d6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:20:23.874 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:23 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:23.873+0000 7fa7455d6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:20:24.149 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:24 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:24.065+0000 7fa7455d6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:20:24.149 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:24 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:24.149+0000 7fa7455d6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:20:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.275+0000 7f4879000640 1 Processor -- start 2024-09-11T22:20:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.275+0000 7f4879000640 1 -- start start 2024-09-11T22:20:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.276+0000 7f4879000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487407c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.276+0000 7f4879000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f487407c7c0 con 0x7f487407dd80 2024-09-11T22:20:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.276+0000 7f4871e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487407c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.276+0000 7f4871e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487407c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45566/0 (socket says 172.21.15.40:45566) 2024-09-11T22:20:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.276+0000 7f4871e00640 1 -- 172.21.15.40:0/1443521754 learned_addr learned my addr 172.21.15.40:0/1443521754 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.277+0000 7f4871e00640 1 -- 172.21.15.40:0/1443521754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487407c940 con 0x7f487407dd80 2024-09-11T22:20:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.278+0000 7f4871e00640 1 --2- 172.21.15.40:0/1443521754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487407c280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4864009820 tx=0x7f486402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c2160d4f64b96e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.278+0000 7f4871400640 1 -- 172.21.15.40:0/1443521754 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864037070 con 0x7f487407dd80 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.278+0000 7f4871400640 1 -- 172.21.15.40:0/1443521754 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4864032900 con 0x7f487407dd80 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.278+0000 7f4871400640 1 -- 172.21.15.40:0/1443521754 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864030850 con 0x7f487407dd80 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.279+0000 7f4879000640 1 -- 172.21.15.40:0/1443521754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 msgr2=0x7f487407c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.279+0000 7f4879000640 1 --2- 172.21.15.40:0/1443521754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487407c280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4864009820 tx=0x7f486402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.279+0000 7f4879000640 1 -- 172.21.15.40:0/1443521754 shutdown_connections 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.279+0000 7f4879000640 1 --2- 172.21.15.40:0/1443521754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487407c280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.279+0000 7f4879000640 1 -- 172.21.15.40:0/1443521754 >> 172.21.15.40:0/1443521754 conn(0x7f4874102db0 msgr2=0x7f4874105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.279+0000 7f4879000640 1 -- 172.21.15.40:0/1443521754 shutdown_connections 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.279+0000 7f4879000640 1 -- 172.21.15.40:0/1443521754 wait complete. 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.280+0000 7f4879000640 1 Processor -- start 2024-09-11T22:20:24.257 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.280+0000 7f4879000640 1 -- start start 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.280+0000 7f4879000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487419d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.280+0000 7f4879000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f487410dc30 con 0x7f487407dd80 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.280+0000 7f4871e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487419d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.281+0000 7f4871e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487419d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45582/0 (socket says 172.21.15.40:45582) 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.281+0000 7f4871e00640 1 -- 172.21.15.40:0/1107025355 learned_addr learned my addr 172.21.15.40:0/1107025355 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.281+0000 7f4871e00640 1 -- 172.21.15.40:0/1107025355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487419dd60 con 0x7f487407dd80 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.281+0000 7f4871e00640 1 --2- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487419d820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48640097f0 tx=0x7f4864030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.281+0000 7f486b400640 1 -- 172.21.15.40:0/1107025355 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864042070 con 0x7f487407dd80 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.281+0000 7f486b400640 1 -- 172.21.15.40:0/1107025355 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4864032ca0 con 0x7f487407dd80 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.281+0000 7f486b400640 1 -- 172.21.15.40:0/1107025355 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4864037040 con 0x7f487407dd80 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.281+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487419dff0 con 0x7f487407dd80 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.282+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48741a0ce0 con 0x7f487407dd80 2024-09-11T22:20:24.258 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.283+0000 7f486b400640 1 -- 172.21.15.40:0/1107025355 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f4864045070 con 0x7f487407dd80 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.283+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487407c300 con 0x7f487407dd80 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.283+0000 7f486b400640 1 --2- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f4858038f70 0x7f485803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.283+0000 7f486b400640 1 -- 172.21.15.40:0/1107025355 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f486406bec0 con 0x7f487407dd80 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.284+0000 7f4869400640 1 --2- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f4858038f70 0x7f485803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.284+0000 7f4869400640 1 --2- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f4858038f70 0x7f485803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f485c0098c0 tx=0x7f485c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.289+0000 7f486b400640 1 -- 172.21.15.40:0/1107025355 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4864045360 con 0x7f487407dd80 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.523+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f48741a1360 con 0x7f487407dd80 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.575+0000 7f486b400640 1 -- 172.21.15.40:0/1107025355 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f486406b8e0 con 0x7f487407dd80 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.577+0000 7f486b400640 1 -- 172.21.15.40:0/1107025355 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f486403d430 con 0x7f487407dd80 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.578+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f4858038f70 msgr2=0x7f485803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.578+0000 7f4879000640 1 --2- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f4858038f70 0x7f485803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f485c0098c0 tx=0x7f485c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.259 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.578+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 msgr2=0x7f487419d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.260 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.578+0000 7f4879000640 1 --2- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487419d820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48640097f0 tx=0x7f4864030ec0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.260 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.578+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 shutdown_connections 2024-09-11T22:20:24.260 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.578+0000 7f4879000640 1 --2- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7f4858038f70 0x7f485803b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.260 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.578+0000 7f4879000640 1 --2- 172.21.15.40:0/1107025355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f487407dd80 0x7f487419d820 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.260 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.578+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 >> 172.21.15.40:0/1107025355 conn(0x7f4874102db0 msgr2=0x7f4874103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.260 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.579+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 shutdown_connections 2024-09-11T22:20:24.260 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:23.579+0000 7f4879000640 1 -- 172.21.15.40:0/1107025355 wait complete. 2024-09-11T22:20:24.403 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:24 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:24.333+0000 7fa7455d6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:20:24.673 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:24 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1107025355' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T22:20:24.673 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:24 smithi040 ceph-mon[30787]: mgrmap e5: x(active, since 4s) 2024-09-11T22:20:24.674 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:24 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:24.506+0000 7fa7455d6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:20:24.975 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:24 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:24.901+0000 7fa7455d6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:20:24.975 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:24 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:24.975+0000 7fa7455d6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:20:25.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:25 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:25.198+0000 7fa7455d6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:20:25.663 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:25.663 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T22:20:25.663 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T22:20:25.663 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T22:20:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T22:20:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.781+0000 7fa236000640 1 Processor -- start 2024-09-11T22:20:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.781+0000 7fa236000640 1 -- start start 2024-09-11T22:20:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.782+0000 7fa236000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa230109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.782+0000 7fa236000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa23010a1a0 con 0x7fa2301097d0 2024-09-11T22:20:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.782+0000 7fa22f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa230109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.782+0000 7fa22f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa230109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45602/0 (socket says 172.21.15.40:45602) 2024-09-11T22:20:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.782+0000 7fa22f400640 1 -- 172.21.15.40:0/523718950 learned_addr learned my addr 172.21.15.40:0/523718950 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.782+0000 7fa22f400640 1 -- 172.21.15.40:0/523718950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23010a9e0 con 0x7fa2301097d0 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.783+0000 7fa22f400640 1 --2- 172.21.15.40:0/523718950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa230109bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa220009820 tx=0x7fa22002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815bafcb4f7801e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.784+0000 7fa22e000640 1 -- 172.21.15.40:0/523718950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa220037070 con 0x7fa2301097d0 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.784+0000 7fa22e000640 1 -- 172.21.15.40:0/523718950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa220032900 con 0x7fa2301097d0 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.784+0000 7fa22e000640 1 -- 172.21.15.40:0/523718950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa220030850 con 0x7fa2301097d0 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.784+0000 7fa236000640 1 -- 172.21.15.40:0/523718950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 msgr2=0x7fa230109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.784+0000 7fa236000640 1 --2- 172.21.15.40:0/523718950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa230109bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa220009820 tx=0x7fa22002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.784+0000 7fa236000640 1 -- 172.21.15.40:0/523718950 shutdown_connections 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.784+0000 7fa236000640 1 --2- 172.21.15.40:0/523718950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa230109bd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.784+0000 7fa236000640 1 -- 172.21.15.40:0/523718950 >> 172.21.15.40:0/523718950 conn(0x7fa23007cde0 msgr2=0x7fa23007d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.665 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.785+0000 7fa236000640 1 -- 172.21.15.40:0/523718950 shutdown_connections 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.785+0000 7fa236000640 1 -- 172.21.15.40:0/523718950 wait complete. 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.785+0000 7fa236000640 1 Processor -- start 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.786+0000 7fa236000640 1 -- start start 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.786+0000 7fa236000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa23019d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.786+0000 7fa236000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa23010dd90 con 0x7fa2301097d0 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.786+0000 7fa22f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa23019d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.786+0000 7fa22f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa23019d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45610/0 (socket says 172.21.15.40:45610) 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.786+0000 7fa22f400640 1 -- 172.21.15.40:0/849165798 learned_addr learned my addr 172.21.15.40:0/849165798 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.787+0000 7fa22f400640 1 -- 172.21.15.40:0/849165798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23019dd70 con 0x7fa2301097d0 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.787+0000 7fa22f400640 1 --2- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa23019d830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa220009940 tx=0x7fa220032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.787+0000 7fa227e00640 1 -- 172.21.15.40:0/849165798 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa220042070 con 0x7fa2301097d0 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.787+0000 7fa227e00640 1 -- 172.21.15.40:0/849165798 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2200308c0 con 0x7fa2301097d0 2024-09-11T22:20:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.787+0000 7fa227e00640 1 -- 172.21.15.40:0/849165798 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa220037040 con 0x7fa2301097d0 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.787+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa23019e000 con 0x7fa2301097d0 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.787+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2301a0cf0 con 0x7fa2301097d0 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.789+0000 7fa227e00640 1 -- 172.21.15.40:0/849165798 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fa220045070 con 0x7fa2301097d0 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.789+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa230109bd0 con 0x7fa2301097d0 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.789+0000 7fa227e00640 1 --2- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fa214038fc0 0x7fa21403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.789+0000 7fa227e00640 1 -- 172.21.15.40:0/849165798 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa22006bfb0 con 0x7fa2301097d0 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.789+0000 7fa22ea00640 1 -- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fa214038fc0 msgr2=0x7fa21403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2370914626 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.789+0000 7fa22ea00640 1 --2- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fa214038fc0 0x7fa21403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.794+0000 7fa227e00640 1 -- 172.21.15.40:0/849165798 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa22004b170 con 0x7fa2301097d0 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.990+0000 7fa22ea00640 1 -- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fa214038fc0 msgr2=0x7fa21403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2370914626 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:24.990+0000 7fa22ea00640 1 --2- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fa214038fc0 0x7fa21403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.024+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fa2301a1370 con 0x7fa2301097d0 2024-09-11T22:20:25.667 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.024+0000 7fa227e00640 1 -- 172.21.15.40:0/849165798 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fa22006b9d0 con 0x7fa2301097d0 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.026+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fa214038fc0 msgr2=0x7fa21403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.026+0000 7fa236000640 1 --2- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fa214038fc0 0x7fa21403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.026+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 msgr2=0x7fa23019d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.026+0000 7fa236000640 1 --2- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa23019d830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa220009940 tx=0x7fa220032ce0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.027+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 shutdown_connections 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.027+0000 7fa236000640 1 --2- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fa214038fc0 0x7fa21403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.027+0000 7fa236000640 1 --2- 172.21.15.40:0/849165798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2301097d0 0x7fa23019d830 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.027+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 >> 172.21.15.40:0/849165798 conn(0x7fa23007cde0 msgr2=0x7fa2301074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.027+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 shutdown_connections 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:25.027+0000 7fa236000640 1 -- 172.21.15.40:0/849165798 wait complete. 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for the mgr to restart... 2024-09-11T22:20:25.668 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mgr epoch 5... 2024-09-11T22:20:25.799 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:25 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/849165798' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T22:20:26.734 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:26 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:26.361+0000 7fa7455d6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:20:26.734 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:26 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:26.445+0000 7fa7455d6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:20:27.705 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:27 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:27.392+0000 7fa7455d6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:20:27.705 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:27 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:27.534+0000 7fa7455d6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:20:27.705 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:27 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:27.704+0000 7fa7455d6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:20:27.959 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:27 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:27.779+0000 7fa7455d6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:20:27.959 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:27 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:27.958+0000 7fa7455d6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:20:28.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:28.047+0000 7fa7455d6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:20:28.234 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:28.123+0000 7fa7455d6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:20:28.582 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:28.314+0000 7fa7455d6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:20:28.582 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:28.396+0000 7fa7455d6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:20:28.583 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:28.479+0000 7fa7455d6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:20:28.583 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:28.582+0000 7fa7455d6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:20:28.984 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:28.661+0000 7fa7455d6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:20:28.984 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:28.735+0000 7fa7455d6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:20:29.984 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:29.705+0000 7fa7455d6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:20:29.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: Active manager daemon x restarted 2024-09-11T22:20:29.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: Activating manager daemon x 2024-09-11T22:20:29.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T22:20:29.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: mgrmap e6: x(active, starting, since 0.00398645s) 2024-09-11T22:20:29.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:20:29.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:20:29.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:20:29.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:20:29.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:20:29.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: Manager daemon x is now available 2024-09-11T22:20:29.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:29.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:29.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:29.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:29 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:30 smithi040 ceph-mon[30787]: Found migration_current of "None". Setting to last migration. 2024-09-11T22:20:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:30 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:20:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:30 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:20:30.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:30 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:30.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:30 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:30.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:30 smithi040 ceph-mon[30787]: mgrmap e7: x(active, since 1.00876s) 2024-09-11T22:20:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T22:20:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.204+0000 7fd603a00640 1 Processor -- start 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.204+0000 7fd603a00640 1 -- start start 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.204+0000 7fd603a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.204+0000 7fd603a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc108000 con 0x7fd5fc107630 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.205+0000 7fd601000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.205+0000 7fd601000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45620/0 (socket says 172.21.15.40:45620) 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.205+0000 7fd601000640 1 -- 172.21.15.40:0/1896775195 learned_addr learned my addr 172.21.15.40:0/1896775195 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.205+0000 7fd601000640 1 -- 172.21.15.40:0/1896775195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc108830 con 0x7fd5fc107630 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.206+0000 7fd601000640 1 --2- 172.21.15.40:0/1896775195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc107a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009820 tx=0x7fd5f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aea7aebc4afb013 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.206+0000 7fd5fb400640 1 -- 172.21.15.40:0/1896775195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f0037070 con 0x7fd5fc107630 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.207+0000 7fd5fb400640 1 -- 172.21.15.40:0/1896775195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5f0032900 con 0x7fd5fc107630 2024-09-11T22:20:31.505 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.207+0000 7fd5fb400640 1 -- 172.21.15.40:0/1896775195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f0030850 con 0x7fd5fc107630 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.207+0000 7fd603a00640 1 -- 172.21.15.40:0/1896775195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 msgr2=0x7fd5fc107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.207+0000 7fd603a00640 1 --2- 172.21.15.40:0/1896775195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc107a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009820 tx=0x7fd5f002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.207+0000 7fd603a00640 1 -- 172.21.15.40:0/1896775195 shutdown_connections 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.207+0000 7fd603a00640 1 --2- 172.21.15.40:0/1896775195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc107a30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.207+0000 7fd603a00640 1 -- 172.21.15.40:0/1896775195 >> 172.21.15.40:0/1896775195 conn(0x7fd5fc102d80 msgr2=0x7fd5fc105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.207+0000 7fd603a00640 1 -- 172.21.15.40:0/1896775195 shutdown_connections 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.208+0000 7fd603a00640 1 -- 172.21.15.40:0/1896775195 wait complete. 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.208+0000 7fd603a00640 1 Processor -- start 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.209+0000 7fd603a00640 1 -- start start 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.209+0000 7fd603a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.209+0000 7fd603a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc10bbe0 con 0x7fd5fc107630 2024-09-11T22:20:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.209+0000 7fd601000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.209+0000 7fd601000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45630/0 (socket says 172.21.15.40:45630) 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.209+0000 7fd601000640 1 -- 172.21.15.40:0/3803295476 learned_addr learned my addr 172.21.15.40:0/3803295476 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.210+0000 7fd601000640 1 -- 172.21.15.40:0/3803295476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc19bb90 con 0x7fd5fc107630 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.210+0000 7fd601000640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc19b650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00097f0 tx=0x7fd5f0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.210+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f0042070 con 0x7fd5fc107630 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.210+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5f0032ca0 con 0x7fd5fc107630 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.210+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5f0037040 con 0x7fd5fc107630 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.210+0000 7fd603a00640 1 -- 172.21.15.40:0/3803295476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5fc19be20 con 0x7fd5fc107630 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.210+0000 7fd603a00640 1 -- 172.21.15.40:0/3803295476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5fc19eb10 con 0x7fd5fc107630 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.212+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fd5f0045070 con 0x7fd5fc107630 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.212+0000 7fd5f9600640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 0x7fd5e403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.212+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 --> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd5e403bb40 con 0x7fd5e4038f70 2024-09-11T22:20:31.507 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.212+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd5f006bec0 con 0x7fd5fc107630 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.212+0000 7fd5fbe00640 1 -- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 msgr2=0x7fd5e403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2370914626 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.212+0000 7fd5fbe00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 0x7fd5e403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.413+0000 7fd5fbe00640 1 -- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 msgr2=0x7fd5e403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2370914626 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.413+0000 7fd5fbe00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 0x7fd5e403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.814+0000 7fd5fbe00640 1 -- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 msgr2=0x7fd5e403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2370914626 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:26.814+0000 7fd5fbe00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 0x7fd5e403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.615+0000 7fd5fbe00640 1 -- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 msgr2=0x7fd5e403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2370914626 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:27.615+0000 7fd5fbe00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 0x7fd5e403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.215+0000 7fd5fbe00640 1 -- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 msgr2=0x7fd5e403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2370914626 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.216+0000 7fd5fbe00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 0x7fd5e403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.709+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fd5f003d430 con 0x7fd5fc107630 2024-09-11T22:20:31.508 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.709+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 msgr2=0x7fd5e403b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:29.709+0000 7fd5f9600640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 0x7fd5e403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.713+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fd5f006db30 con 0x7fd5fc107630 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.713+0000 7fd5f9600640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5e403c8a0 0x7fd5e403ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.713+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd5f0064ff0 con 0x7fd5e403c8a0 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.714+0000 7fd5fbe00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5e403c8a0 0x7fd5e403ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.715+0000 7fd5fbe00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5e403c8a0 0x7fd5e403ec90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8003980 tx=0x7fd5e8009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.716+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 <== mgr.14118 v2:172.21.15.40:6800/2835470410 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fd5f0064ff0 con 0x7fd5e403c8a0 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 -- 172.21.15.40:0/3803295476 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fd5fc107ab0 con 0x7fd5e403c8a0 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd5f9600640 1 -- 172.21.15.40:0/3803295476 <== mgr.14118 v2:172.21.15.40:6800/2835470410 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fd5fc107ab0 con 0x7fd5e403c8a0 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 -- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5e403c8a0 msgr2=0x7fd5e403ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5e403c8a0 0x7fd5e403ec90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8003980 tx=0x7fd5e8009290 comp rx=0 tx=0).stop 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 -- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 msgr2=0x7fd5fc19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc19b650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00097f0 tx=0x7fd5f0030ec0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 -- 172.21.15.40:0/3803295476 shutdown_connections 2024-09-11T22:20:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5e403c8a0 0x7fd5e403ec90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:6800/2370914626,v1:172.21.15.40:6801/2370914626] conn(0x7fd5e4038f70 0x7fd5e403b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 --2- 172.21.15.40:0/3803295476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5fc107630 0x7fd5fc19b650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.724+0000 7fd603a00640 1 -- 172.21.15.40:0/3803295476 >> 172.21.15.40:0/3803295476 conn(0x7fd5fc102d80 msgr2=0x7fd5fc1039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.725+0000 7fd603a00640 1 -- 172.21.15.40:0/3803295476 shutdown_connections 2024-09-11T22:20:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:30.725+0000 7fd603a00640 1 -- 172.21.15.40:0/3803295476 wait complete. 2024-09-11T22:20:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:mgr epoch 5 is available 2024-09-11T22:20:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:Setting orchestrator backend to cephadm... 2024-09-11T22:20:32.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:31 smithi040 ceph-mon[30787]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T22:20:32.038 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:31 smithi040 ceph-mon[30787]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T22:20:32.302 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:32.245+0000 7fa6a3c00640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:22:20:32] ENGINE Error in HTTPServer.serve 2024-09-11T22:20:32.302 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: Traceback (most recent call last): 2024-09-11T22:20:32.302 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:20:32.302 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: self._connections.run(self.expiration_interval) 2024-09-11T22:20:32.302 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:20:32.302 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: self._run(expiration_interval) 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: s = self.context.wrap_socket( 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: return self.sslsocket_class._create( 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: self.do_handshake() 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:20:32.303 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: self._sslobj.do_handshake() 2024-09-11T22:20:32.304 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:20:32.304 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.036+0000 7f39d8c00640 1 Processor -- start 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.036+0000 7f39d8c00640 1 -- start start 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.036+0000 7f39d8c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d4109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.037+0000 7f39d8c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f39d410a1a0 con 0x7f39d41097d0 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.037+0000 7f39d1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d4109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.037+0000 7f39d1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d4109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59858/0 (socket says 172.21.15.40:59858) 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.037+0000 7f39d1e00640 1 -- 172.21.15.40:0/507259059 learned_addr learned my addr 172.21.15.40:0/507259059 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.038+0000 7f39d1e00640 1 -- 172.21.15.40:0/507259059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d410a9e0 con 0x7f39d41097d0 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.039+0000 7f39d1e00640 1 --2- 172.21.15.40:0/507259059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d4109bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009820 tx=0x7f39c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c94c29362931eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.039+0000 7f39d0a00640 1 -- 172.21.15.40:0/507259059 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c4037070 con 0x7f39d41097d0 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.039+0000 7f39d0a00640 1 -- 172.21.15.40:0/507259059 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39c4032900 con 0x7f39d41097d0 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.039+0000 7f39d0a00640 1 -- 172.21.15.40:0/507259059 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c4030850 con 0x7f39d41097d0 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.040+0000 7f39d8c00640 1 -- 172.21.15.40:0/507259059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 msgr2=0x7f39d4109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.040+0000 7f39d8c00640 1 --2- 172.21.15.40:0/507259059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d4109bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009820 tx=0x7f39c402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.040+0000 7f39d8c00640 1 -- 172.21.15.40:0/507259059 shutdown_connections 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.040+0000 7f39d8c00640 1 --2- 172.21.15.40:0/507259059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d4109bd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.040+0000 7f39d8c00640 1 -- 172.21.15.40:0/507259059 >> 172.21.15.40:0/507259059 conn(0x7f39d407cde0 msgr2=0x7f39d407d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.040+0000 7f39d8c00640 1 -- 172.21.15.40:0/507259059 shutdown_connections 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.040+0000 7f39d8c00640 1 -- 172.21.15.40:0/507259059 wait complete. 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.041+0000 7f39d8c00640 1 Processor -- start 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.041+0000 7f39d8c00640 1 -- start start 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.042+0000 7f39d8c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d419d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.042+0000 7f39d8c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f39d410dd90 con 0x7f39d41097d0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.042+0000 7f39d1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d419d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.042+0000 7f39d1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d419d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59874/0 (socket says 172.21.15.40:59874) 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.042+0000 7f39d1e00640 1 -- 172.21.15.40:0/3007305669 learned_addr learned my addr 172.21.15.40:0/3007305669 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.042+0000 7f39d1e00640 1 -- 172.21.15.40:0/3007305669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d419dd70 con 0x7f39d41097d0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.043+0000 7f39d1e00640 1 --2- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d419d830 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f39c40097f0 tx=0x7f39c4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.043+0000 7f39caa00640 1 -- 172.21.15.40:0/3007305669 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c4037040 con 0x7f39d41097d0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.043+0000 7f39caa00640 1 -- 172.21.15.40:0/3007305669 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39c4040070 con 0x7f39d41097d0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.043+0000 7f39caa00640 1 -- 172.21.15.40:0/3007305669 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c403a390 con 0x7f39d41097d0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.043+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d419e000 con 0x7f39d41097d0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.043+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d41a0cf0 con 0x7f39d41097d0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.044+0000 7f39caa00640 1 -- 172.21.15.40:0/3007305669 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f39c403b430 con 0x7f39d41097d0 2024-09-11T22:20:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.044+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d4109bd0 con 0x7f39d41097d0 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.045+0000 7f39caa00640 1 --2- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f39b8038fc0 0x7f39b803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.045+0000 7f39caa00640 1 -- 172.21.15.40:0/3007305669 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f39c406c4f0 con 0x7f39d41097d0 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.045+0000 7f39d1400640 1 --2- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f39b8038fc0 0x7f39b803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.046+0000 7f39d1400640 1 --2- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f39b8038fc0 0x7f39b803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39c00098c0 tx=0x7f39c0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.050+0000 7f39caa00640 1 -- 172.21.15.40:0/3007305669 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39c406be40 con 0x7f39d41097d0 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.251+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f39d4107be0 con 0x7f39b8038fc0 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.259+0000 7f39caa00640 1 -- 172.21.15.40:0/3007305669 <== mgr.14118 v2:172.21.15.40:6800/2835470410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f39d4107be0 con 0x7f39b8038fc0 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.261+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f39b8038fc0 msgr2=0x7f39b803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.261+0000 7f39d8c00640 1 --2- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f39b8038fc0 0x7f39b803b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39c00098c0 tx=0x7f39c0006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.261+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 msgr2=0x7f39d419d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.261+0000 7f39d8c00640 1 --2- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d419d830 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f39c40097f0 tx=0x7f39c4030d80 comp rx=0 tx=0).stop 2024-09-11T22:20:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.261+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 shutdown_connections 2024-09-11T22:20:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.261+0000 7f39d8c00640 1 --2- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f39b8038fc0 0x7f39b803b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.261+0000 7f39d8c00640 1 --2- 172.21.15.40:0/3007305669 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39d41097d0 0x7f39d419d830 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.261+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 >> 172.21.15.40:0/3007305669 conn(0x7f39d407cde0 msgr2=0x7f39d41074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.261+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 shutdown_connections 2024-09-11T22:20:32.821 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:32.262+0000 7f39d8c00640 1 -- 172.21.15.40:0/3007305669 wait complete. 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: mgrmap e8: x(active, since 2s) 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:32] ENGINE Bus STARTING 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:32] ENGINE Serving on https://172.21.15.40:7150 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:32] ENGINE Error in HTTPServer.serve 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout: Traceback (most recent call last): 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._run(expiration_interval) 2024-09-11T22:20:32.953 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: s = self.context.wrap_socket( 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: return self.sslsocket_class._create( 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: self.do_handshake() 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._sslobj.do_handshake() 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:20:32.954 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:32.955 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:32.955 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:32.955 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:32] ENGINE Serving on http://172.21.15.40:8765 2024-09-11T22:20:32.955 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:32] ENGINE Bus STARTED 2024-09-11T22:20:32.955 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:32 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:34.070 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:33 smithi040 ceph-mon[30787]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:34.122 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.292+0000 7f51ae800640 1 Processor -- start 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.292+0000 7f51ae800640 1 -- start start 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.292+0000 7f51ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a8107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.292+0000 7f51ae800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8108000 con 0x7f51a8107630 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.293+0000 7f51a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a8107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.293+0000 7f51a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a8107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59882/0 (socket says 172.21.15.40:59882) 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.293+0000 7f51a7400640 1 -- 172.21.15.40:0/897968189 learned_addr learned my addr 172.21.15.40:0/897968189 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.293+0000 7f51a7400640 1 -- 172.21.15.40:0/897968189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a8108830 con 0x7f51a8107630 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.294+0000 7f51a7400640 1 --2- 172.21.15.40:0/897968189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a8107a30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5198009820 tx=0x7f519802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf30c045567e899b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.294+0000 7f51a6000640 1 -- 172.21.15.40:0/897968189 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5198037070 con 0x7f51a8107630 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.294+0000 7f51a6000640 1 -- 172.21.15.40:0/897968189 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5198032900 con 0x7f51a8107630 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.294+0000 7f51a6000640 1 -- 172.21.15.40:0/897968189 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5198030850 con 0x7f51a8107630 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.295+0000 7f51ae800640 1 -- 172.21.15.40:0/897968189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 msgr2=0x7f51a8107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.295+0000 7f51ae800640 1 --2- 172.21.15.40:0/897968189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a8107a30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5198009820 tx=0x7f519802a270 comp rx=0 tx=0).stop 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.295+0000 7f51ae800640 1 -- 172.21.15.40:0/897968189 shutdown_connections 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.295+0000 7f51ae800640 1 --2- 172.21.15.40:0/897968189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a8107a30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.295+0000 7f51ae800640 1 -- 172.21.15.40:0/897968189 >> 172.21.15.40:0/897968189 conn(0x7f51a8102d80 msgr2=0x7f51a8105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.295+0000 7f51ae800640 1 -- 172.21.15.40:0/897968189 shutdown_connections 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.295+0000 7f51ae800640 1 -- 172.21.15.40:0/897968189 wait complete. 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.296+0000 7f51ae800640 1 Processor -- start 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.296+0000 7f51ae800640 1 -- start start 2024-09-11T22:20:34.124 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.296+0000 7f51ae800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.296+0000 7f51ae800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f51a810bbe0 con 0x7f51a8107630 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.297+0000 7f51a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.297+0000 7f51a7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59898/0 (socket says 172.21.15.40:59898) 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.297+0000 7f51a7400640 1 -- 172.21.15.40:0/984786506 learned_addr learned my addr 172.21.15.40:0/984786506 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.297+0000 7f51a7400640 1 -- 172.21.15.40:0/984786506 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a819bb90 con 0x7f51a8107630 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.297+0000 7f51a7400640 1 --2- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a819b650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f51980097f0 tx=0x7f5198030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.298+0000 7f519fe00640 1 -- 172.21.15.40:0/984786506 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5198042070 con 0x7f51a8107630 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.298+0000 7f519fe00640 1 -- 172.21.15.40:0/984786506 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5198032ca0 con 0x7f51a8107630 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.298+0000 7f519fe00640 1 -- 172.21.15.40:0/984786506 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5198037040 con 0x7f51a8107630 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.298+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a819be20 con 0x7f51a8107630 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.298+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a819eb10 con 0x7f51a8107630 2024-09-11T22:20:34.125 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.299+0000 7f519fe00640 1 -- 172.21.15.40:0/984786506 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5198045070 con 0x7f51a8107630 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.299+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a8107ab0 con 0x7f51a8107630 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.299+0000 7f519fe00640 1 --2- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f518c038fc0 0x7f518c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.299+0000 7f519fe00640 1 -- 172.21.15.40:0/984786506 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f519806bf40 con 0x7f51a8107630 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.300+0000 7f51a6a00640 1 --2- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f518c038fc0 0x7f518c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.300+0000 7f51a6a00640 1 --2- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f518c038fc0 0x7f518c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f51940098c0 tx=0x7f5194006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.304+0000 7f519fe00640 1 -- 172.21.15.40:0/984786506 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f519804b170 con 0x7f51a8107630 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.490+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f51a8104100 con 0x7f518c038fc0 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.491+0000 7f519fe00640 1 -- 172.21.15.40:0/984786506 <== mgr.14118 v2:172.21.15.40:6800/2835470410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f51a8104100 con 0x7f518c038fc0 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f518c038fc0 msgr2=0x7f518c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 --2- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f518c038fc0 0x7f518c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f51940098c0 tx=0x7f5194006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 msgr2=0x7f51a819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:34.126 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 --2- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a819b650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f51980097f0 tx=0x7f5198030ec0 comp rx=0 tx=0).stop 2024-09-11T22:20:34.127 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 shutdown_connections 2024-09-11T22:20:34.127 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 --2- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f518c038fc0 0x7f518c03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:34.127 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 --2- 172.21.15.40:0/984786506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51a8107630 0x7f51a819b650 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:34.127 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 >> 172.21.15.40:0/984786506 conn(0x7f51a8102d80 msgr2=0x7f51a81039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:34.127 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 shutdown_connections 2024-09-11T22:20:34.127 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:33.493+0000 7f51ae800640 1 -- 172.21.15.40:0/984786506 wait complete. 2024-09-11T22:20:34.127 INFO:teuthology.orchestra.run.smithi040.stdout:Generating ssh key... 2024-09-11T22:20:35.471 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: Generating public/private rsa key pair. 2024-09-11T22:20:35.471 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: Your identification has been saved in /tmp/tmp6w9h9fly/key 2024-09-11T22:20:35.471 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: Your public key has been saved in /tmp/tmp6w9h9fly/key.pub 2024-09-11T22:20:35.471 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: The key fingerprint is: 2024-09-11T22:20:35.471 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: SHA256:ihF0tVA097fyjg5AyIT06KVLBhdkmA2r46YXsg8KTJI ceph-c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:35.471 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: The key's randomart image is: 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: +---[RSA 3072]----+ 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: | .B*.++= . | 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: | o+oB o + . | 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: | o + = o . . | 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: | o + + . . . | 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: |E. * S . . | 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: |*..o + . . o | 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: |o* .o . . . | 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: |*.. . o | 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: |oo. .o . | 2024-09-11T22:20:35.472 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:35 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: +----[SHA256]-----+ 2024-09-11T22:20:35.731 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.581+0000 7ff5b7000640 1 Processor -- start 2024-09-11T22:20:35.731 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.581+0000 7ff5b7000640 1 -- start start 2024-09-11T22:20:35.731 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.582+0000 7ff5b7000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b0107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.731 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.582+0000 7ff5b7000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0108000 con 0x7ff5b0107630 2024-09-11T22:20:35.731 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.582+0000 7ff5afe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b0107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.582+0000 7ff5afe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b0107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59910/0 (socket says 172.21.15.40:59910) 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.582+0000 7ff5afe00640 1 -- 172.21.15.40:0/2475614825 learned_addr learned my addr 172.21.15.40:0/2475614825 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.582+0000 7ff5afe00640 1 -- 172.21.15.40:0/2475614825 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b0108830 con 0x7ff5b0107630 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.583+0000 7ff5afe00640 1 --2- 172.21.15.40:0/2475614825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b0107a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009820 tx=0x7ff5a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ae64c6cbfe6339 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.584+0000 7ff5af400640 1 -- 172.21.15.40:0/2475614825 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a0037070 con 0x7ff5b0107630 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.584+0000 7ff5af400640 1 -- 172.21.15.40:0/2475614825 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5a0032900 con 0x7ff5b0107630 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.584+0000 7ff5af400640 1 -- 172.21.15.40:0/2475614825 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a0030850 con 0x7ff5b0107630 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.584+0000 7ff5b7000640 1 -- 172.21.15.40:0/2475614825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 msgr2=0x7ff5b0107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.584+0000 7ff5b7000640 1 --2- 172.21.15.40:0/2475614825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b0107a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009820 tx=0x7ff5a002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.584+0000 7ff5b7000640 1 -- 172.21.15.40:0/2475614825 shutdown_connections 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.584+0000 7ff5b7000640 1 --2- 172.21.15.40:0/2475614825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b0107a30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.732 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.584+0000 7ff5b7000640 1 -- 172.21.15.40:0/2475614825 >> 172.21.15.40:0/2475614825 conn(0x7ff5b0102d80 msgr2=0x7ff5b0105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.584+0000 7ff5b7000640 1 -- 172.21.15.40:0/2475614825 shutdown_connections 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.585+0000 7ff5b7000640 1 -- 172.21.15.40:0/2475614825 wait complete. 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.585+0000 7ff5b7000640 1 Processor -- start 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.586+0000 7ff5b7000640 1 -- start start 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.586+0000 7ff5b7000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.586+0000 7ff5b7000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b010bbe0 con 0x7ff5b0107630 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.586+0000 7ff5afe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.586+0000 7ff5afe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59926/0 (socket says 172.21.15.40:59926) 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.586+0000 7ff5afe00640 1 -- 172.21.15.40:0/4046263758 learned_addr learned my addr 172.21.15.40:0/4046263758 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.587+0000 7ff5afe00640 1 -- 172.21.15.40:0/4046263758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b019bb90 con 0x7ff5b0107630 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.587+0000 7ff5afe00640 1 --2- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b019b650 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00097f0 tx=0x7ff5a0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:35.733 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.587+0000 7ff5ad600640 1 -- 172.21.15.40:0/4046263758 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a0042070 con 0x7ff5b0107630 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.587+0000 7ff5ad600640 1 -- 172.21.15.40:0/4046263758 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5a0032ca0 con 0x7ff5b0107630 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.587+0000 7ff5ad600640 1 -- 172.21.15.40:0/4046263758 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a0037040 con 0x7ff5b0107630 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.587+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b019be20 con 0x7ff5b0107630 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.587+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b019eb10 con 0x7ff5b0107630 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.588+0000 7ff5ad600640 1 -- 172.21.15.40:0/4046263758 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff5a0045070 con 0x7ff5b0107630 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.588+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b0107ab0 con 0x7ff5b0107630 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.589+0000 7ff5ad600640 1 --2- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7ff594038f70 0x7ff59403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.589+0000 7ff5ad600640 1 -- 172.21.15.40:0/4046263758 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff5a006bf70 con 0x7ff5b0107630 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.589+0000 7ff5a7e00640 1 --2- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7ff594038f70 0x7ff59403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.590+0000 7ff5a7e00640 1 --2- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7ff594038f70 0x7ff59403b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff5980098c0 tx=0x7ff598006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.594+0000 7ff5ad600640 1 -- 172.21.15.40:0/4046263758 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5a004b170 con 0x7ff5b0107630 2024-09-11T22:20:35.734 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:34.782+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7ff5b0104100 con 0x7ff594038f70 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.152+0000 7ff5ad600640 1 -- 172.21.15.40:0/4046263758 <== mgr.14118 v2:172.21.15.40:6800/2835470410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff5b0104100 con 0x7ff594038f70 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.154+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7ff594038f70 msgr2=0x7ff59403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.154+0000 7ff5b7000640 1 --2- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7ff594038f70 0x7ff59403b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff5980098c0 tx=0x7ff598006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.154+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 msgr2=0x7ff5b019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.154+0000 7ff5b7000640 1 --2- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b019b650 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00097f0 tx=0x7ff5a0030ec0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.154+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 shutdown_connections 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.154+0000 7ff5b7000640 1 --2- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7ff594038f70 0x7ff59403b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.154+0000 7ff5b7000640 1 --2- 172.21.15.40:0/4046263758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5b0107630 0x7ff5b019b650 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.154+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 >> 172.21.15.40:0/4046263758 conn(0x7ff5b0102d80 msgr2=0x7ff5b01039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.155+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 shutdown_connections 2024-09-11T22:20:35.735 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:35.155+0000 7ff5b7000640 1 -- 172.21.15.40:0/4046263758 wait complete. 2024-09-11T22:20:36.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:36 smithi040 ceph-mon[30787]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:36.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:36 smithi040 ceph-mon[30787]: Generating ssh key... 2024-09-11T22:20:36.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:36 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:36.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:36 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMq4j1b2kiKTO0nJpuAGgo0ZdJbhWxVOgbqRLl36/bVaLvgSlgOrdoarWz08e892kRudbdDRsQFJnq2YiJs6r0qlZP5T4SVbndxphulZSJu7MkjG0i5tm5gi4nor+JShe8Iv3NLaEjzlWlVIkKBTOzqvFKZSdlAoF5xJ7K80BQoRn4FsqHh0nshpYOcE9QYHHrv5aDq8/CS6D59rCnBNyt6iqZRegdSIDSVPOsTrTTJt3gr8Ux+FQiGuDPIVn2t41Tjf0mgXmVGxn+hfp7vRbQoprnUN09rAxOll0yKj1i0BNOXc/DkXAZUhSQ9tWh1ACscQ9Glze5rYvtf6+jR8EOYK7jHfOGA/2jsW2gs/MXxRtCNI6ghBrFKdPBPI3NuCfhXdMW27F9oJMydd2d08pNOEJmXYgQw+XqmFSoEWyRhbHBLwwq2iTRFn3ndRAFNERalImrhdwf/OPnrDoAMmoQrW000ONDMsFYm/XVEGBIYsZMmu73Z47lTPEwxva4hqM= ceph-c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.196+0000 7f0d99a00640 1 Processor -- start 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.196+0000 7f0d99a00640 1 -- start start 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.197+0000 7f0d99a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d94107a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.197+0000 7f0d99a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94108030 con 0x7f0d94107660 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.197+0000 7f0d92a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d94107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.197+0000 7f0d92a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d94107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59930/0 (socket says 172.21.15.40:59930) 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.197+0000 7f0d92a00640 1 -- 172.21.15.40:0/2019403464 learned_addr learned my addr 172.21.15.40:0/2019403464 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.197+0000 7f0d92a00640 1 -- 172.21.15.40:0/2019403464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d941087c0 con 0x7f0d94107660 2024-09-11T22:20:37.003 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.198+0000 7f0d92a00640 1 --2- 172.21.15.40:0/2019403464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d94107a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009820 tx=0x7f0d8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4fa988beca345f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.199+0000 7f0d92000640 1 -- 172.21.15.40:0/2019403464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84037070 con 0x7f0d94107660 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.199+0000 7f0d92000640 1 -- 172.21.15.40:0/2019403464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d84032900 con 0x7f0d94107660 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.199+0000 7f0d92000640 1 -- 172.21.15.40:0/2019403464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84030850 con 0x7f0d94107660 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.199+0000 7f0d99a00640 1 -- 172.21.15.40:0/2019403464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 msgr2=0x7f0d94107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.199+0000 7f0d99a00640 1 --2- 172.21.15.40:0/2019403464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d94107a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009820 tx=0x7f0d8402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.199+0000 7f0d99a00640 1 -- 172.21.15.40:0/2019403464 shutdown_connections 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.199+0000 7f0d99a00640 1 --2- 172.21.15.40:0/2019403464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d94107a60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.199+0000 7f0d99a00640 1 -- 172.21.15.40:0/2019403464 >> 172.21.15.40:0/2019403464 conn(0x7f0d94102db0 msgr2=0x7f0d94105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.199+0000 7f0d99a00640 1 -- 172.21.15.40:0/2019403464 shutdown_connections 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.200+0000 7f0d99a00640 1 -- 172.21.15.40:0/2019403464 wait complete. 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.200+0000 7f0d99a00640 1 Processor -- start 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.201+0000 7f0d99a00640 1 -- start start 2024-09-11T22:20:37.004 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.201+0000 7f0d99a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d9407db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.201+0000 7f0d99a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9410bb70 con 0x7f0d94107660 2024-09-11T22:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.201+0000 7f0d92a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d9407db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.201+0000 7f0d92a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d9407db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59944/0 (socket says 172.21.15.40:59944) 2024-09-11T22:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.201+0000 7f0d92a00640 1 -- 172.21.15.40:0/1028669742 learned_addr learned my addr 172.21.15.40:0/1028669742 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.201+0000 7f0d92a00640 1 -- 172.21.15.40:0/1028669742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9407e050 con 0x7f0d94107660 2024-09-11T22:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.202+0000 7f0d92a00640 1 --2- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d9407db10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009940 tx=0x7f0d840326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.202+0000 7f0d8be00640 1 -- 172.21.15.40:0/1028669742 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84042070 con 0x7f0d94107660 2024-09-11T22:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.202+0000 7f0d8be00640 1 -- 172.21.15.40:0/1028669742 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d84032be0 con 0x7f0d94107660 2024-09-11T22:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.202+0000 7f0d8be00640 1 -- 172.21.15.40:0/1028669742 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d84037040 con 0x7f0d94107660 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.202+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9407c240 con 0x7f0d94107660 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.202+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9407c780 con 0x7f0d94107660 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.203+0000 7f0d8be00640 1 -- 172.21.15.40:0/1028669742 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0d84045070 con 0x7f0d94107660 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.203+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d94107ae0 con 0x7f0d94107660 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.204+0000 7f0d8be00640 1 --2- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f0d78038fc0 0x7f0d7803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.204+0000 7f0d8be00640 1 -- 172.21.15.40:0/1028669742 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0d8406be90 con 0x7f0d94107660 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.204+0000 7f0d8a000640 1 --2- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f0d78038fc0 0x7f0d7803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.205+0000 7f0d8a000640 1 --2- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f0d78038fc0 0x7f0d7803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0098c0 tx=0x7f0d7c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.210+0000 7f0d8be00640 1 -- 172.21.15.40:0/1028669742 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d8404b170 con 0x7f0d94107660 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.401+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f0d94104130 con 0x7f0d78038fc0 2024-09-11T22:20:37.006 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.402+0000 7f0d8be00640 1 -- 172.21.15.40:0/1028669742 <== mgr.14118 v2:172.21.15.40:6800/2835470410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f0d94104130 con 0x7f0d78038fc0 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f0d78038fc0 msgr2=0x7f0d7803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 --2- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f0d78038fc0 0x7f0d7803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0098c0 tx=0x7f0d7c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 msgr2=0x7f0d9407db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 --2- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d9407db10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009940 tx=0x7f0d840326e0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 shutdown_connections 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 --2- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f0d78038fc0 0x7f0d7803b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 --2- 172.21.15.40:0/1028669742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d94107660 0x7f0d9407db10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 >> 172.21.15.40:0/1028669742 conn(0x7f0d94102db0 msgr2=0x7f0d94103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 shutdown_connections 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:36.404+0000 7f0d99a00640 1 -- 172.21.15.40:0/1028669742 wait complete. 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:20:37.007 INFO:teuthology.orchestra.run.smithi040.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T22:20:37.010 INFO:teuthology.orchestra.run.smithi040.stdout:Adding host smithi040... 2024-09-11T22:20:37.258 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:37 smithi040 ceph-mon[30787]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:38.932 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:38 smithi040 ceph-mon[30787]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi040", "addr": "172.21.15.40", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:39.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:39 smithi040 ceph-mon[30787]: Deploying cephadm binary to smithi040 2024-09-11T22:20:42.903 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout Added host 'smithi040' with addr '172.21.15.40' 2024-09-11T22:20:42.903 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.530+0000 7f6757c00640 1 Processor -- start 2024-09-11T22:20:42.903 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.530+0000 7f6757c00640 1 -- start start 2024-09-11T22:20:42.903 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.531+0000 7f6757c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f6750107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.531+0000 7f6757c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6750108000 con 0x7f6750107630 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.531+0000 7f6755200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f6750107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.531+0000 7f6755200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f6750107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59956/0 (socket says 172.21.15.40:59956) 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.531+0000 7f6755200640 1 -- 172.21.15.40:0/4065453727 learned_addr learned my addr 172.21.15.40:0/4065453727 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.532+0000 7f6755200640 1 -- 172.21.15.40:0/4065453727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6750108830 con 0x7f6750107630 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.532+0000 7f6755200640 1 --2- 172.21.15.40:0/4065453727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f6750107a30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6744009820 tx=0x7f674402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e2a79f8d4d6a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.533+0000 7f674f400640 1 -- 172.21.15.40:0/4065453727 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6744037070 con 0x7f6750107630 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.533+0000 7f674f400640 1 -- 172.21.15.40:0/4065453727 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6744032900 con 0x7f6750107630 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.533+0000 7f674f400640 1 -- 172.21.15.40:0/4065453727 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6744030850 con 0x7f6750107630 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.533+0000 7f6757c00640 1 -- 172.21.15.40:0/4065453727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 msgr2=0x7f6750107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.533+0000 7f6757c00640 1 --2- 172.21.15.40:0/4065453727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f6750107a30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6744009820 tx=0x7f674402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:42.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.533+0000 7f6757c00640 1 -- 172.21.15.40:0/4065453727 shutdown_connections 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.533+0000 7f6757c00640 1 --2- 172.21.15.40:0/4065453727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f6750107a30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.533+0000 7f6757c00640 1 -- 172.21.15.40:0/4065453727 >> 172.21.15.40:0/4065453727 conn(0x7f6750102d80 msgr2=0x7f6750105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.534+0000 7f6757c00640 1 -- 172.21.15.40:0/4065453727 shutdown_connections 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.534+0000 7f6757c00640 1 -- 172.21.15.40:0/4065453727 wait complete. 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.534+0000 7f6757c00640 1 Processor -- start 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.535+0000 7f6757c00640 1 -- start start 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.535+0000 7f6757c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f675019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.535+0000 7f6757c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f675010bbe0 con 0x7f6750107630 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.535+0000 7f6755200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f675019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.535+0000 7f6755200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f675019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59962/0 (socket says 172.21.15.40:59962) 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.535+0000 7f6755200640 1 -- 172.21.15.40:0/4181526719 learned_addr learned my addr 172.21.15.40:0/4181526719 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.535+0000 7f6755200640 1 -- 172.21.15.40:0/4181526719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675019bb90 con 0x7f6750107630 2024-09-11T22:20:42.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.536+0000 7f6755200640 1 --2- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f675019b650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f67440097f0 tx=0x7f6744030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.536+0000 7f674d600640 1 -- 172.21.15.40:0/4181526719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6744042070 con 0x7f6750107630 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.536+0000 7f674d600640 1 -- 172.21.15.40:0/4181526719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6744032ca0 con 0x7f6750107630 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.536+0000 7f674d600640 1 -- 172.21.15.40:0/4181526719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6744037040 con 0x7f6750107630 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.536+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675019be20 con 0x7f6750107630 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.536+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f675019eb10 con 0x7f6750107630 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.537+0000 7f674d600640 1 -- 172.21.15.40:0/4181526719 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6744045070 con 0x7f6750107630 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.537+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6750107ab0 con 0x7f6750107630 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.538+0000 7f674d600640 1 --2- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f6738038fc0 0x7f673803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.538+0000 7f674d600640 1 -- 172.21.15.40:0/4181526719 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f674406bf40 con 0x7f6750107630 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.538+0000 7f674fe00640 1 --2- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f6738038fc0 0x7f673803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.539+0000 7f674fe00640 1 --2- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f6738038fc0 0x7f673803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f673c0098c0 tx=0x7f673c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.543+0000 7f674d600640 1 -- 172.21.15.40:0/4181526719 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f674404b170 con 0x7f6750107630 2024-09-11T22:20:42.906 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:37.732+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi040", "addr": "172.21.15.40", "target": ["mon-mgr", ""]}) -- 0x7f6750104100 con 0x7f6738038fc0 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.250+0000 7f674d600640 1 -- 172.21.15.40:0/4181526719 <== mgr.14118 v2:172.21.15.40:6800/2835470410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f6750104100 con 0x7f6738038fc0 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f6738038fc0 msgr2=0x7f673803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 --2- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f6738038fc0 0x7f673803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f673c0098c0 tx=0x7f673c006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 msgr2=0x7f675019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 --2- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f675019b650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f67440097f0 tx=0x7f6744030ec0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 shutdown_connections 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 --2- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f6738038fc0 0x7f673803b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 --2- 172.21.15.40:0/4181526719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6750107630 0x7f675019b650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 >> 172.21.15.40:0/4181526719 conn(0x7f6750102d80 msgr2=0x7f67501039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 shutdown_connections 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:42.253+0000 7f6757c00640 1 -- 172.21.15.40:0/4181526719 wait complete. 2024-09-11T22:20:42.907 INFO:teuthology.orchestra.run.smithi040.stdout:Deploying unmanaged mon service... 2024-09-11T22:20:43.468 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:43 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:43.468 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:43 smithi040 ceph-mon[30787]: Added host smithi040 2024-09-11T22:20:43.468 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:43 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:44.474 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T22:20:44.474 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.466+0000 7f4009200640 1 Processor -- start 2024-09-11T22:20:44.474 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.466+0000 7f4009200640 1 -- start start 2024-09-11T22:20:44.474 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.467+0000 7f4009200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f4004107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.474 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.467+0000 7f4009200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4004108000 con 0x7f4004107630 2024-09-11T22:20:44.474 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.467+0000 7f4001e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f4004107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.474 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.467+0000 7f4001e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f4004107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43562/0 (socket says 172.21.15.40:43562) 2024-09-11T22:20:44.474 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.467+0000 7f4001e00640 1 -- 172.21.15.40:0/4185476128 learned_addr learned my addr 172.21.15.40:0/4185476128 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.468+0000 7f4001e00640 1 -- 172.21.15.40:0/4185476128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4004108830 con 0x7f4004107630 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.469+0000 7f4001e00640 1 --2- 172.21.15.40:0/4185476128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f4004107a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009820 tx=0x7f3ff402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf189d43759a64ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.469+0000 7f4001400640 1 -- 172.21.15.40:0/4185476128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff4037070 con 0x7f4004107630 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.469+0000 7f4001400640 1 -- 172.21.15.40:0/4185476128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ff4032900 con 0x7f4004107630 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.469+0000 7f4001400640 1 -- 172.21.15.40:0/4185476128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff4030850 con 0x7f4004107630 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.469+0000 7f4009200640 1 -- 172.21.15.40:0/4185476128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 msgr2=0x7f4004107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.469+0000 7f4009200640 1 --2- 172.21.15.40:0/4185476128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f4004107a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009820 tx=0x7f3ff402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.470+0000 7f4009200640 1 -- 172.21.15.40:0/4185476128 shutdown_connections 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.470+0000 7f4009200640 1 --2- 172.21.15.40:0/4185476128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f4004107a30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.470+0000 7f4009200640 1 -- 172.21.15.40:0/4185476128 >> 172.21.15.40:0/4185476128 conn(0x7f4004102d80 msgr2=0x7f4004105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.470+0000 7f4009200640 1 -- 172.21.15.40:0/4185476128 shutdown_connections 2024-09-11T22:20:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.470+0000 7f4009200640 1 -- 172.21.15.40:0/4185476128 wait complete. 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.471+0000 7f4009200640 1 Processor -- start 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.471+0000 7f4009200640 1 -- start start 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.471+0000 7f4009200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f400407db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.471+0000 7f4009200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f400410bbe0 con 0x7f4004107630 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.471+0000 7f4001e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f400407db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.471+0000 7f4001e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f400407db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43570/0 (socket says 172.21.15.40:43570) 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.471+0000 7f4001e00640 1 -- 172.21.15.40:0/1987284781 learned_addr learned my addr 172.21.15.40:0/1987284781 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.472+0000 7f4001e00640 1 -- 172.21.15.40:0/1987284781 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400407e050 con 0x7f4004107630 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.472+0000 7f4001e00640 1 --2- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f400407db10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009940 tx=0x7f3ff40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.472+0000 7f3ffb400640 1 -- 172.21.15.40:0/1987284781 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff4042070 con 0x7f4004107630 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.472+0000 7f3ffb400640 1 -- 172.21.15.40:0/1987284781 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ff4032be0 con 0x7f4004107630 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.472+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400407c240 con 0x7f4004107630 2024-09-11T22:20:44.476 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.472+0000 7f3ffb400640 1 -- 172.21.15.40:0/1987284781 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ff4037040 con 0x7f4004107630 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.472+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f400407c780 con 0x7f4004107630 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.473+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4004107ab0 con 0x7f4004107630 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.473+0000 7f3ffb400640 1 -- 172.21.15.40:0/1987284781 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3ff4045070 con 0x7f4004107630 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.474+0000 7f3ffb400640 1 --2- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f3fe8038fc0 0x7f3fe803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.474+0000 7f3ffb400640 1 -- 172.21.15.40:0/1987284781 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3ff406bfa0 con 0x7f4004107630 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.474+0000 7f3ff9400640 1 --2- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f3fe8038fc0 0x7f3fe803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.475+0000 7f3ff9400640 1 --2- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f3fe8038fc0 0x7f3fe803b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0098c0 tx=0x7f3fec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.479+0000 7f3ffb400640 1 -- 172.21.15.40:0/1987284781 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ff404b170 con 0x7f4004107630 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.704+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f400407d030 con 0x7f3fe8038fc0 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.710+0000 7f3ffb400640 1 -- 172.21.15.40:0/1987284781 <== mgr.14118 v2:172.21.15.40:6800/2835470410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f400407d030 con 0x7f3fe8038fc0 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f3fe8038fc0 msgr2=0x7f3fe803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 --2- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f3fe8038fc0 0x7f3fe803b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0098c0 tx=0x7f3fec006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.477 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 msgr2=0x7f400407db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.478 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 --2- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f400407db10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009940 tx=0x7f3ff40326e0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.478 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 shutdown_connections 2024-09-11T22:20:44.478 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 --2- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f3fe8038fc0 0x7f3fe803b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.478 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 --2- 172.21.15.40:0/1987284781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4004107630 0x7f400407db10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.478 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 >> 172.21.15.40:0/1987284781 conn(0x7f4004102d80 msgr2=0x7f40041039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.478 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 shutdown_connections 2024-09-11T22:20:44.478 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:43.712+0000 7f4009200640 1 -- 172.21.15.40:0/1987284781 wait complete. 2024-09-11T22:20:44.478 INFO:teuthology.orchestra.run.smithi040.stdout:Deploying unmanaged mgr service... 2024-09-11T22:20:44.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:44 smithi040 ceph-mon[30787]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:44.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:44 smithi040 ceph-mon[30787]: Saving service mon spec with placement count:5 2024-09-11T22:20:44.885 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:44 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:46.408 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T22:20:46.408 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.327+0000 7f1e44a00640 1 Processor -- start 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.328+0000 7f1e44a00640 1 -- start start 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.328+0000 7f1e44a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4007c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.328+0000 7f1e44a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4007c7a0 con 0x7f1e4007de00 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.328+0000 7f1e3e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4007c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.328+0000 7f1e3e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4007c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43574/0 (socket says 172.21.15.40:43574) 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.328+0000 7f1e3e800640 1 -- 172.21.15.40:0/2767457468 learned_addr learned my addr 172.21.15.40:0/2767457468 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.329+0000 7f1e3e800640 1 -- 172.21.15.40:0/2767457468 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4007c920 con 0x7f1e4007de00 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.330+0000 7f1e3e800640 1 --2- 172.21.15.40:0/2767457468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4007c260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009820 tx=0x7f1e3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8eb4f85ddba6033 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.330+0000 7f1e3de00640 1 -- 172.21.15.40:0/2767457468 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e30037070 con 0x7f1e4007de00 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.330+0000 7f1e3de00640 1 -- 172.21.15.40:0/2767457468 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e30032900 con 0x7f1e4007de00 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.330+0000 7f1e3de00640 1 -- 172.21.15.40:0/2767457468 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e30030850 con 0x7f1e4007de00 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.331+0000 7f1e44a00640 1 -- 172.21.15.40:0/2767457468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 msgr2=0x7f1e4007c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.331+0000 7f1e44a00640 1 --2- 172.21.15.40:0/2767457468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4007c260 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009820 tx=0x7f1e3002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.331+0000 7f1e44a00640 1 -- 172.21.15.40:0/2767457468 shutdown_connections 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.331+0000 7f1e44a00640 1 --2- 172.21.15.40:0/2767457468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4007c260 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.331+0000 7f1e44a00640 1 -- 172.21.15.40:0/2767457468 >> 172.21.15.40:0/2767457468 conn(0x7f1e40102be0 msgr2=0x7f1e40105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.331+0000 7f1e44a00640 1 -- 172.21.15.40:0/2767457468 shutdown_connections 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.331+0000 7f1e44a00640 1 -- 172.21.15.40:0/2767457468 wait complete. 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.332+0000 7f1e44a00640 1 Processor -- start 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.332+0000 7f1e44a00640 1 -- start start 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.332+0000 7f1e44a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4019d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.332+0000 7f1e44a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4010da40 con 0x7f1e4007de00 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.333+0000 7f1e3e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4019d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.333+0000 7f1e3e800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4019d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43584/0 (socket says 172.21.15.40:43584) 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.333+0000 7f1e3e800640 1 -- 172.21.15.40:0/3130026809 learned_addr learned my addr 172.21.15.40:0/3130026809 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.333+0000 7f1e3e800640 1 -- 172.21.15.40:0/3130026809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4019db20 con 0x7f1e4007de00 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.333+0000 7f1e3e800640 1 --2- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4019d5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e30032ce0 tx=0x7f1e30032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.333+0000 7f1e37400640 1 -- 172.21.15.40:0/3130026809 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e30042070 con 0x7f1e4007de00 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.333+0000 7f1e37400640 1 -- 172.21.15.40:0/3130026809 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e300308c0 con 0x7f1e4007de00 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.333+0000 7f1e37400640 1 -- 172.21.15.40:0/3130026809 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e30037040 con 0x7f1e4007de00 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.333+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4019ddb0 con 0x7f1e4007de00 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.334+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e401a0aa0 con 0x7f1e4007de00 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.335+0000 7f1e37400640 1 -- 172.21.15.40:0/3130026809 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1e30045070 con 0x7f1e4007de00 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.335+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4007c2e0 con 0x7f1e4007de00 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.335+0000 7f1e37400640 1 --2- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f1e24038f70 0x7f1e2403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.335+0000 7f1e37400640 1 -- 172.21.15.40:0/3130026809 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1e3006c100 con 0x7f1e4007de00 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.335+0000 7f1e37e00640 1 --2- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f1e24038f70 0x7f1e2403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.336+0000 7f1e37e00640 1 --2- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f1e24038f70 0x7f1e2403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1e280098c0 tx=0x7f1e28006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.340+0000 7f1e37400640 1 -- 172.21.15.40:0/3130026809 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e3004b170 con 0x7f1e4007de00 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.558+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1e40103e80 con 0x7f1e24038f70 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.563+0000 7f1e37400640 1 -- 172.21.15.40:0/3130026809 <== mgr.14118 v2:172.21.15.40:6800/2835470410 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1e40103e80 con 0x7f1e24038f70 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f1e24038f70 msgr2=0x7f1e2403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 --2- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f1e24038f70 0x7f1e2403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1e280098c0 tx=0x7f1e28006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 msgr2=0x7f1e4019d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 --2- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4019d5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e30032ce0 tx=0x7f1e30032d10 comp rx=0 tx=0).stop 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 shutdown_connections 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 --2- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f1e24038f70 0x7f1e2403b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 --2- 172.21.15.40:0/3130026809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e4007de00 0x7f1e4019d5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 >> 172.21.15.40:0/3130026809 conn(0x7f1e40102be0 msgr2=0x7f1e40103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.413 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 shutdown_connections 2024-09-11T22:20:46.413 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:45.565+0000 7f1e44a00640 1 -- 172.21.15.40:0/3130026809 wait complete. 2024-09-11T22:20:46.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:46 smithi040 ceph-mon[30787]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:20:46.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:46 smithi040 ceph-mon[30787]: Saving service mgr spec with placement count:2 2024-09-11T22:20:46.669 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:46 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:46.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:46 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:47.792 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.938+0000 7f478d800640 1 Processor -- start 2024-09-11T22:20:47.792 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.938+0000 7f478d800640 1 -- start start 2024-09-11T22:20:47.792 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.939+0000 7f478d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f4788109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.792 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.939+0000 7f478d800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f478810a1a0 con 0x7f47881097d0 2024-09-11T22:20:47.792 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.939+0000 7f4786a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f4788109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.792 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.939+0000 7f4786a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f4788109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43586/0 (socket says 172.21.15.40:43586) 2024-09-11T22:20:47.792 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.939+0000 7f4786a00640 1 -- 172.21.15.40:0/3680770449 learned_addr learned my addr 172.21.15.40:0/3680770449 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:47.792 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.940+0000 7f4786a00640 1 -- 172.21.15.40:0/3680770449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478810a9e0 con 0x7f47881097d0 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.941+0000 7f4786a00640 1 --2- 172.21.15.40:0/3680770449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f4788109bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4778009820 tx=0x7f477802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a6d82680d99d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.941+0000 7f4785600640 1 -- 172.21.15.40:0/3680770449 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4778037070 con 0x7f47881097d0 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.941+0000 7f4785600640 1 -- 172.21.15.40:0/3680770449 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4778032920 con 0x7f47881097d0 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.941+0000 7f4785600640 1 -- 172.21.15.40:0/3680770449 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4778030810 con 0x7f47881097d0 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.942+0000 7f478d800640 1 -- 172.21.15.40:0/3680770449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 msgr2=0x7f4788109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.942+0000 7f478d800640 1 --2- 172.21.15.40:0/3680770449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f4788109bd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4778009820 tx=0x7f477802a270 comp rx=0 tx=0).stop 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.942+0000 7f478d800640 1 -- 172.21.15.40:0/3680770449 shutdown_connections 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.942+0000 7f478d800640 1 --2- 172.21.15.40:0/3680770449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f4788109bd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.942+0000 7f478d800640 1 -- 172.21.15.40:0/3680770449 >> 172.21.15.40:0/3680770449 conn(0x7f478807cde0 msgr2=0x7f478807d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.942+0000 7f478d800640 1 -- 172.21.15.40:0/3680770449 shutdown_connections 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.942+0000 7f478d800640 1 -- 172.21.15.40:0/3680770449 wait complete. 2024-09-11T22:20:47.793 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.943+0000 7f478d800640 1 Processor -- start 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.943+0000 7f478d800640 1 -- start start 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.944+0000 7f478d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f478819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.944+0000 7f478d800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f478810dd90 con 0x7f47881097d0 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.944+0000 7f4786a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f478819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.944+0000 7f4786a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f478819d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43596/0 (socket says 172.21.15.40:43596) 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.944+0000 7f4786a00640 1 -- 172.21.15.40:0/1440040565 learned_addr learned my addr 172.21.15.40:0/1440040565 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.944+0000 7f4786a00640 1 -- 172.21.15.40:0/1440040565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478819dd50 con 0x7f47881097d0 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.945+0000 7f4786a00640 1 --2- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f478819d810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f47780097f0 tx=0x7f47780327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.945+0000 7f477f400640 1 -- 172.21.15.40:0/1440040565 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4778037040 con 0x7f47881097d0 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.945+0000 7f477f400640 1 -- 172.21.15.40:0/1440040565 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4778030cc0 con 0x7f47881097d0 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.945+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478819dfe0 con 0x7f47881097d0 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.945+0000 7f477f400640 1 -- 172.21.15.40:0/1440040565 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477803a640 con 0x7f47881097d0 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.945+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47881a0cd0 con 0x7f47881097d0 2024-09-11T22:20:47.794 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.946+0000 7f477f400640 1 -- 172.21.15.40:0/1440040565 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f477803b3f0 con 0x7f47881097d0 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.946+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4788109bd0 con 0x7f47881097d0 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.947+0000 7f477f400640 1 --2- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f476c038fc0 0x7f476c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.947+0000 7f477f400640 1 -- 172.21.15.40:0/1440040565 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f477806c570 con 0x7f47881097d0 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.947+0000 7f4786000640 1 --2- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f476c038fc0 0x7f476c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.948+0000 7f4786000640 1 --2- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f476c038fc0 0x7f476c03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47740098c0 tx=0x7f4774006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:46.952+0000 7f477f400640 1 -- 172.21.15.40:0/1440040565 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4778042e10 con 0x7f47881097d0 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.150+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f47881a12c0 con 0x7f47881097d0 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.153+0000 7f477f400640 1 -- 172.21.15.40:0/1440040565 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f47780328c0 con 0x7f47881097d0 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.155+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f476c038fc0 msgr2=0x7f476c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.155+0000 7f478d800640 1 --2- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f476c038fc0 0x7f476c03b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47740098c0 tx=0x7f4774006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.155+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 msgr2=0x7f478819d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.155+0000 7f478d800640 1 --2- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f478819d810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f47780097f0 tx=0x7f47780327b0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.796 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.156+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 shutdown_connections 2024-09-11T22:20:47.796 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.156+0000 7f478d800640 1 --2- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f476c038fc0 0x7f476c03b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.796 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.156+0000 7f478d800640 1 --2- 172.21.15.40:0/1440040565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47881097d0 0x7f478819d810 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.796 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.156+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 >> 172.21.15.40:0/1440040565 conn(0x7f478807cde0 msgr2=0x7f4788107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.796 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.156+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 shutdown_connections 2024-09-11T22:20:47.796 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:47.156+0000 7f478d800640 1 -- 172.21.15.40:0/1440040565 wait complete. 2024-09-11T22:20:48.032 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:47 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:48.032 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:47 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1440040565' entity='client.admin' 2024-09-11T22:20:49.589 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:49 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1242534001' entity='client.admin' 2024-09-11T22:20:49.590 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:49 smithi040 ceph-mon[30787]: from='mgr.14118 172.21.15.40:0/763343030' entity='mgr.x' 2024-09-11T22:20:49.600 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.261+0000 7fbea3400640 1 Processor -- start 2024-09-11T22:20:49.600 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.261+0000 7fbea3400640 1 -- start start 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.261+0000 7fbea3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.261+0000 7fbea3400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c108000 con 0x7fbe9c107630 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.261+0000 7fbea0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.261+0000 7fbea0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43600/0 (socket says 172.21.15.40:43600) 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.261+0000 7fbea0a00640 1 -- 172.21.15.40:0/2250937622 learned_addr learned my addr 172.21.15.40:0/2250937622 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.261+0000 7fbea0a00640 1 -- 172.21.15.40:0/2250937622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c108830 con 0x7fbe9c107630 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.262+0000 7fbea0a00640 1 --2- 172.21.15.40:0/2250937622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c107a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009820 tx=0x7fbe9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2f14e829533a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.262+0000 7fbe9b400640 1 -- 172.21.15.40:0/2250937622 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90037070 con 0x7fbe9c107630 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.262+0000 7fbe9b400640 1 -- 172.21.15.40:0/2250937622 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe90032920 con 0x7fbe9c107630 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.262+0000 7fbe9b400640 1 -- 172.21.15.40:0/2250937622 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90030810 con 0x7fbe9c107630 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.263+0000 7fbea3400640 1 -- 172.21.15.40:0/2250937622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 msgr2=0x7fbe9c107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.601 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.263+0000 7fbea3400640 1 --2- 172.21.15.40:0/2250937622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c107a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009820 tx=0x7fbe9002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.263+0000 7fbea3400640 1 -- 172.21.15.40:0/2250937622 shutdown_connections 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.263+0000 7fbea3400640 1 --2- 172.21.15.40:0/2250937622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c107a30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.263+0000 7fbea3400640 1 -- 172.21.15.40:0/2250937622 >> 172.21.15.40:0/2250937622 conn(0x7fbe9c102d80 msgr2=0x7fbe9c105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.263+0000 7fbea3400640 1 -- 172.21.15.40:0/2250937622 shutdown_connections 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.263+0000 7fbea3400640 1 -- 172.21.15.40:0/2250937622 wait complete. 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.264+0000 7fbea3400640 1 Processor -- start 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.264+0000 7fbea3400640 1 -- start start 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.265+0000 7fbea3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c19d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.265+0000 7fbea3400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c10bbe0 con 0x7fbe9c107630 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.265+0000 7fbea0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c19d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.265+0000 7fbea0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c19d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43606/0 (socket says 172.21.15.40:43606) 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.265+0000 7fbea0a00640 1 -- 172.21.15.40:0/1242534001 learned_addr learned my addr 172.21.15.40:0/1242534001 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.265+0000 7fbea0a00640 1 -- 172.21.15.40:0/1242534001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c19ddd0 con 0x7fbe9c107630 2024-09-11T22:20:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.266+0000 7fbea0a00640 1 --2- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c19d890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe900097f0 tx=0x7fbe900327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.266+0000 7fbe99600640 1 -- 172.21.15.40:0/1242534001 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90037040 con 0x7fbe9c107630 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.266+0000 7fbe99600640 1 -- 172.21.15.40:0/1242534001 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe90030c40 con 0x7fbe9c107630 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.266+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c19e060 con 0x7fbe9c107630 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.267+0000 7fbe99600640 1 -- 172.21.15.40:0/1242534001 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe9003a5b0 con 0x7fbe9c107630 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.267+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c1a0d50 con 0x7fbe9c107630 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.268+0000 7fbe99600640 1 -- 172.21.15.40:0/1242534001 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbe9003a7a0 con 0x7fbe9c107630 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.268+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9c107ab0 con 0x7fbe9c107630 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.268+0000 7fbe99600640 1 --2- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fbe84038fc0 0x7fbe8403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.268+0000 7fbe99600640 1 -- 172.21.15.40:0/1242534001 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbe9006c450 con 0x7fbe9c107630 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.269+0000 7fbe9be00640 1 --2- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fbe84038fc0 0x7fbe8403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.270+0000 7fbe9be00640 1 --2- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fbe84038fc0 0x7fbe8403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098c0 tx=0x7fbe88006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.603 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.274+0000 7fbe99600640 1 -- 172.21.15.40:0/1242534001 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe900371e0 con 0x7fbe9c107630 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.465+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fbe9c1a0f20 con 0x7fbe9c107630 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.469+0000 7fbe99600640 1 -- 172.21.15.40:0/1242534001 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fbe9006bda0 con 0x7fbe9c107630 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fbe84038fc0 msgr2=0x7fbe8403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 --2- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fbe84038fc0 0x7fbe8403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098c0 tx=0x7fbe88006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 msgr2=0x7fbe9c19d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 --2- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c19d890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe900097f0 tx=0x7fbe900327b0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 shutdown_connections 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 --2- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fbe84038fc0 0x7fbe8403b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 --2- 172.21.15.40:0/1242534001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe9c107630 0x7fbe9c19d890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 >> 172.21.15.40:0/1242534001 conn(0x7fbe9c102d80 msgr2=0x7fbe9c1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 shutdown_connections 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:48.471+0000 7fbea3400640 1 -- 172.21.15.40:0/1242534001 wait complete. 2024-09-11T22:20:49.604 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling the dashboard module... 2024-09-11T22:20:50.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:50 smithi040 ceph-mon[30787]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:20:50.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:50 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/730922684' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-11T22:20:50.984 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:50 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: ignoring --setuser ceph since I am not root 2024-09-11T22:20:50.985 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:50 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: ignoring --setgroup ceph since I am not root 2024-09-11T22:20:51.253 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:50 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:50.985+0000 7f0e9022f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:20:51.253 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:51 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:51.060+0000 7f0e9022f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:20:51.253 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:51 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:51.252+0000 7f0e9022f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:20:51.390 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.156+0000 7f01e2400640 1 Processor -- start 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.157+0000 7f01e2400640 1 -- start start 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.157+0000 7f01e2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.157+0000 7f01e2400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc10a1a0 con 0x7f01dc1097d0 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.157+0000 7f01db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.157+0000 7f01db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43618/0 (socket says 172.21.15.40:43618) 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.157+0000 7f01db400640 1 -- 172.21.15.40:0/2220188013 learned_addr learned my addr 172.21.15.40:0/2220188013 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.158+0000 7f01db400640 1 -- 172.21.15.40:0/2220188013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc10a9e0 con 0x7f01dc1097d0 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.159+0000 7f01db400640 1 --2- 172.21.15.40:0/2220188013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc109bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009820 tx=0x7f01cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381ca011de30380f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.160+0000 7f01daa00640 1 -- 172.21.15.40:0/2220188013 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01cc037070 con 0x7f01dc1097d0 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.160+0000 7f01daa00640 1 -- 172.21.15.40:0/2220188013 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01cc032920 con 0x7f01dc1097d0 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.160+0000 7f01daa00640 1 -- 172.21.15.40:0/2220188013 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01cc030810 con 0x7f01dc1097d0 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.160+0000 7f01e2400640 1 -- 172.21.15.40:0/2220188013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 msgr2=0x7f01dc109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.160+0000 7f01e2400640 1 --2- 172.21.15.40:0/2220188013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc109bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009820 tx=0x7f01cc02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.160+0000 7f01e2400640 1 -- 172.21.15.40:0/2220188013 shutdown_connections 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.160+0000 7f01e2400640 1 --2- 172.21.15.40:0/2220188013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc109bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.160+0000 7f01e2400640 1 -- 172.21.15.40:0/2220188013 >> 172.21.15.40:0/2220188013 conn(0x7f01dc07cde0 msgr2=0x7f01dc07d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.160+0000 7f01e2400640 1 -- 172.21.15.40:0/2220188013 shutdown_connections 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.161+0000 7f01e2400640 1 -- 172.21.15.40:0/2220188013 wait complete. 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.161+0000 7f01e2400640 1 Processor -- start 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.162+0000 7f01e2400640 1 -- start start 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.162+0000 7f01e2400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc19d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.162+0000 7f01e2400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc10dd90 con 0x7f01dc1097d0 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.162+0000 7f01db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc19d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.162+0000 7f01db400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc19d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43634/0 (socket says 172.21.15.40:43634) 2024-09-11T22:20:51.392 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.162+0000 7f01db400640 1 -- 172.21.15.40:0/730922684 learned_addr learned my addr 172.21.15.40:0/730922684 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.163+0000 7f01db400640 1 -- 172.21.15.40:0/730922684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc19dd50 con 0x7f01dc1097d0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.163+0000 7f01db400640 1 --2- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc19d810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f01cc030560 tx=0x7f01cc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.163+0000 7f01d8c00640 1 -- 172.21.15.40:0/730922684 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01cc037040 con 0x7f01dc1097d0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.163+0000 7f01d8c00640 1 -- 172.21.15.40:0/730922684 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01cc040070 con 0x7f01dc1097d0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.163+0000 7f01d8c00640 1 -- 172.21.15.40:0/730922684 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01cc03a740 con 0x7f01dc1097d0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.163+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01dc19dfe0 con 0x7f01dc1097d0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.163+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01dc1a0cd0 con 0x7f01dc1097d0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.164+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01dc109bd0 con 0x7f01dc1097d0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.165+0000 7f01d8c00640 1 -- 172.21.15.40:0/730922684 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f01cc03bb90 con 0x7f01dc1097d0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.165+0000 7f01d8c00640 1 --2- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f01c0038f70 0x7f01c003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.165+0000 7f01d8c00640 1 -- 172.21.15.40:0/730922684 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f01cc06c650 con 0x7f01dc1097d0 2024-09-11T22:20:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.165+0000 7f01d3e00640 1 --2- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f01c0038f70 0x7f01c003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.166+0000 7f01d3e00640 1 --2- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f01c0038f70 0x7f01c003b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f01c40098c0 tx=0x7f01c4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.170+0000 7f01d8c00640 1 -- 172.21.15.40:0/730922684 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01cc04a200 con 0x7f01dc1097d0 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.424+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f01dc1a0ea0 con 0x7f01dc1097d0 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.724+0000 7f01d8c00640 1 -- 172.21.15.40:0/730922684 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f01cc031e80 con 0x7f01dc1097d0 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.726+0000 7f01d8c00640 1 -- 172.21.15.40:0/730922684 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f01cc03b420 con 0x7f01dc1097d0 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.728+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f01c0038f70 msgr2=0x7f01c003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.728+0000 7f01e2400640 1 --2- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f01c0038f70 0x7f01c003b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f01c40098c0 tx=0x7f01c4006db0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.728+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 msgr2=0x7f01dc19d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.728+0000 7f01e2400640 1 --2- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc19d810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f01cc030560 tx=0x7f01cc032670 comp rx=0 tx=0).stop 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.728+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 shutdown_connections 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.728+0000 7f01e2400640 1 --2- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f01c0038f70 0x7f01c003b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.728+0000 7f01e2400640 1 --2- 172.21.15.40:0/730922684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01dc1097d0 0x7f01dc19d810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.728+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 >> 172.21.15.40:0/730922684 conn(0x7f01dc07cde0 msgr2=0x7f01dc1074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.395 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.729+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 shutdown_connections 2024-09-11T22:20:51.395 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:50.729+0000 7f01e2400640 1 -- 172.21.15.40:0/730922684 wait complete. 2024-09-11T22:20:51.522 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:51 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:51.336+0000 7f0e9022f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:20:51.522 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:51 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:51.521+0000 7f0e9022f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:20:51.862 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:51 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/730922684' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T22:20:51.862 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:51 smithi040 ceph-mon[30787]: mgrmap e9: x(active, since 21s) 2024-09-11T22:20:51.862 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:51 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:51.702+0000 7f0e9022f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:20:52.167 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:52 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:52.092+0000 7f0e9022f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:20:52.167 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:52 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:52.166+0000 7f0e9022f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:20:52.484 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:52 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:52.390+0000 7f0e9022f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:20:52.879 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:52 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3096301277' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.971+0000 7fd5e6600640 1 Processor -- start 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.972+0000 7fd5e6600640 1 -- start start 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.972+0000 7fd5e6600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e007c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.972+0000 7fd5e6600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e007c7a0 con 0x7fd5e007de00 2024-09-11T22:20:52.890 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.973+0000 7fd5e5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e007c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.973+0000 7fd5e5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e007c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50784/0 (socket says 172.21.15.40:50784) 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.973+0000 7fd5e5200640 1 -- 172.21.15.40:0/980340294 learned_addr learned my addr 172.21.15.40:0/980340294 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.973+0000 7fd5e5200640 1 -- 172.21.15.40:0/980340294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e007c920 con 0x7fd5e007de00 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.974+0000 7fd5e5200640 1 --2- 172.21.15.40:0/980340294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e007c260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009820 tx=0x7fd5d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99a64a08822f9a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.974+0000 7fd5df400640 1 -- 172.21.15.40:0/980340294 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d4037070 con 0x7fd5e007de00 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.974+0000 7fd5df400640 1 -- 172.21.15.40:0/980340294 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5d4032920 con 0x7fd5e007de00 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.974+0000 7fd5df400640 1 -- 172.21.15.40:0/980340294 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d4030810 con 0x7fd5e007de00 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.975+0000 7fd5e6600640 1 -- 172.21.15.40:0/980340294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 msgr2=0x7fd5e007c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.975+0000 7fd5e6600640 1 --2- 172.21.15.40:0/980340294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e007c260 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009820 tx=0x7fd5d402a270 comp rx=0 tx=0).stop 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.975+0000 7fd5e6600640 1 -- 172.21.15.40:0/980340294 shutdown_connections 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.975+0000 7fd5e6600640 1 --2- 172.21.15.40:0/980340294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e007c260 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.975+0000 7fd5e6600640 1 -- 172.21.15.40:0/980340294 >> 172.21.15.40:0/980340294 conn(0x7fd5e0102c10 msgr2=0x7fd5e0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.891 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.975+0000 7fd5e6600640 1 -- 172.21.15.40:0/980340294 shutdown_connections 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.975+0000 7fd5e6600640 1 -- 172.21.15.40:0/980340294 wait complete. 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.976+0000 7fd5e6600640 1 Processor -- start 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.976+0000 7fd5e6600640 1 -- start start 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.977+0000 7fd5e6600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e019d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.977+0000 7fd5e6600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e010da50 con 0x7fd5e007de00 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.977+0000 7fd5e5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e019d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.977+0000 7fd5e5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e019d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50792/0 (socket says 172.21.15.40:50792) 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.977+0000 7fd5e5200640 1 -- 172.21.15.40:0/3096301277 learned_addr learned my addr 172.21.15.40:0/3096301277 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.977+0000 7fd5e5200640 1 -- 172.21.15.40:0/3096301277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e019db20 con 0x7fd5e007de00 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.978+0000 7fd5e5200640 1 --2- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e019d5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40097f0 tx=0x7fd5d40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.978+0000 7fd5dd600640 1 -- 172.21.15.40:0/3096301277 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d4037040 con 0x7fd5e007de00 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.978+0000 7fd5dd600640 1 -- 172.21.15.40:0/3096301277 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5d4030cc0 con 0x7fd5e007de00 2024-09-11T22:20:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.978+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e019ddb0 con 0x7fd5e007de00 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.978+0000 7fd5dd600640 1 -- 172.21.15.40:0/3096301277 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5d403a6b0 con 0x7fd5e007de00 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.978+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e01a0aa0 con 0x7fd5e007de00 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.979+0000 7fd5dd600640 1 -- 172.21.15.40:0/3096301277 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fd5d403a850 con 0x7fd5e007de00 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.979+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e007c2e0 con 0x7fd5e007de00 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.980+0000 7fd5dd600640 1 --2- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5c8039020 0x7fd5c803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.980+0000 7fd5dd600640 1 -- 172.21.15.40:0/3096301277 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd5d406c5d0 con 0x7fd5e007de00 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.980+0000 7fd5dfe00640 1 -- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5c8039020 msgr2=0x7fd5c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2835470410 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.980+0000 7fd5dfe00640 1 --2- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5c8039020 0x7fd5c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:51.985+0000 7fd5dd600640 1 -- 172.21.15.40:0/3096301277 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5d406bf20 con 0x7fd5e007de00 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.181+0000 7fd5dfe00640 1 -- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5c8039020 msgr2=0x7fd5c803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2835470410 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.181+0000 7fd5dfe00640 1 --2- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5c8039020 0x7fd5c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:20:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.217+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd5e01a1090 con 0x7fd5e007de00 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.218+0000 7fd5dd600640 1 -- 172.21.15.40:0/3096301277 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fd5d4044920 con 0x7fd5e007de00 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5c8039020 msgr2=0x7fd5c803b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 --2- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5c8039020 0x7fd5c803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 msgr2=0x7fd5e019d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 --2- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e019d5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40097f0 tx=0x7fd5d40327b0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 shutdown_connections 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 --2- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7fd5c8039020 0x7fd5c803b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 --2- 172.21.15.40:0/3096301277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5e007de00 0x7fd5e019d5e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 >> 172.21.15.40:0/3096301277 conn(0x7fd5e0102c10 msgr2=0x7fd5e0103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 shutdown_connections 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:52.220+0000 7fd5e6600640 1 -- 172.21.15.40:0/3096301277 wait complete. 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for the mgr to restart... 2024-09-11T22:20:52.894 INFO:teuthology.orchestra.run.smithi040.stdout:Waiting for mgr epoch 9... 2024-09-11T22:20:53.984 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:53 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:53.556+0000 7f0e9022f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:20:53.984 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:53 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:53.639+0000 7f0e9022f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:20:54.907 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:54 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:54.594+0000 7f0e9022f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:20:54.908 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:54 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:54.736+0000 7f0e9022f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:20:54.908 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:54 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:54.906+0000 7f0e9022f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:20:55.161 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:54 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:54.982+0000 7f0e9022f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:20:55.484 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:55 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:55.161+0000 7f0e9022f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:20:55.484 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:55 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:55.246+0000 7f0e9022f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:20:55.484 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:55 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:55.320+0000 7f0e9022f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:20:55.773 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:55 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:55.509+0000 7f0e9022f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:20:55.774 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:55 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:55.590+0000 7f0e9022f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:20:55.774 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:55 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:55.672+0000 7f0e9022f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:20:55.774 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:55 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:55.773+0000 7f0e9022f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:20:56.189 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:55 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:55.846+0000 7f0e9022f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:20:56.189 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:55 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:55.920+0000 7f0e9022f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:20:57.124 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:56.886+0000 7f0e9022f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:20:57.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: Active manager daemon x restarted 2024-09-11T22:20:57.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: Activating manager daemon x 2024-09-11T22:20:57.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T22:20:57.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: mgrmap e10: x(active, starting, since 0.00407076s) 2024-09-11T22:20:57.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:20:57.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T22:20:57.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T22:20:57.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T22:20:57.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T22:20:57.126 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: Manager daemon x is now available 2024-09-11T22:20:57.126 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:20:57.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T22:20:57.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T22:20:57.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:57 smithi040 ceph-mon[30787]: mgrmap e11: x(active, since 1.00871s) 2024-09-11T22:20:58.656 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout { 2024-09-11T22:20:58.656 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T22:20:58.656 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T22:20:58.656 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout } 2024-09-11T22:20:58.656 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.376+0000 7f4a7be00640 1 Processor -- start 2024-09-11T22:20:58.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.376+0000 7f4a7be00640 1 -- start start 2024-09-11T22:20:58.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.376+0000 7f4a7be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c107800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.376+0000 7f4a7be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c107dd0 con 0x7f4a7c107400 2024-09-11T22:20:58.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.377+0000 7f4a7aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.377+0000 7f4a7aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50794/0 (socket says 172.21.15.40:50794) 2024-09-11T22:20:58.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.377+0000 7f4a7aa00640 1 -- 172.21.15.40:0/3383091384 learned_addr learned my addr 172.21.15.40:0/3383091384 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:58.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.377+0000 7f4a7aa00640 1 -- 172.21.15.40:0/3383091384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c108600 con 0x7f4a7c107400 2024-09-11T22:20:58.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.378+0000 7f4a7aa00640 1 --2- 172.21.15.40:0/3383091384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c107800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009820 tx=0x7f4a6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50eefa0aaf090026 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.378+0000 7f4a79600640 1 -- 172.21.15.40:0/3383091384 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c037070 con 0x7f4a7c107400 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.378+0000 7f4a79600640 1 -- 172.21.15.40:0/3383091384 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a6c032920 con 0x7f4a7c107400 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.378+0000 7f4a79600640 1 -- 172.21.15.40:0/3383091384 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c030810 con 0x7f4a7c107400 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.379+0000 7f4a7be00640 1 -- 172.21.15.40:0/3383091384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 msgr2=0x7f4a7c107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.379+0000 7f4a7be00640 1 --2- 172.21.15.40:0/3383091384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c107800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009820 tx=0x7f4a6c02a270 comp rx=0 tx=0).stop 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.379+0000 7f4a7be00640 1 -- 172.21.15.40:0/3383091384 shutdown_connections 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.379+0000 7f4a7be00640 1 --2- 172.21.15.40:0/3383091384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c107800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.379+0000 7f4a7be00640 1 -- 172.21.15.40:0/3383091384 >> 172.21.15.40:0/3383091384 conn(0x7f4a7c102c10 msgr2=0x7f4a7c105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.379+0000 7f4a7be00640 1 -- 172.21.15.40:0/3383091384 shutdown_connections 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.379+0000 7f4a7be00640 1 -- 172.21.15.40:0/3383091384 wait complete. 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.380+0000 7f4a7be00640 1 Processor -- start 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.380+0000 7f4a7be00640 1 -- start start 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.381+0000 7f4a7be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c07db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.381+0000 7f4a7be00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c10b9b0 con 0x7f4a7c107400 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.381+0000 7f4a7aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c07db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.381+0000 7f4a7aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c07db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50804/0 (socket says 172.21.15.40:50804) 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.381+0000 7f4a7aa00640 1 -- 172.21.15.40:0/4199930220 learned_addr learned my addr 172.21.15.40:0/4199930220 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.381+0000 7f4a7aa00640 1 -- 172.21.15.40:0/4199930220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c07e050 con 0x7f4a7c107400 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.382+0000 7f4a7aa00640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c07db10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0097f0 tx=0x7f4a6c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.382+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c037040 con 0x7f4a7c107400 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.382+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a6c030cc0 con 0x7f4a7c107400 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.382+0000 7f4a7be00640 1 -- 172.21.15.40:0/4199930220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c07c240 con 0x7f4a7c107400 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.382+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c03a640 con 0x7f4a7c107400 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.382+0000 7f4a7be00640 1 -- 172.21.15.40:0/4199930220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c07c780 con 0x7f4a7c107400 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.383+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f4a6c03a940 con 0x7f4a7c107400 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.384+0000 7f4a73400640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 0x7f4a6003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.384+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 --> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4a6003bb90 con 0x7f4a60038fc0 2024-09-11T22:20:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.384+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4a6c06c770 con 0x7f4a7c107400 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.384+0000 7f4a7a000640 1 -- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 msgr2=0x7f4a6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2835470410 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.384+0000 7f4a7a000640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 0x7f4a6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.585+0000 7f4a7a000640 1 -- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 msgr2=0x7f4a6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2835470410 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.585+0000 7f4a7a000640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 0x7f4a6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.986+0000 7f4a7a000640 1 -- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 msgr2=0x7f4a6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2835470410 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:53.986+0000 7f4a7a000640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 0x7f4a6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:54.787+0000 7f4a7a000640 1 -- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 msgr2=0x7f4a6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2835470410 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:54.787+0000 7f4a7a000640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 0x7f4a6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:56.388+0000 7f4a7a000640 1 -- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 msgr2=0x7f4a6003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6800/2835470410 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:56.389+0000 7f4a7a000640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 0x7f4a6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:56.891+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f4a6c044920 con 0x7f4a7c107400 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:56.892+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 msgr2=0x7f4a6003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:56.892+0000 7f4a73400640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 0x7f4a6003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.894+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f4a6c06dfc0 con 0x7f4a7c107400 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.894+0000 7f4a73400640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4a6003ca80 0x7f4a6003ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.895+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4a6c034ec0 con 0x7f4a6003ca80 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.895+0000 7f4a7a000640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4a6003ca80 0x7f4a6003ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.897+0000 7f4a7a000640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4a6003ca80 0x7f4a6003ee70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4a68003980 tx=0x7f4a68009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.898+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f4a6c034ec0 con 0x7f4a6003ca80 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.911+0000 7f4a7be00640 1 -- 172.21.15.40:0/4199930220 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4a7c10bb30 con 0x7f4a6003ca80 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.911+0000 7f4a73400640 1 -- 172.21.15.40:0/4199930220 <== mgr.14150 v2:172.21.15.40:6800/3905506167 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f4a7c10bb30 con 0x7f4a6003ca80 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 -- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4a6003ca80 msgr2=0x7f4a6003ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4a6003ca80 0x7f4a6003ee70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4a68003980 tx=0x7f4a68009290 comp rx=0 tx=0).stop 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 -- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 msgr2=0x7f4a7c07db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c07db10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0097f0 tx=0x7f4a6c0327b0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 -- 172.21.15.40:0/4199930220 shutdown_connections 2024-09-11T22:20:58.661 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4a6003ca80 0x7f4a6003ee70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.662 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:6800/2835470410,v1:172.21.15.40:6801/2835470410] conn(0x7f4a60038fc0 0x7f4a6003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.662 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 --2- 172.21.15.40:0/4199930220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a7c107400 0x7f4a7c07db10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.662 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 -- 172.21.15.40:0/4199930220 >> 172.21.15.40:0/4199930220 conn(0x7f4a7c102c10 msgr2=0x7f4a7c103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.662 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 -- 172.21.15.40:0/4199930220 shutdown_connections 2024-09-11T22:20:58.662 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:57.912+0000 7f4a7be00640 1 -- 172.21.15.40:0/4199930220 wait complete. 2024-09-11T22:20:58.662 INFO:teuthology.orchestra.run.smithi040.stdout:mgr epoch 9 is available 2024-09-11T22:20:58.662 INFO:teuthology.orchestra.run.smithi040.stdout:Generating a dashboard self-signed certificate... 2024-09-11T22:20:59.224 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:58 smithi040 ceph-mon[30787]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T22:20:59.224 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:58 smithi040 ceph-mon[30787]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:20:59.085+0000 7f0ded600640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:22:20:59] ENGINE Error in HTTPServer.serve 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: Traceback (most recent call last): 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: self._connections.run(self.expiration_interval) 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: self._run(expiration_interval) 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: s = self.context.wrap_socket( 2024-09-11T22:20:59.225 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:20:59.226 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: return self.sslsocket_class._create( 2024-09-11T22:20:59.226 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:20:59.226 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: self.do_handshake() 2024-09-11T22:20:59.226 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:20:59.226 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: self._sslobj.do_handshake() 2024-09-11T22:20:59.226 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:20:59.226 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:21:00.145 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: mgrmap e12: x(active, since 2s) 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:58] ENGINE Bus STARTING 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:59] ENGINE Serving on https://172.21.15.40:7150 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:59] ENGINE Error in HTTPServer.serve 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: Traceback (most recent call last): 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._connections.run(self.expiration_interval) 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._run(expiration_interval) 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T22:21:00.146 INFO:journalctl@ceph.mon.a.smithi040.stdout: s = self.context.wrap_socket( 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout: return self.sslsocket_class._create( 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout: self.do_handshake() 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout: self._sslobj.do_handshake() 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:59] ENGINE Serving on http://172.21.15.40:8765 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: [11/Sep/2024:22:20:59] ENGINE Bus STARTED 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:00.147 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:20:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:00.156 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-11T22:21:00.156 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.237+0000 7faf53800640 1 Processor -- start 2024-09-11T22:21:00.156 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.237+0000 7faf53800640 1 -- start start 2024-09-11T22:21:00.156 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.238+0000 7faf53800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.156 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.238+0000 7faf53800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c10a1e0 con 0x7faf4c109810 2024-09-11T22:21:00.156 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.238+0000 7faf50e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.156 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.238+0000 7faf50e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50882/0 (socket says 172.21.15.40:50882) 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.238+0000 7faf50e00640 1 -- 172.21.15.40:0/2124310950 learned_addr learned my addr 172.21.15.40:0/2124310950 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.238+0000 7faf50e00640 1 -- 172.21.15.40:0/2124310950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c10aa00 con 0x7faf4c109810 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.239+0000 7faf50e00640 1 --2- 172.21.15.40:0/2124310950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c109c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf40009820 tx=0x7faf4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45bf498b0c2cc04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.239+0000 7faf4b400640 1 -- 172.21.15.40:0/2124310950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf40037070 con 0x7faf4c109810 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.240+0000 7faf4b400640 1 -- 172.21.15.40:0/2124310950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf40032920 con 0x7faf4c109810 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.240+0000 7faf4b400640 1 -- 172.21.15.40:0/2124310950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf40030810 con 0x7faf4c109810 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.240+0000 7faf53800640 1 -- 172.21.15.40:0/2124310950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 msgr2=0x7faf4c109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.240+0000 7faf53800640 1 --2- 172.21.15.40:0/2124310950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c109c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf40009820 tx=0x7faf4002a270 comp rx=0 tx=0).stop 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.240+0000 7faf53800640 1 -- 172.21.15.40:0/2124310950 shutdown_connections 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.240+0000 7faf53800640 1 --2- 172.21.15.40:0/2124310950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c109c10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.240+0000 7faf53800640 1 -- 172.21.15.40:0/2124310950 >> 172.21.15.40:0/2124310950 conn(0x7faf4c07cd60 msgr2=0x7faf4c07d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.240+0000 7faf53800640 1 -- 172.21.15.40:0/2124310950 shutdown_connections 2024-09-11T22:21:00.157 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.240+0000 7faf53800640 1 -- 172.21.15.40:0/2124310950 wait complete. 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.241+0000 7faf53800640 1 Processor -- start 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.242+0000 7faf53800640 1 -- start start 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.242+0000 7faf53800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c19d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.242+0000 7faf53800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c10ddb0 con 0x7faf4c109810 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.242+0000 7faf50e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c19d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.242+0000 7faf50e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c19d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50898/0 (socket says 172.21.15.40:50898) 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.242+0000 7faf50e00640 1 -- 172.21.15.40:0/1181913067 learned_addr learned my addr 172.21.15.40:0/1181913067 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.242+0000 7faf50e00640 1 -- 172.21.15.40:0/1181913067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c19dd40 con 0x7faf4c109810 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.243+0000 7faf50e00640 1 --2- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c19d800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faf400097f0 tx=0x7faf400327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.243+0000 7faf49600640 1 -- 172.21.15.40:0/1181913067 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf40037040 con 0x7faf4c109810 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.243+0000 7faf49600640 1 -- 172.21.15.40:0/1181913067 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf40030cc0 con 0x7faf4c109810 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.243+0000 7faf49600640 1 -- 172.21.15.40:0/1181913067 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4003a6b0 con 0x7faf4c109810 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.243+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4c19dfd0 con 0x7faf4c109810 2024-09-11T22:21:00.158 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.243+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf4c1a0cc0 con 0x7faf4c109810 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.244+0000 7faf49600640 1 -- 172.21.15.40:0/1181913067 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7faf4003baf0 con 0x7faf4c109810 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.244+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf4c109c90 con 0x7faf4c109810 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.245+0000 7faf49600640 1 --2- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf34039020 0x7faf3403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.245+0000 7faf49600640 1 -- 172.21.15.40:0/1181913067 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7faf4006c5f0 con 0x7faf4c109810 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.245+0000 7faf4be00640 1 --2- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf34039020 0x7faf3403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.246+0000 7faf4be00640 1 --2- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf34039020 0x7faf3403b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faf380098c0 tx=0x7faf38006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.250+0000 7faf49600640 1 -- 172.21.15.40:0/1181913067 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf400371e0 con 0x7faf4c109810 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.443+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7faf4c107c00 con 0x7faf34039020 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.500+0000 7faf49600640 1 -- 172.21.15.40:0/1181913067 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7faf4c107c00 con 0x7faf34039020 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf34039020 msgr2=0x7faf3403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 --2- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf34039020 0x7faf3403b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faf380098c0 tx=0x7faf38006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.159 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 msgr2=0x7faf4c19d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.160 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 --2- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c19d800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faf400097f0 tx=0x7faf400327b0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.160 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 shutdown_connections 2024-09-11T22:21:00.160 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 --2- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf34039020 0x7faf3403b4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.160 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 --2- 172.21.15.40:0/1181913067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf4c109810 0x7faf4c19d800 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.160 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 >> 172.21.15.40:0/1181913067 conn(0x7faf4c07cd60 msgr2=0x7faf4c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:00.160 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 shutdown_connections 2024-09-11T22:21:00.160 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:20:59.502+0000 7faf53800640 1 -- 172.21.15.40:0/1181913067 wait complete. 2024-09-11T22:21:00.160 INFO:teuthology.orchestra.run.smithi040.stdout:Creating initial admin user... 2024-09-11T22:21:01.856 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$kG/RmjsT2Sh5RgK7eGgYbeBofzQ8kWgKoeVT1s7Ogy1Zdz.DHK3Sa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726093261, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T22:21:01.856 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.715+0000 7fbad7000640 1 Processor -- start 2024-09-11T22:21:01.856 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.715+0000 7fbad7000640 1 -- start start 2024-09-11T22:21:01.856 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.716+0000 7fbad7000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad0109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.856 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.716+0000 7fbad7000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbad010a1a0 con 0x7fbad01097d0 2024-09-11T22:21:01.856 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.716+0000 7fbacfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad0109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.856 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.716+0000 7fbacfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad0109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50912/0 (socket says 172.21.15.40:50912) 2024-09-11T22:21:01.856 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.716+0000 7fbacfe00640 1 -- 172.21.15.40:0/1740534726 learned_addr learned my addr 172.21.15.40:0/1740534726 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.717+0000 7fbacfe00640 1 -- 172.21.15.40:0/1740534726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad010a9e0 con 0x7fbad01097d0 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.718+0000 7fbacfe00640 1 --2- 172.21.15.40:0/1740534726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad0109bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009820 tx=0x7fbac002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0a22b636b3d5ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.718+0000 7fbacea00640 1 -- 172.21.15.40:0/1740534726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbac0037070 con 0x7fbad01097d0 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.718+0000 7fbacea00640 1 -- 172.21.15.40:0/1740534726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbac0032920 con 0x7fbad01097d0 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.718+0000 7fbacea00640 1 -- 172.21.15.40:0/1740534726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbac0030810 con 0x7fbad01097d0 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.719+0000 7fbad7000640 1 -- 172.21.15.40:0/1740534726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 msgr2=0x7fbad0109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.719+0000 7fbad7000640 1 --2- 172.21.15.40:0/1740534726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad0109bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009820 tx=0x7fbac002a270 comp rx=0 tx=0).stop 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.719+0000 7fbad7000640 1 -- 172.21.15.40:0/1740534726 shutdown_connections 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.719+0000 7fbad7000640 1 --2- 172.21.15.40:0/1740534726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad0109bd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.719+0000 7fbad7000640 1 -- 172.21.15.40:0/1740534726 >> 172.21.15.40:0/1740534726 conn(0x7fbad007cde0 msgr2=0x7fbad007d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:01.857 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.719+0000 7fbad7000640 1 -- 172.21.15.40:0/1740534726 shutdown_connections 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.719+0000 7fbad7000640 1 -- 172.21.15.40:0/1740534726 wait complete. 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.720+0000 7fbad7000640 1 Processor -- start 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.720+0000 7fbad7000640 1 -- start start 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.721+0000 7fbad7000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.721+0000 7fbad7000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbad010dd90 con 0x7fbad01097d0 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.721+0000 7fbacfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.721+0000 7fbacfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad019d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50916/0 (socket says 172.21.15.40:50916) 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.721+0000 7fbacfe00640 1 -- 172.21.15.40:0/4026146701 learned_addr learned my addr 172.21.15.40:0/4026146701 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.721+0000 7fbacfe00640 1 -- 172.21.15.40:0/4026146701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad019dd50 con 0x7fbad01097d0 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.722+0000 7fbacfe00640 1 --2- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad019d810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbac0030560 tx=0x7fbac0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.722+0000 7fbaccc00640 1 -- 172.21.15.40:0/4026146701 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbac0037040 con 0x7fbad01097d0 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.722+0000 7fbaccc00640 1 -- 172.21.15.40:0/4026146701 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbac0040070 con 0x7fbad01097d0 2024-09-11T22:21:01.858 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.722+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad019dfe0 con 0x7fbad01097d0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.722+0000 7fbaccc00640 1 -- 172.21.15.40:0/4026146701 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbac003a740 con 0x7fbad01097d0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.722+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad01a0cd0 con 0x7fbad01097d0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.723+0000 7fbaccc00640 1 -- 172.21.15.40:0/4026146701 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fbac003a9b0 con 0x7fbad01097d0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.723+0000 7fbaccc00640 1 --2- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbab4038fc0 0x7fbab403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.724+0000 7fbaccc00640 1 -- 172.21.15.40:0/4026146701 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbac006c7c0 con 0x7fbad01097d0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.723+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad0109bd0 con 0x7fbad01097d0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.724+0000 7fbacf400640 1 --2- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbab4038fc0 0x7fbab403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.725+0000 7fbacf400640 1 --2- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbab4038fc0 0x7fbab403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0098c0 tx=0x7fbabc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.729+0000 7fbaccc00640 1 -- 172.21.15.40:0/4026146701 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbac0042e30 con 0x7fbad01097d0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:00.931+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fbad019e4c0 con 0x7fbab4038fc0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.181+0000 7fbaccc00640 1 -- 172.21.15.40:0/4026146701 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fbad019e4c0 con 0x7fbab4038fc0 2024-09-11T22:21:01.859 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbab4038fc0 msgr2=0x7fbab403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.860 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 --2- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbab4038fc0 0x7fbab403b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0098c0 tx=0x7fbabc006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.860 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 msgr2=0x7fbad019d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.860 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 --2- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad019d810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbac0030560 tx=0x7fbac0032670 comp rx=0 tx=0).stop 2024-09-11T22:21:01.860 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 shutdown_connections 2024-09-11T22:21:01.860 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 --2- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbab4038fc0 0x7fbab403b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.861 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 --2- 172.21.15.40:0/4026146701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad01097d0 0x7fbad019d810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.861 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 >> 172.21.15.40:0/4026146701 conn(0x7fbad007cde0 msgr2=0x7fbad0107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:01.861 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 shutdown_connections 2024-09-11T22:21:01.861 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:01.183+0000 7fbad7000640 1 -- 172.21.15.40:0/4026146701 wait complete. 2024-09-11T22:21:01.861 INFO:teuthology.orchestra.run.smithi040.stdout:Fetching dashboard port number... 2024-09-11T22:21:02.118 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:02.118 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:01 smithi040 ceph-mon[30787]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:02.118 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:03.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:02 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3459079431' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-11T22:21:03.567 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T22:21:03.567 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.560+0000 7f56e5400640 1 Processor -- start 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.560+0000 7f56e5400640 1 -- start start 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.561+0000 7f56e5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e007c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.561+0000 7f56e5400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f56e007c8b0 con 0x7f56e007de80 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.561+0000 7f56de800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e007c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.561+0000 7f56de800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e007c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43222/0 (socket says 172.21.15.40:43222) 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.561+0000 7f56de800640 1 -- 172.21.15.40:0/2337987088 learned_addr learned my addr 172.21.15.40:0/2337987088 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.561+0000 7f56de800640 1 -- 172.21.15.40:0/2337987088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e007ca30 con 0x7f56e007de80 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.562+0000 7f56de800640 1 --2- 172.21.15.40:0/2337987088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e007c2e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009820 tx=0x7f56d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e32daa360ace68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.563+0000 7f56dd400640 1 -- 172.21.15.40:0/2337987088 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d0037070 con 0x7f56e007de80 2024-09-11T22:21:03.568 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.563+0000 7f56dd400640 1 -- 172.21.15.40:0/2337987088 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d0032920 con 0x7f56e007de80 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.563+0000 7f56dd400640 1 -- 172.21.15.40:0/2337987088 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d0030810 con 0x7f56e007de80 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.563+0000 7f56e5400640 1 -- 172.21.15.40:0/2337987088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 msgr2=0x7f56e007c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.563+0000 7f56e5400640 1 --2- 172.21.15.40:0/2337987088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e007c2e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009820 tx=0x7f56d002a270 comp rx=0 tx=0).stop 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.563+0000 7f56e5400640 1 -- 172.21.15.40:0/2337987088 shutdown_connections 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.563+0000 7f56e5400640 1 --2- 172.21.15.40:0/2337987088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e007c2e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.563+0000 7f56e5400640 1 -- 172.21.15.40:0/2337987088 >> 172.21.15.40:0/2337987088 conn(0x7f56e0102d10 msgr2=0x7f56e0105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.564+0000 7f56e5400640 1 -- 172.21.15.40:0/2337987088 shutdown_connections 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.564+0000 7f56e5400640 1 -- 172.21.15.40:0/2337987088 wait complete. 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.565+0000 7f56e5400640 1 Processor -- start 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.565+0000 7f56e5400640 1 -- start start 2024-09-11T22:21:03.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.565+0000 7f56e5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e01a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.565+0000 7f56e5400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0109840 con 0x7f56e007de80 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.565+0000 7f56de800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e01a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.565+0000 7f56de800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e01a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43234/0 (socket says 172.21.15.40:43234) 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.565+0000 7f56de800640 1 -- 172.21.15.40:0/3459079431 learned_addr learned my addr 172.21.15.40:0/3459079431 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.565+0000 7f56de800640 1 -- 172.21.15.40:0/3459079431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e01a2190 con 0x7f56e007de80 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.566+0000 7f56de800640 1 --2- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e01a1c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56d00097f0 tx=0x7f56d00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.566+0000 7f56d7400640 1 -- 172.21.15.40:0/3459079431 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d0037040 con 0x7f56e007de80 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.566+0000 7f56d7400640 1 -- 172.21.15.40:0/3459079431 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d0030c40 con 0x7f56e007de80 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.566+0000 7f56d7400640 1 -- 172.21.15.40:0/3459079431 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d003a5b0 con 0x7f56e007de80 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.566+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e01a2420 con 0x7f56e007de80 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.566+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e01a5110 con 0x7f56e007de80 2024-09-11T22:21:03.570 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.567+0000 7f56d7400640 1 -- 172.21.15.40:0/3459079431 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f56d003a7a0 con 0x7f56e007de80 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.567+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e007c360 con 0x7f56e007de80 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.568+0000 7f56d7400640 1 --2- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56c4039020 0x7f56c403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.568+0000 7f56d7400640 1 -- 172.21.15.40:0/3459079431 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f56d006c4e0 con 0x7f56e007de80 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.568+0000 7f56dde00640 1 --2- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56c4039020 0x7f56c403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.569+0000 7f56dde00640 1 --2- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56c4039020 0x7f56c403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0098c0 tx=0x7f56cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.574+0000 7f56d7400640 1 -- 172.21.15.40:0/3459079431 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56d00371e0 con 0x7f56e007de80 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.764+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f56e002d9a0 con 0x7f56e007de80 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.764+0000 7f56d7400640 1 -- 172.21.15.40:0/3459079431 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f56d003b3f0 con 0x7f56e007de80 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56c4039020 msgr2=0x7f56c403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 --2- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56c4039020 0x7f56c403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0098c0 tx=0x7f56cc006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 msgr2=0x7f56e01a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.572 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 --2- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e01a1c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f56d00097f0 tx=0x7f56d00327b0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.572 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 shutdown_connections 2024-09-11T22:21:03.572 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 --2- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56c4039020 0x7f56c403b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.572 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 --2- 172.21.15.40:0/3459079431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56e007de80 0x7f56e01a1c50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.572 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 >> 172.21.15.40:0/3459079431 conn(0x7f56e0102d10 msgr2=0x7f56e01988b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:03.572 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 shutdown_connections 2024-09-11T22:21:03.572 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:02.767+0000 7f56e5400640 1 -- 172.21.15.40:0/3459079431 wait complete. 2024-09-11T22:21:03.581 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T22:21:03.581 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout disabled 2024-09-11T22:21:03.594 INFO:teuthology.orchestra.run.smithi040.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T22:21:03.595 INFO:teuthology.orchestra.run.smithi040.stdout:systemctl: stdout inactive 2024-09-11T22:21:03.595 INFO:teuthology.orchestra.run.smithi040.stdout:firewalld.service is not enabled 2024-09-11T22:21:03.595 INFO:teuthology.orchestra.run.smithi040.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T22:21:03.597 INFO:teuthology.orchestra.run.smithi040.stdout:Ceph Dashboard is now available at: 2024-09-11T22:21:03.597 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:03.597 INFO:teuthology.orchestra.run.smithi040.stdout: URL: https://smithi040.front.sepia.ceph.com:8443/ 2024-09-11T22:21:03.597 INFO:teuthology.orchestra.run.smithi040.stdout: User: admin 2024-09-11T22:21:03.597 INFO:teuthology.orchestra.run.smithi040.stdout: Password: pc8urgh8kv 2024-09-11T22:21:03.597 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:03.598 INFO:teuthology.orchestra.run.smithi040.stdout:Saving cluster configuration to /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config directory 2024-09-11T22:21:04.125 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:03 smithi040 ceph-mon[30787]: mgrmap e13: x(active, since 6s) 2024-09-11T22:21:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.571+0000 7f4ffb200640 1 Processor -- start 2024-09-11T22:21:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.571+0000 7f4ffb200640 1 -- start start 2024-09-11T22:21:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.571+0000 7f4ffb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc07c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.571+0000 7f4ffb200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc07c7a0 con 0x7f4ffc07de00 2024-09-11T22:21:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.571+0000 7f4ff9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc07c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.572+0000 7f4ff9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc07c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43248/0 (socket says 172.21.15.40:43248) 2024-09-11T22:21:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.572+0000 7f4ff9e00640 1 -- 172.21.15.40:0/2606115531 learned_addr learned my addr 172.21.15.40:0/2606115531 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.572+0000 7f4ff9e00640 1 -- 172.21.15.40:0/2606115531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ffc07c920 con 0x7f4ffc07de00 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.573+0000 7f4ff9e00640 1 --2- 172.21.15.40:0/2606115531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc07c260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009820 tx=0x7f4fec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2107a71e76e7ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.573+0000 7f4ff9400640 1 -- 172.21.15.40:0/2606115531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec037070 con 0x7f4ffc07de00 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.573+0000 7f4ff9400640 1 -- 172.21.15.40:0/2606115531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fec032920 con 0x7f4ffc07de00 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.573+0000 7f4ff9400640 1 -- 172.21.15.40:0/2606115531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec030810 con 0x7f4ffc07de00 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.574+0000 7f4ffb200640 1 -- 172.21.15.40:0/2606115531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 msgr2=0x7f4ffc07c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.574+0000 7f4ffb200640 1 --2- 172.21.15.40:0/2606115531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc07c260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009820 tx=0x7f4fec02a270 comp rx=0 tx=0).stop 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.574+0000 7f4ffb200640 1 -- 172.21.15.40:0/2606115531 shutdown_connections 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.574+0000 7f4ffb200640 1 --2- 172.21.15.40:0/2606115531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc07c260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.574+0000 7f4ffb200640 1 -- 172.21.15.40:0/2606115531 >> 172.21.15.40:0/2606115531 conn(0x7f4ffc102c10 msgr2=0x7f4ffc105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.574+0000 7f4ffb200640 1 -- 172.21.15.40:0/2606115531 shutdown_connections 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.574+0000 7f4ffb200640 1 -- 172.21.15.40:0/2606115531 wait complete. 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.575+0000 7f4ffb200640 1 Processor -- start 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.575+0000 7f4ffb200640 1 -- start start 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.575+0000 7f4ffb200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc19d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.575+0000 7f4ffb200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc10da50 con 0x7f4ffc07de00 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.576+0000 7f4ff9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc19d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.576+0000 7f4ff9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc19d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43258/0 (socket says 172.21.15.40:43258) 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.576+0000 7f4ff9e00640 1 -- 172.21.15.40:0/406943545 learned_addr learned my addr 172.21.15.40:0/406943545 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.576+0000 7f4ff9e00640 1 -- 172.21.15.40:0/406943545 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ffc19db20 con 0x7f4ffc07de00 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.576+0000 7f4ff9e00640 1 --2- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc19d5e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097f0 tx=0x7f4fec0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.576+0000 7f4ff3400640 1 -- 172.21.15.40:0/406943545 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec037040 con 0x7f4ffc07de00 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.577+0000 7f4ff3400640 1 -- 172.21.15.40:0/406943545 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fec030cc0 con 0x7f4ffc07de00 2024-09-11T22:21:05.419 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.577+0000 7f4ffb200640 1 -- 172.21.15.40:0/406943545 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ffc19ddb0 con 0x7f4ffc07de00 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.577+0000 7f4ff3400640 1 -- 172.21.15.40:0/406943545 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec03a6b0 con 0x7f4ffc07de00 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.577+0000 7f4ffb200640 1 -- 172.21.15.40:0/406943545 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ffc1a0aa0 con 0x7f4ffc07de00 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.578+0000 7f4ff3400640 1 -- 172.21.15.40:0/406943545 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4fec03b3f0 con 0x7f4ffc07de00 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.578+0000 7f4febe00640 1 -- 172.21.15.40:0/406943545 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd4005290 con 0x7f4ffc07de00 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.578+0000 7f4ff3400640 1 --2- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4fe00390c0 0x7f4fe003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.579+0000 7f4ff3400640 1 -- 172.21.15.40:0/406943545 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4fec06c6c0 con 0x7f4ffc07de00 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.579+0000 7f4ff1400640 1 --2- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4fe00390c0 0x7f4fe003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.579+0000 7f4ff1400640 1 --2- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4fe00390c0 0x7f4fe003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40098c0 tx=0x7f4fe4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.583+0000 7f4ff3400640 1 -- 172.21.15.40:0/406943545 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fec03b6e0 con 0x7f4ffc07de00 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.858+0000 7f4febe00640 1 -- 172.21.15.40:0/406943545 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f4fd4005580 con 0x7f4ffc07de00 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.860+0000 7f4ff3400640 1 -- 172.21.15.40:0/406943545 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f4fec03ad70 con 0x7f4ffc07de00 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T22:21:05.420 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.862+0000 7f4febe00640 1 -- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4fe00390c0 msgr2=0x7f4fe003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.863+0000 7f4febe00640 1 --2- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4fe00390c0 0x7f4fe003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40098c0 tx=0x7f4fe4006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.863+0000 7f4febe00640 1 -- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 msgr2=0x7f4ffc19d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.863+0000 7f4febe00640 1 --2- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc19d5e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097f0 tx=0x7f4fec0327b0 comp rx=0 tx=0).stop 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.863+0000 7f4febe00640 1 -- 172.21.15.40:0/406943545 shutdown_connections 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.863+0000 7f4febe00640 1 --2- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4fe00390c0 0x7f4fe003b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.863+0000 7f4febe00640 1 --2- 172.21.15.40:0/406943545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ffc07de00 0x7f4ffc19d5e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.863+0000 7f4febe00640 1 -- 172.21.15.40:0/406943545 >> 172.21.15.40:0/406943545 conn(0x7f4ffc102c10 msgr2=0x7f4ffc103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.863+0000 7f4febe00640 1 -- 172.21.15.40:0/406943545 shutdown_connections 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/ceph: stderr 2024-09-11T22:21:04.863+0000 7f4febe00640 1 -- 172.21.15.40:0/406943545 wait complete. 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T22:21:05.421 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: ceph telemetry on 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout:For more information see: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:05.422 INFO:teuthology.orchestra.run.smithi040.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-11T22:21:05.423 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:05.423 INFO:teuthology.orchestra.run.smithi040.stdout:Bootstrap complete. 2024-09-11T22:21:05.472 INFO:tasks.cephadm:Fetching config... 2024-09-11T22:21:05.473 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:21:05.473 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T22:21:05.509 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T22:21:05.509 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:21:05.509 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T22:21:05.585 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T22:21:05.585 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:21:05.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T22:21:05.682 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T22:21:05.682 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:21:05.682 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T22:21:05.757 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T22:21:05.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMq4j1b2kiKTO0nJpuAGgo0ZdJbhWxVOgbqRLl36/bVaLvgSlgOrdoarWz08e892kRudbdDRsQFJnq2YiJs6r0qlZP5T4SVbndxphulZSJu7MkjG0i5tm5gi4nor+JShe8Iv3NLaEjzlWlVIkKBTOzqvFKZSdlAoF5xJ7K80BQoRn4FsqHh0nshpYOcE9QYHHrv5aDq8/CS6D59rCnBNyt6iqZRegdSIDSVPOsTrTTJt3gr8Ux+FQiGuDPIVn2t41Tjf0mgXmVGxn+hfp7vRbQoprnUN09rAxOll0yKj1i0BNOXc/DkXAZUhSQ9tWh1ACscQ9Glze5rYvtf6+jR8EOYK7jHfOGA/2jsW2gs/MXxRtCNI6ghBrFKdPBPI3NuCfhXdMW27F9oJMydd2d08pNOEJmXYgQw+XqmFSoEWyRhbHBLwwq2iTRFn3ndRAFNERalImrhdwf/OPnrDoAMmoQrW000ONDMsFYm/XVEGBIYsZMmu73Z47lTPEwxva4hqM= ceph-c836ee3e-708b-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T22:21:05.876 INFO:teuthology.orchestra.run.smithi040.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMq4j1b2kiKTO0nJpuAGgo0ZdJbhWxVOgbqRLl36/bVaLvgSlgOrdoarWz08e892kRudbdDRsQFJnq2YiJs6r0qlZP5T4SVbndxphulZSJu7MkjG0i5tm5gi4nor+JShe8Iv3NLaEjzlWlVIkKBTOzqvFKZSdlAoF5xJ7K80BQoRn4FsqHh0nshpYOcE9QYHHrv5aDq8/CS6D59rCnBNyt6iqZRegdSIDSVPOsTrTTJt3gr8Ux+FQiGuDPIVn2t41Tjf0mgXmVGxn+hfp7vRbQoprnUN09rAxOll0yKj1i0BNOXc/DkXAZUhSQ9tWh1ACscQ9Glze5rYvtf6+jR8EOYK7jHfOGA/2jsW2gs/MXxRtCNI6ghBrFKdPBPI3NuCfhXdMW27F9oJMydd2d08pNOEJmXYgQw+XqmFSoEWyRhbHBLwwq2iTRFn3ndRAFNERalImrhdwf/OPnrDoAMmoQrW000ONDMsFYm/XVEGBIYsZMmu73Z47lTPEwxva4hqM= ceph-c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:05.902 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMq4j1b2kiKTO0nJpuAGgo0ZdJbhWxVOgbqRLl36/bVaLvgSlgOrdoarWz08e892kRudbdDRsQFJnq2YiJs6r0qlZP5T4SVbndxphulZSJu7MkjG0i5tm5gi4nor+JShe8Iv3NLaEjzlWlVIkKBTOzqvFKZSdlAoF5xJ7K80BQoRn4FsqHh0nshpYOcE9QYHHrv5aDq8/CS6D59rCnBNyt6iqZRegdSIDSVPOsTrTTJt3gr8Ux+FQiGuDPIVn2t41Tjf0mgXmVGxn+hfp7vRbQoprnUN09rAxOll0yKj1i0BNOXc/DkXAZUhSQ9tWh1ACscQ9Glze5rYvtf6+jR8EOYK7jHfOGA/2jsW2gs/MXxRtCNI6ghBrFKdPBPI3NuCfhXdMW27F9oJMydd2d08pNOEJmXYgQw+XqmFSoEWyRhbHBLwwq2iTRFn3ndRAFNERalImrhdwf/OPnrDoAMmoQrW000ONDMsFYm/XVEGBIYsZMmu73Z47lTPEwxva4hqM= ceph-c836ee3e-708b-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T22:21:05.945 INFO:teuthology.orchestra.run.smithi146.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMq4j1b2kiKTO0nJpuAGgo0ZdJbhWxVOgbqRLl36/bVaLvgSlgOrdoarWz08e892kRudbdDRsQFJnq2YiJs6r0qlZP5T4SVbndxphulZSJu7MkjG0i5tm5gi4nor+JShe8Iv3NLaEjzlWlVIkKBTOzqvFKZSdlAoF5xJ7K80BQoRn4FsqHh0nshpYOcE9QYHHrv5aDq8/CS6D59rCnBNyt6iqZRegdSIDSVPOsTrTTJt3gr8Ux+FQiGuDPIVn2t41Tjf0mgXmVGxn+hfp7vRbQoprnUN09rAxOll0yKj1i0BNOXc/DkXAZUhSQ9tWh1ACscQ9Glze5rYvtf6+jR8EOYK7jHfOGA/2jsW2gs/MXxRtCNI6ghBrFKdPBPI3NuCfhXdMW27F9oJMydd2d08pNOEJmXYgQw+XqmFSoEWyRhbHBLwwq2iTRFn3ndRAFNERalImrhdwf/OPnrDoAMmoQrW000ONDMsFYm/XVEGBIYsZMmu73Z47lTPEwxva4hqM= ceph-c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:05.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMq4j1b2kiKTO0nJpuAGgo0ZdJbhWxVOgbqRLl36/bVaLvgSlgOrdoarWz08e892kRudbdDRsQFJnq2YiJs6r0qlZP5T4SVbndxphulZSJu7MkjG0i5tm5gi4nor+JShe8Iv3NLaEjzlWlVIkKBTOzqvFKZSdlAoF5xJ7K80BQoRn4FsqHh0nshpYOcE9QYHHrv5aDq8/CS6D59rCnBNyt6iqZRegdSIDSVPOsTrTTJt3gr8Ux+FQiGuDPIVn2t41Tjf0mgXmVGxn+hfp7vRbQoprnUN09rAxOll0yKj1i0BNOXc/DkXAZUhSQ9tWh1ACscQ9Glze5rYvtf6+jR8EOYK7jHfOGA/2jsW2gs/MXxRtCNI6ghBrFKdPBPI3NuCfhXdMW27F9oJMydd2d08pNOEJmXYgQw+XqmFSoEWyRhbHBLwwq2iTRFn3ndRAFNERalImrhdwf/OPnrDoAMmoQrW000ONDMsFYm/XVEGBIYsZMmu73Z47lTPEwxva4hqM= ceph-c836ee3e-708b-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T22:21:05.961 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:05 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/406943545' entity='client.admin' 2024-09-11T22:21:06.001 INFO:teuthology.orchestra.run.smithi177.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCMq4j1b2kiKTO0nJpuAGgo0ZdJbhWxVOgbqRLl36/bVaLvgSlgOrdoarWz08e892kRudbdDRsQFJnq2YiJs6r0qlZP5T4SVbndxphulZSJu7MkjG0i5tm5gi4nor+JShe8Iv3NLaEjzlWlVIkKBTOzqvFKZSdlAoF5xJ7K80BQoRn4FsqHh0nshpYOcE9QYHHrv5aDq8/CS6D59rCnBNyt6iqZRegdSIDSVPOsTrTTJt3gr8Ux+FQiGuDPIVn2t41Tjf0mgXmVGxn+hfp7vRbQoprnUN09rAxOll0yKj1i0BNOXc/DkXAZUhSQ9tWh1ACscQ9Glze5rYvtf6+jR8EOYK7jHfOGA/2jsW2gs/MXxRtCNI6ghBrFKdPBPI3NuCfhXdMW27F9oJMydd2d08pNOEJmXYgQw+XqmFSoEWyRhbHBLwwq2iTRFn3ndRAFNERalImrhdwf/OPnrDoAMmoQrW000ONDMsFYm/XVEGBIYsZMmu73Z47lTPEwxva4hqM= ceph-c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:06.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T22:21:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:06.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.962+0000 7f39d2600640 1 -- 172.21.15.40:0/3389504916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 msgr2=0x7f39cc074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.962+0000 7f39d2600640 1 --2- 172.21.15.40:0/3389504916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 0x7f39cc074680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009880 tx=0x7f39bc02a5d0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.962+0000 7f39d2600640 1 -- 172.21.15.40:0/3389504916 shutdown_connections 2024-09-11T22:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.962+0000 7f39d2600640 1 --2- 172.21.15.40:0/3389504916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 0x7f39cc074680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.962+0000 7f39d2600640 1 -- 172.21.15.40:0/3389504916 >> 172.21.15.40:0/3389504916 conn(0x7f39cc0fcd80 msgr2=0x7f39cc0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.962+0000 7f39d2600640 1 -- 172.21.15.40:0/3389504916 shutdown_connections 2024-09-11T22:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.962+0000 7f39d2600640 1 -- 172.21.15.40:0/3389504916 wait complete. 2024-09-11T22:21:06.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.964+0000 7f39d2600640 1 Processor -- start 2024-09-11T22:21:06.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.964+0000 7f39d2600640 1 -- start start 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.964+0000 7f39d2600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 0x7f39cc198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.964+0000 7f39d2600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc109910 con 0x7f39cc076220 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.964+0000 7f39cb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 0x7f39cc198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.964+0000 7f39cb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 0x7f39cc198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43276/0 (socket says 172.21.15.40:43276) 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.964+0000 7f39cb400640 1 -- 172.21.15.40:0/147242587 learned_addr learned my addr 172.21.15.40:0/147242587 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.965+0000 7f39cb400640 1 -- 172.21.15.40:0/147242587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc1994c0 con 0x7f39cc076220 2024-09-11T22:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.965+0000 7f39cb400640 1 --2- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 0x7f39cc198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39bc004f60 tx=0x7f39bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.965+0000 7f39c3e00640 1 -- 172.21.15.40:0/147242587 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39bc03f070 con 0x7f39cc076220 2024-09-11T22:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.966+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc199750 con 0x7f39cc076220 2024-09-11T22:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.966+0000 7f39c3e00640 1 -- 172.21.15.40:0/147242587 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39bc004cc0 con 0x7f39cc076220 2024-09-11T22:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.966+0000 7f39c3e00640 1 -- 172.21.15.40:0/147242587 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39bc035030 con 0x7f39cc076220 2024-09-11T22:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.966+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc19c440 con 0x7f39cc076220 2024-09-11T22:21:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.967+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ac0052c0 con 0x7f39cc076220 2024-09-11T22:21:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.967+0000 7f39c3e00640 1 -- 172.21.15.40:0/147242587 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f39bc042070 con 0x7f39cc076220 2024-09-11T22:21:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.967+0000 7f39c3e00640 1 --2- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f39b0039060 0x7f39b003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.968+0000 7f39c3e00640 1 -- 172.21.15.40:0/147242587 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f39bc06cdb0 con 0x7f39cc076220 2024-09-11T22:21:06.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.968+0000 7f39caa00640 1 --2- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f39b0039060 0x7f39b003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.969+0000 7f39caa00640 1 --2- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f39b0039060 0x7f39b003b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39b80098c0 tx=0x7f39b8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:06.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:06.973+0000 7f39c3e00640 1 -- 172.21.15.40:0/147242587 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39bc071070 con 0x7f39cc076220 2024-09-11T22:21:07.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.166+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f39ac0055b0 con 0x7f39cc076220 2024-09-11T22:21:07.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.169+0000 7f39c3e00640 1 -- 172.21.15.40:0/147242587 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f39bc0035f0 con 0x7f39cc076220 2024-09-11T22:21:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f39b0039060 msgr2=0x7f39b003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 --2- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f39b0039060 0x7f39b003b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39b80098c0 tx=0x7f39b8006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 msgr2=0x7f39cc198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 --2- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 0x7f39cc198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39bc004f60 tx=0x7f39bc0048f0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 shutdown_connections 2024-09-11T22:21:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 --2- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f39b0039060 0x7f39b003b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 --2- 172.21.15.40:0/147242587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39cc076220 0x7f39cc198f80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 >> 172.21.15.40:0/147242587 conn(0x7f39cc0fcd80 msgr2=0x7f39cc0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 shutdown_connections 2024-09-11T22:21:07.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:07.172+0000 7f39d2600640 1 -- 172.21.15.40:0/147242587 wait complete. 2024-09-11T22:21:07.922 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T22:21:07.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T22:21:08.475 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:08.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:08 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/147242587' entity='client.admin' 2024-09-11T22:21:08.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:08.998+0000 7f8572800640 1 -- 172.21.15.40:0/2476629564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 msgr2=0x7f856c074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:08.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:08.998+0000 7f8572800640 1 --2- 172.21.15.40:0/2476629564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 0x7f856c074680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f855c009880 tx=0x7f855c02a5d0 comp rx=0 tx=0).stop 2024-09-11T22:21:08.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:08.998+0000 7f8572800640 1 -- 172.21.15.40:0/2476629564 shutdown_connections 2024-09-11T22:21:08.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:08.998+0000 7f8572800640 1 --2- 172.21.15.40:0/2476629564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 0x7f856c074680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:09.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:08.998+0000 7f8572800640 1 -- 172.21.15.40:0/2476629564 >> 172.21.15.40:0/2476629564 conn(0x7f856c0fcd80 msgr2=0x7f856c0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:09.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:08.999+0000 7f8572800640 1 -- 172.21.15.40:0/2476629564 shutdown_connections 2024-09-11T22:21:09.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:08.999+0000 7f8572800640 1 -- 172.21.15.40:0/2476629564 wait complete. 2024-09-11T22:21:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:08.999+0000 7f8572800640 1 Processor -- start 2024-09-11T22:21:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.000+0000 7f8572800640 1 -- start start 2024-09-11T22:21:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.000+0000 7f8572800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 0x7f856c19d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.000+0000 7f8572800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f856c10dd50 con 0x7f856c076220 2024-09-11T22:21:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.000+0000 7f856b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 0x7f856c19d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.000+0000 7f856b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 0x7f856c19d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43292/0 (socket says 172.21.15.40:43292) 2024-09-11T22:21:09.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.000+0000 7f856b400640 1 -- 172.21.15.40:0/2244432952 learned_addr learned my addr 172.21.15.40:0/2244432952 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.001+0000 7f856b400640 1 -- 172.21.15.40:0/2244432952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c19d8f0 con 0x7f856c076220 2024-09-11T22:21:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.001+0000 7f856b400640 1 --2- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 0x7f856c19d3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f855c004f60 tx=0x7f855c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.001+0000 7f8568c00640 1 -- 172.21.15.40:0/2244432952 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f855c03f070 con 0x7f856c076220 2024-09-11T22:21:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.001+0000 7f8568c00640 1 -- 172.21.15.40:0/2244432952 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c004cc0 con 0x7f856c076220 2024-09-11T22:21:09.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.001+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c19db80 con 0x7f856c076220 2024-09-11T22:21:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.001+0000 7f8568c00640 1 -- 172.21.15.40:0/2244432952 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f855c035030 con 0x7f856c076220 2024-09-11T22:21:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.001+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c1a0870 con 0x7f856c076220 2024-09-11T22:21:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.002+0000 7f8568c00640 1 -- 172.21.15.40:0/2244432952 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f855c042070 con 0x7f856c076220 2024-09-11T22:21:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.003+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856c10e490 con 0x7f856c076220 2024-09-11T22:21:09.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.003+0000 7f8568c00640 1 --2- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f85500390c0 0x7f855003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:09.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.003+0000 7f8568c00640 1 -- 172.21.15.40:0/2244432952 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f855c06cf70 con 0x7f856c076220 2024-09-11T22:21:09.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.003+0000 7f8563e00640 1 --2- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f85500390c0 0x7f855003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:09.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.004+0000 7f8563e00640 1 --2- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f85500390c0 0x7f855003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f85540098c0 tx=0x7f8554006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:09.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.008+0000 7f8568c00640 1 -- 172.21.15.40:0/2244432952 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f855c0433b0 con 0x7f856c076220 2024-09-11T22:21:09.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.194+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f856c02d830 con 0x7f85500390c0 2024-09-11T22:21:09.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.198+0000 7f8568c00640 1 -- 172.21.15.40:0/2244432952 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f856c02d830 con 0x7f85500390c0 2024-09-11T22:21:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f85500390c0 msgr2=0x7f855003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 --2- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f85500390c0 0x7f855003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f85540098c0 tx=0x7f8554006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:09.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 msgr2=0x7f856c19d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 --2- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 0x7f856c19d3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f855c004f60 tx=0x7f855c0048f0 comp rx=0 tx=0).stop 2024-09-11T22:21:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 shutdown_connections 2024-09-11T22:21:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 --2- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f85500390c0 0x7f855003b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 --2- 172.21.15.40:0/2244432952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c076220 0x7f856c19d3b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 >> 172.21.15.40:0/2244432952 conn(0x7f856c0fcd80 msgr2=0x7f856c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 shutdown_connections 2024-09-11T22:21:09.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:09.201+0000 7f8572800640 1 -- 172.21.15.40:0/2244432952 wait complete. 2024-09-11T22:21:09.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi040", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:21:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:09.953 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi146 2024-09-11T22:21:09.954 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:21:09.954 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/etc/ceph/ceph.conf 2024-09-11T22:21:09.973 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:21:09.973 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:10.031 INFO:tasks.cephadm:Adding host smithi146 to orchestrator... 2024-09-11T22:21:10.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch host add smithi146 2024-09-11T22:21:10.417 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:10.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:10 smithi040 ceph-mon[30787]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:10.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:10 smithi040 ceph-mon[30787]: Updating smithi040:/etc/ceph/ceph.conf 2024-09-11T22:21:10.641 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:10 smithi040 ceph-mon[30787]: Updating smithi040:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:11.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.008+0000 7f621d000640 1 -- 172.21.15.40:0/3302210972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 msgr2=0x7f6218109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.008+0000 7f621d000640 1 --2- 172.21.15.40:0/3302210972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 0x7f6218109a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6208009880 tx=0x7f620802a5d0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.008+0000 7f621d000640 1 -- 172.21.15.40:0/3302210972 shutdown_connections 2024-09-11T22:21:11.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.008+0000 7f621d000640 1 --2- 172.21.15.40:0/3302210972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 0x7f6218109a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.008+0000 7f621d000640 1 -- 172.21.15.40:0/3302210972 >> 172.21.15.40:0/3302210972 conn(0x7f62180ff290 msgr2=0x7f62181016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.008+0000 7f621d000640 1 -- 172.21.15.40:0/3302210972 shutdown_connections 2024-09-11T22:21:11.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.008+0000 7f621d000640 1 -- 172.21.15.40:0/3302210972 wait complete. 2024-09-11T22:21:11.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.009+0000 7f621d000640 1 Processor -- start 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.009+0000 7f621d000640 1 -- start start 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.010+0000 7f621d000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 0x7f6218199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.010+0000 7f621d000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f621810dc70 con 0x7f6218109660 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.010+0000 7f6217400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 0x7f6218199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.010+0000 7f6217400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 0x7f6218199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43302/0 (socket says 172.21.15.40:43302) 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.010+0000 7f6217400640 1 -- 172.21.15.40:0/1928398710 learned_addr learned my addr 172.21.15.40:0/1928398710 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.010+0000 7f6217400640 1 -- 172.21.15.40:0/1928398710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62181996b0 con 0x7f6218109660 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.011+0000 7f6217400640 1 --2- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 0x7f6218199170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6208009230 tx=0x7f6208003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.011+0000 7f620fe00640 1 -- 172.21.15.40:0/1928398710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f620803f070 con 0x7f6218109660 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.011+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62181999a0 con 0x7f6218109660 2024-09-11T22:21:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.011+0000 7f620fe00640 1 -- 172.21.15.40:0/1928398710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f620803bd40 con 0x7f6218109660 2024-09-11T22:21:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.011+0000 7f620fe00640 1 -- 172.21.15.40:0/1928398710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6208035030 con 0x7f6218109660 2024-09-11T22:21:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.011+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621819da40 con 0x7f6218109660 2024-09-11T22:21:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.012+0000 7f620fe00640 1 -- 172.21.15.40:0/1928398710 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6208042070 con 0x7f6218109660 2024-09-11T22:21:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.012+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6218104d10 con 0x7f6218109660 2024-09-11T22:21:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.013+0000 7f620fe00640 1 --2- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61fc0390c0 0x7f61fc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.013+0000 7f620fe00640 1 -- 172.21.15.40:0/1928398710 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f620806c8f0 con 0x7f6218109660 2024-09-11T22:21:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.013+0000 7f6216a00640 1 --2- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61fc0390c0 0x7f61fc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.014+0000 7f6216a00640 1 --2- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61fc0390c0 0x7f61fc03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62040098c0 tx=0x7f6204006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.019+0000 7f620fe00640 1 -- 172.21.15.40:0/1928398710 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6208044e10 con 0x7f6218109660 2024-09-11T22:21:11.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:11.209+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}) -- 0x7f6218109ac0 con 0x7f61fc0390c0 2024-09-11T22:21:11.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:11 smithi040 ceph-mon[30787]: Updating smithi040:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:11.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:11 smithi040 ceph-mon[30787]: Updating smithi040:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:21:11.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:11.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:11.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:12 smithi040 ceph-mon[30787]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi146", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:13.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:13 smithi040 ceph-mon[30787]: Deploying cephadm binary to smithi146 2024-09-11T22:21:15.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.139+0000 7f620fe00640 1 -- 172.21.15.40:0/1928398710 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f6218109ac0 con 0x7f61fc0390c0 2024-09-11T22:21:15.141 INFO:teuthology.orchestra.run.smithi040.stdout:Added host 'smithi146' with addr '172.21.15.146' 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61fc0390c0 msgr2=0x7f61fc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 --2- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61fc0390c0 0x7f61fc03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62040098c0 tx=0x7f6204006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 msgr2=0x7f6218199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 --2- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 0x7f6218199170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6208009230 tx=0x7f6208003d80 comp rx=0 tx=0).stop 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 shutdown_connections 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 --2- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61fc0390c0 0x7f61fc03b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 --2- 172.21.15.40:0/1928398710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6218109660 0x7f6218199170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 >> 172.21.15.40:0/1928398710 conn(0x7f62180ff290 msgr2=0x7f6218100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 shutdown_connections 2024-09-11T22:21:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:15.142+0000 7f621d000640 1 -- 172.21.15.40:0/1928398710 wait complete. 2024-09-11T22:21:15.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T22:21:16.183 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:16.450 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:16.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:16 smithi040 ceph-mon[30787]: Added host smithi146 2024-09-11T22:21:16.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:16.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:16.451 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.702+0000 7fda62400640 1 -- 172.21.15.40:0/1909080155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 msgr2=0x7fda5c107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.702+0000 7fda62400640 1 --2- 172.21.15.40:0/1909080155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 0x7fda5c107a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009880 tx=0x7fda4c02a5d0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.702+0000 7fda62400640 1 -- 172.21.15.40:0/1909080155 shutdown_connections 2024-09-11T22:21:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.702+0000 7fda62400640 1 --2- 172.21.15.40:0/1909080155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 0x7fda5c107a20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.702+0000 7fda62400640 1 -- 172.21.15.40:0/1909080155 >> 172.21.15.40:0/1909080155 conn(0x7fda5c0fd230 msgr2=0x7fda5c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.702+0000 7fda62400640 1 -- 172.21.15.40:0/1909080155 shutdown_connections 2024-09-11T22:21:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.702+0000 7fda62400640 1 -- 172.21.15.40:0/1909080155 wait complete. 2024-09-11T22:21:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.703+0000 7fda62400640 1 Processor -- start 2024-09-11T22:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.703+0000 7fda62400640 1 -- start start 2024-09-11T22:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.704+0000 7fda62400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 0x7fda5c197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.704+0000 7fda62400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c10bc70 con 0x7fda5c107640 2024-09-11T22:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.704+0000 7fda5b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 0x7fda5c197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.704+0000 7fda5b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 0x7fda5c197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44856/0 (socket says 172.21.15.40:44856) 2024-09-11T22:21:16.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.704+0000 7fda5b400640 1 -- 172.21.15.40:0/2273896900 learned_addr learned my addr 172.21.15.40:0/2273896900 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:16.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.704+0000 7fda5b400640 1 -- 172.21.15.40:0/2273896900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c197650 con 0x7fda5c107640 2024-09-11T22:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.705+0000 7fda5b400640 1 --2- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 0x7fda5c197110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009230 tx=0x7fda4c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.705+0000 7fda53e00640 1 -- 172.21.15.40:0/2273896900 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda4c03f070 con 0x7fda5c107640 2024-09-11T22:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.705+0000 7fda53e00640 1 -- 172.21.15.40:0/2273896900 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda4c03bd40 con 0x7fda5c107640 2024-09-11T22:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.705+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5c1978e0 con 0x7fda5c107640 2024-09-11T22:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.705+0000 7fda53e00640 1 -- 172.21.15.40:0/2273896900 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda4c035030 con 0x7fda5c107640 2024-09-11T22:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.705+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5c19b9e0 con 0x7fda5c107640 2024-09-11T22:21:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.706+0000 7fda53e00640 1 -- 172.21.15.40:0/2273896900 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fda4c042070 con 0x7fda5c107640 2024-09-11T22:21:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.706+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda5c102cb0 con 0x7fda5c107640 2024-09-11T22:21:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.707+0000 7fda53e00640 1 --2- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fda40039060 0x7fda4003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.707+0000 7fda53e00640 1 -- 172.21.15.40:0/2273896900 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fda4c06cd20 con 0x7fda5c107640 2024-09-11T22:21:16.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.707+0000 7fda5aa00640 1 --2- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fda40039060 0x7fda4003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:16.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.708+0000 7fda5aa00640 1 --2- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fda40039060 0x7fda4003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fda480098c0 tx=0x7fda48006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.712+0000 7fda53e00640 1 -- 172.21.15.40:0/2273896900 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda4c030d60 con 0x7fda5c107640 2024-09-11T22:21:16.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.899+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda5c198470 con 0x7fda40039060 2024-09-11T22:21:16.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.901+0000 7fda53e00640 1 -- 172.21.15.40:0/2273896900 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fda5c198470 con 0x7fda40039060 2024-09-11T22:21:16.901 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:16.902 INFO:teuthology.orchestra.run.smithi040.stdout:[{"addr": "172.21.15.40", "hostname": "smithi040", "labels": [], "status": ""}, {"addr": "172.21.15.146", "hostname": "smithi146", "labels": [], "status": ""}] 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fda40039060 msgr2=0x7fda4003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 --2- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fda40039060 0x7fda4003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fda480098c0 tx=0x7fda48006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 msgr2=0x7fda5c197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 --2- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 0x7fda5c197110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009230 tx=0x7fda4c003d80 comp rx=0 tx=0).stop 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 shutdown_connections 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 --2- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fda40039060 0x7fda4003b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 --2- 172.21.15.40:0/2273896900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda5c107640 0x7fda5c197110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 >> 172.21.15.40:0/2273896900 conn(0x7fda5c0fd230 msgr2=0x7fda5c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 shutdown_connections 2024-09-11T22:21:16.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:16.903+0000 7fda62400640 1 -- 172.21.15.40:0/2273896900 wait complete. 2024-09-11T22:21:17.531 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi177 2024-09-11T22:21:17.532 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:21:17.532 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/etc/ceph/ceph.conf 2024-09-11T22:21:17.549 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:21:17.549 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:17.605 INFO:tasks.cephadm:Adding host smithi177 to orchestrator... 2024-09-11T22:21:17.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch host add smithi177 2024-09-11T22:21:17.970 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:17.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:17 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.452+0000 7f5d6b000640 1 -- 172.21.15.40:0/183180779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 msgr2=0x7f5d64107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:18.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.452+0000 7f5d6b000640 1 --2- 172.21.15.40:0/183180779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 0x7f5d64107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009880 tx=0x7f5d5402a5d0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.453+0000 7f5d6b000640 1 -- 172.21.15.40:0/183180779 shutdown_connections 2024-09-11T22:21:18.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.453+0000 7f5d6b000640 1 --2- 172.21.15.40:0/183180779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 0x7f5d64107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:18.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.453+0000 7f5d6b000640 1 -- 172.21.15.40:0/183180779 >> 172.21.15.40:0/183180779 conn(0x7f5d640fd290 msgr2=0x7f5d640ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:18.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.453+0000 7f5d6b000640 1 -- 172.21.15.40:0/183180779 shutdown_connections 2024-09-11T22:21:18.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.453+0000 7f5d6b000640 1 -- 172.21.15.40:0/183180779 wait complete. 2024-09-11T22:21:18.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.454+0000 7f5d6b000640 1 Processor -- start 2024-09-11T22:21:18.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.454+0000 7f5d6b000640 1 -- start start 2024-09-11T22:21:18.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.454+0000 7f5d6b000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 0x7f5d64199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.454+0000 7f5d6b000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6410bc90 con 0x7f5d64107660 2024-09-11T22:21:18.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.454+0000 7f5d63e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 0x7f5d64199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.454+0000 7f5d63e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 0x7f5d64199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44868/0 (socket says 172.21.15.40:44868) 2024-09-11T22:21:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.454+0000 7f5d63e00640 1 -- 172.21.15.40:0/3540910668 learned_addr learned my addr 172.21.15.40:0/3540910668 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.455+0000 7f5d63e00640 1 -- 172.21.15.40:0/3540910668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d64199860 con 0x7f5d64107660 2024-09-11T22:21:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.455+0000 7f5d63e00640 1 --2- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 0x7f5d64199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009230 tx=0x7f5d54003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.455+0000 7f5d60c00640 1 -- 172.21.15.40:0/3540910668 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d5403f070 con 0x7f5d64107660 2024-09-11T22:21:18.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.455+0000 7f5d60c00640 1 -- 172.21.15.40:0/3540910668 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d5403bd40 con 0x7f5d64107660 2024-09-11T22:21:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.455+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d64199af0 con 0x7f5d64107660 2024-09-11T22:21:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.455+0000 7f5d60c00640 1 -- 172.21.15.40:0/3540910668 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d54035030 con 0x7f5d64107660 2024-09-11T22:21:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.455+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6419dbf0 con 0x7f5d64107660 2024-09-11T22:21:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.457+0000 7f5d60c00640 1 -- 172.21.15.40:0/3540910668 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5d54042070 con 0x7f5d64107660 2024-09-11T22:21:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.457+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d64102cd0 con 0x7f5d64107660 2024-09-11T22:21:18.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.457+0000 7f5d60c00640 1 --2- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d48039060 0x7f5d4803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.457+0000 7f5d60c00640 1 -- 172.21.15.40:0/3540910668 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5d5406c960 con 0x7f5d64107660 2024-09-11T22:21:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.457+0000 7f5d63400640 1 --2- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d48039060 0x7f5d4803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:18.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.458+0000 7f5d63400640 1 --2- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d48039060 0x7f5d4803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5d500098c0 tx=0x7f5d50006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:18.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.462+0000 7f5d60c00640 1 -- 172.21.15.40:0/3540910668 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d540412c0 con 0x7f5d64107660 2024-09-11T22:21:18.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:18.651+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi177", "target": ["mon-mgr", ""]}) -- 0x7f5d6419a680 con 0x7f5d48039060 2024-09-11T22:21:18.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:18 smithi040 ceph-mon[30787]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:18.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:18 smithi040 ceph-mon[30787]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:21:19.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:19 smithi040 ceph-mon[30787]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi177", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:19.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:19 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:19.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:19 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:19.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:19 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:19.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:19 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:19.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:19 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi146", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:21:19.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:19 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:19.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:19 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:20.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:20 smithi040 ceph-mon[30787]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:20.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:20 smithi040 ceph-mon[30787]: Updating smithi146:/etc/ceph/ceph.conf 2024-09-11T22:21:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:20 smithi040 ceph-mon[30787]: Updating smithi146:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:20 smithi040 ceph-mon[30787]: Updating smithi146:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:21.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:21 smithi040 ceph-mon[30787]: Deploying cephadm binary to smithi177 2024-09-11T22:21:21.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:21 smithi040 ceph-mon[30787]: Updating smithi146:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:21:22.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.648+0000 7f5d60c00640 1 -- 172.21.15.40:0/3540910668 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f5d6419a680 con 0x7f5d48039060 2024-09-11T22:21:22.649 INFO:teuthology.orchestra.run.smithi040.stdout:Added host 'smithi177' with addr '172.21.15.177' 2024-09-11T22:21:22.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.650+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d48039060 msgr2=0x7f5d4803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:22.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.651+0000 7f5d6b000640 1 --2- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d48039060 0x7f5d4803b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5d500098c0 tx=0x7f5d50006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.651+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 msgr2=0x7f5d64199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.651+0000 7f5d6b000640 1 --2- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 0x7f5d64199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009230 tx=0x7f5d54003d80 comp rx=0 tx=0).stop 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.651+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 shutdown_connections 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.651+0000 7f5d6b000640 1 --2- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d48039060 0x7f5d4803b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.651+0000 7f5d6b000640 1 --2- 172.21.15.40:0/3540910668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d64107660 0x7f5d64199320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.651+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 >> 172.21.15.40:0/3540910668 conn(0x7f5d640fd290 msgr2=0x7f5d64075e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.651+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 shutdown_connections 2024-09-11T22:21:22.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:22.651+0000 7f5d6b000640 1 -- 172.21.15.40:0/3540910668 wait complete. 2024-09-11T22:21:22.949 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:22 smithi040 ceph-mon[30787]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:23.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T22:21:23.630 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:23.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:23 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:23.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:23 smithi040 ceph-mon[30787]: Added host smithi177 2024-09-11T22:21:23.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:23 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:23.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:23 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:23.908 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:23 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:24.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.241+0000 7f6d61c00640 1 -- 172.21.15.40:0/3879859977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 msgr2=0x7f6d5c109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:24.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.241+0000 7f6d61c00640 1 --2- 172.21.15.40:0/3879859977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 0x7f6d5c109b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009c20 tx=0x7f6d4c02aa90 comp rx=0 tx=0).stop 2024-09-11T22:21:24.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.241+0000 7f6d61c00640 1 -- 172.21.15.40:0/3879859977 shutdown_connections 2024-09-11T22:21:24.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.241+0000 7f6d61c00640 1 --2- 172.21.15.40:0/3879859977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 0x7f6d5c109b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:24.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.241+0000 7f6d61c00640 1 -- 172.21.15.40:0/3879859977 >> 172.21.15.40:0/3879859977 conn(0x7f6d5c0ff450 msgr2=0x7f6d5c101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:24.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.241+0000 7f6d61c00640 1 -- 172.21.15.40:0/3879859977 shutdown_connections 2024-09-11T22:21:24.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.241+0000 7f6d61c00640 1 -- 172.21.15.40:0/3879859977 wait complete. 2024-09-11T22:21:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.242+0000 7f6d61c00640 1 Processor -- start 2024-09-11T22:21:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.242+0000 7f6d61c00640 1 -- start start 2024-09-11T22:21:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.242+0000 7f6d61c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 0x7f6d5c1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.242+0000 7f6d61c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c10de30 con 0x7f6d5c109770 2024-09-11T22:21:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.243+0000 7f6d5aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 0x7f6d5c1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.243+0000 7f6d5aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 0x7f6d5c1993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39728/0 (socket says 172.21.15.40:39728) 2024-09-11T22:21:24.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.243+0000 7f6d5aa00640 1 -- 172.21.15.40:0/3610007340 learned_addr learned my addr 172.21.15.40:0/3610007340 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:24.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.243+0000 7f6d5aa00640 1 -- 172.21.15.40:0/3610007340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c1998e0 con 0x7f6d5c109770 2024-09-11T22:21:24.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.243+0000 7f6d5aa00640 1 --2- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 0x7f6d5c1993a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009d40 tx=0x7f6d4c02fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:24.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.244+0000 7f6d53e00640 1 -- 172.21.15.40:0/3610007340 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d4c047070 con 0x7f6d5c109770 2024-09-11T22:21:24.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.244+0000 7f6d53e00640 1 -- 172.21.15.40:0/3610007340 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d4c003e40 con 0x7f6d5c109770 2024-09-11T22:21:24.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.244+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5c199b70 con 0x7f6d5c109770 2024-09-11T22:21:24.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.244+0000 7f6d53e00640 1 -- 172.21.15.40:0/3610007340 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d4c033050 con 0x7f6d5c109770 2024-09-11T22:21:24.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.244+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5c199fd0 con 0x7f6d5c109770 2024-09-11T22:21:24.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.245+0000 7f6d53e00640 1 -- 172.21.15.40:0/3610007340 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6d4c04a070 con 0x7f6d5c109770 2024-09-11T22:21:24.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.245+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5c104eb0 con 0x7f6d5c109770 2024-09-11T22:21:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.246+0000 7f6d53e00640 1 --2- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6d40039060 0x7f6d4003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.246+0000 7f6d53e00640 1 -- 172.21.15.40:0/3610007340 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6d4c03e030 con 0x7f6d5c109770 2024-09-11T22:21:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.246+0000 7f6d52000640 1 --2- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6d40039060 0x7f6d4003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:24.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.246+0000 7f6d52000640 1 --2- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6d40039060 0x7f6d4003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6d440098c0 tx=0x7f6d44006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:24.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.251+0000 7f6d53e00640 1 -- 172.21.15.40:0/3610007340 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d4c004180 con 0x7f6d5c109770 2024-09-11T22:21:24.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.440+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d5c19a700 con 0x7f6d40039060 2024-09-11T22:21:24.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.442+0000 7f6d53e00640 1 -- 172.21.15.40:0/3610007340 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f6d5c19a700 con 0x7f6d40039060 2024-09-11T22:21:24.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:24.442 INFO:teuthology.orchestra.run.smithi040.stdout:[{"addr": "172.21.15.40", "hostname": "smithi040", "labels": [], "status": ""}, {"addr": "172.21.15.146", "hostname": "smithi146", "labels": [], "status": ""}, {"addr": "172.21.15.177", "hostname": "smithi177", "labels": [], "status": ""}] 2024-09-11T22:21:24.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6d40039060 msgr2=0x7f6d4003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 --2- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6d40039060 0x7f6d4003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6d440098c0 tx=0x7f6d44006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 msgr2=0x7f6d5c1993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 --2- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 0x7f6d5c1993a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009d40 tx=0x7f6d4c02fc10 comp rx=0 tx=0).stop 2024-09-11T22:21:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 shutdown_connections 2024-09-11T22:21:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 --2- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6d40039060 0x7f6d4003b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 --2- 172.21.15.40:0/3610007340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c109770 0x7f6d5c1993a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 >> 172.21.15.40:0/3610007340 conn(0x7f6d5c0ff450 msgr2=0x7f6d5c107280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 shutdown_connections 2024-09-11T22:21:24.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:24.444+0000 7f6d61c00640 1 -- 172.21.15.40:0/3610007340 wait complete. 2024-09-11T22:21:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:24 smithi040 ceph-mon[30787]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:25.109 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T22:21:25.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T22:21:25.474 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:25.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:25 smithi040 ceph-mon[30787]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:21:26.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.129+0000 7fe0bf000640 1 -- 172.21.15.40:0/906575893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 msgr2=0x7fe0b8074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:26.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.129+0000 7fe0bf000640 1 --2- 172.21.15.40:0/906575893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 0x7fe0b8074970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009880 tx=0x7fe0a802a670 comp rx=0 tx=0).stop 2024-09-11T22:21:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.129+0000 7fe0bf000640 1 -- 172.21.15.40:0/906575893 shutdown_connections 2024-09-11T22:21:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.129+0000 7fe0bf000640 1 --2- 172.21.15.40:0/906575893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 0x7fe0b8074970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.129+0000 7fe0bf000640 1 -- 172.21.15.40:0/906575893 >> 172.21.15.40:0/906575893 conn(0x7fe0b80fd290 msgr2=0x7fe0b80ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.129+0000 7fe0bf000640 1 -- 172.21.15.40:0/906575893 shutdown_connections 2024-09-11T22:21:26.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.130+0000 7fe0bf000640 1 -- 172.21.15.40:0/906575893 wait complete. 2024-09-11T22:21:26.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.130+0000 7fe0bf000640 1 Processor -- start 2024-09-11T22:21:26.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.131+0000 7fe0bf000640 1 -- start start 2024-09-11T22:21:26.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.131+0000 7fe0bf000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 0x7fe0b81a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:26.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.131+0000 7fe0bf000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81122b0 con 0x7fe0b8074590 2024-09-11T22:21:26.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.131+0000 7fe0b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 0x7fe0b81a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:26.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.131+0000 7fe0b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 0x7fe0b81a3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39740/0 (socket says 172.21.15.40:39740) 2024-09-11T22:21:26.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.131+0000 7fe0b7e00640 1 -- 172.21.15.40:0/361768852 learned_addr learned my addr 172.21.15.40:0/361768852 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:26.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.132+0000 7fe0b7e00640 1 -- 172.21.15.40:0/361768852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b81a3950 con 0x7fe0b8074590 2024-09-11T22:21:26.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.132+0000 7fe0b7e00640 1 --2- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 0x7fe0b81a3410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009230 tx=0x7fe0a8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:26.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.132+0000 7fe0b4c00640 1 -- 172.21.15.40:0/361768852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a803f070 con 0x7fe0b8074590 2024-09-11T22:21:26.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.132+0000 7fe0b4c00640 1 -- 172.21.15.40:0/361768852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0a803bc80 con 0x7fe0b8074590 2024-09-11T22:21:26.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.132+0000 7fe0b4c00640 1 -- 172.21.15.40:0/361768852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a8035030 con 0x7fe0b8074590 2024-09-11T22:21:26.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.132+0000 7fe0bf000640 1 -- 172.21.15.40:0/361768852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b81a3be0 con 0x7fe0b8074590 2024-09-11T22:21:26.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.133+0000 7fe0bf000640 1 -- 172.21.15.40:0/361768852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b819d5d0 con 0x7fe0b8074590 2024-09-11T22:21:26.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.133+0000 7fe0b4c00640 1 -- 172.21.15.40:0/361768852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe0a8042070 con 0x7fe0b8074590 2024-09-11T22:21:26.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.134+0000 7fe0ae000640 1 -- 172.21.15.40:0/361768852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe090005290 con 0x7fe0b8074590 2024-09-11T22:21:26.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.134+0000 7fe0b4c00640 1 --2- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe09c0390c0 0x7fe09c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:26.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.134+0000 7fe0b4c00640 1 -- 172.21.15.40:0/361768852 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe0a806d180 con 0x7fe0b8074590 2024-09-11T22:21:26.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.134+0000 7fe0b7400640 1 --2- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe09c0390c0 0x7fe09c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:26.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.135+0000 7fe0b7400640 1 --2- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe09c0390c0 0x7fe09c03b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40098c0 tx=0x7fe0a4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:26.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.140+0000 7fe0b4c00640 1 -- 172.21.15.40:0/361768852 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0a80372d0 con 0x7fe0b8074590 2024-09-11T22:21:26.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.330+0000 7fe0ae000640 1 -- 172.21.15.40:0/361768852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe090005580 con 0x7fe0b8074590 2024-09-11T22:21:26.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.657+0000 7fe0b4c00640 1 -- 172.21.15.40:0/361768852 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fe0a8031dd0 con 0x7fe0b8074590 2024-09-11T22:21:26.657 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-09-11T22:21:26.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.659+0000 7fe0ae000640 1 -- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe09c0390c0 msgr2=0x7fe09c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:26.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.659+0000 7fe0ae000640 1 --2- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe09c0390c0 0x7fe09c03b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40098c0 tx=0x7fe0a4006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.659+0000 7fe0ae000640 1 -- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 msgr2=0x7fe0b81a3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:26.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.659+0000 7fe0ae000640 1 --2- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 0x7fe0b81a3410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009230 tx=0x7fe0a8003d40 comp rx=0 tx=0).stop 2024-09-11T22:21:26.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.659+0000 7fe0ae000640 1 -- 172.21.15.40:0/361768852 shutdown_connections 2024-09-11T22:21:26.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.660+0000 7fe0ae000640 1 --2- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe09c0390c0 0x7fe09c03b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.660+0000 7fe0ae000640 1 --2- 172.21.15.40:0/361768852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b8074590 0x7fe0b81a3410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:26.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.660+0000 7fe0ae000640 1 -- 172.21.15.40:0/361768852 >> 172.21.15.40:0/361768852 conn(0x7fe0b80fd290 msgr2=0x7fe0b80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:26.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.660+0000 7fe0ae000640 1 -- 172.21.15.40:0/361768852 shutdown_connections 2024-09-11T22:21:26.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:26.660+0000 7fe0ae000640 1 -- 172.21.15.40:0/361768852 wait complete. 2024-09-11T22:21:26.955 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:26 smithi040 ceph-mon[30787]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:26.955 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:26 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/361768852' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T22:21:27.345 INFO:tasks.cephadm:Adding mon.a on smithi040 2024-09-11T22:21:27.345 INFO:tasks.cephadm:Adding mon.b on smithi146 2024-09-11T22:21:27.345 INFO:tasks.cephadm:Adding mon.c on smithi177 2024-09-11T22:21:27.345 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi040:172.21.15.40=a;smithi146:172.21.15.146=b;smithi177:172.21.15.177=c' 2024-09-11T22:21:27.587 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:27.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/361768852' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T22:21:27.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi177", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:27.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:27.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.994+0000 7fa5fcb02640 1 -- 172.21.15.177:0/3693073294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 msgr2=0x7fa5f8106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:27.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.994+0000 7fa5fcb02640 1 --2- 172.21.15.177:0/3693073294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 0x7fa5f8106940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009c20 tx=0x7fa5f002aa90 comp rx=0 tx=0).stop 2024-09-11T22:21:27.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.994+0000 7fa5fcb02640 1 -- 172.21.15.177:0/3693073294 shutdown_connections 2024-09-11T22:21:27.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.994+0000 7fa5fcb02640 1 --2- 172.21.15.177:0/3693073294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 0x7fa5f8106940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:27.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.994+0000 7fa5fcb02640 1 -- 172.21.15.177:0/3693073294 >> 172.21.15.177:0/3693073294 conn(0x7fa5f80fc1b0 msgr2=0x7fa5f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:27.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.994+0000 7fa5fcb02640 1 -- 172.21.15.177:0/3693073294 shutdown_connections 2024-09-11T22:21:27.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.994+0000 7fa5fcb02640 1 -- 172.21.15.177:0/3693073294 wait complete. 2024-09-11T22:21:27.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.995+0000 7fa5fcb02640 1 Processor -- start 2024-09-11T22:21:27.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.995+0000 7fa5fcb02640 1 -- start start 2024-09-11T22:21:27.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.995+0000 7fa5fcb02640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 0x7fa5f8195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:27.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.995+0000 7fa5fcb02640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f810ab90 con 0x7fa5f8106560 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.995+0000 7fa5f659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 0x7fa5f8195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.995+0000 7fa5f659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 0x7fa5f8195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.177:34978/0 (socket says 172.21.15.177:34978) 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.995+0000 7fa5f659c640 1 -- 172.21.15.177:0/387237229 learned_addr learned my addr 172.21.15.177:0/387237229 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.996+0000 7fa5f659c640 1 -- 172.21.15.177:0/387237229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f8196520 con 0x7fa5f8106560 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.996+0000 7fa5f659c640 1 --2- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 0x7fa5f8195fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009d40 tx=0x7fa5f002fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.996+0000 7fa5ef7fe640 1 -- 172.21.15.177:0/387237229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f0047070 con 0x7fa5f8106560 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.996+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f81967b0 con 0x7fa5f8106560 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.996+0000 7fa5ef7fe640 1 -- 172.21.15.177:0/387237229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5f0003e40 con 0x7fa5f8106560 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.996+0000 7fa5ef7fe640 1 -- 172.21.15.177:0/387237229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f0033050 con 0x7fa5f8106560 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.996+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f8196c30 con 0x7fa5f8106560 2024-09-11T22:21:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.997+0000 7fa5ef7fe640 1 -- 172.21.15.177:0/387237229 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa5f004a070 con 0x7fa5f8106560 2024-09-11T22:21:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.997+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f8101bd0 con 0x7fa5f8106560 2024-09-11T22:21:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.997+0000 7fa5ef7fe640 1 --2- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa5e40390c0 0x7fa5e403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.997+0000 7fa5ef7fe640 1 -- 172.21.15.177:0/387237229 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa5f003e030 con 0x7fa5f8106560 2024-09-11T22:21:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.998+0000 7fa5f5d9b640 1 --2- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa5e40390c0 0x7fa5e403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:27.998+0000 7fa5f5d9b640 1 --2- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa5e40390c0 0x7fa5e403b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00098c0 tx=0x7fa5e0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:28.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.003+0000 7fa5ef7fe640 1 -- 172.21.15.177:0/387237229 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5f0001250 con 0x7fa5f8106560 2024-09-11T22:21:28.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.182+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi040:172.21.15.40=a;smithi146:172.21.15.146=b;smithi177:172.21.15.177=c", "target": ["mon-mgr", ""]}) -- 0x7fa5f80fe220 con 0x7fa5e40390c0 2024-09-11T22:21:28.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.189+0000 7fa5ef7fe640 1 -- 172.21.15.177:0/387237229 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa5f80fe220 con 0x7fa5e40390c0 2024-09-11T22:21:28.189 INFO:teuthology.orchestra.run.smithi177.stdout:Scheduled mon update... 2024-09-11T22:21:28.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa5e40390c0 msgr2=0x7fa5e403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 --2- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa5e40390c0 0x7fa5e403b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5e00098c0 tx=0x7fa5e0006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 msgr2=0x7fa5f8195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 --2- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 0x7fa5f8195fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009d40 tx=0x7fa5f002fc10 comp rx=0 tx=0).stop 2024-09-11T22:21:28.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 shutdown_connections 2024-09-11T22:21:28.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 --2- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa5e40390c0 0x7fa5e403b580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 --2- 172.21.15.177:0/387237229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f8106560 0x7fa5f8195fe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 >> 172.21.15.177:0/387237229 conn(0x7fa5f80fc1b0 msgr2=0x7fa5f80fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:28.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 shutdown_connections 2024-09-11T22:21:28.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:28.191+0000 7fa5fcb02640 1 -- 172.21.15.177:0/387237229 wait complete. 2024-09-11T22:21:28.756 DEBUG:teuthology.orchestra.run.smithi146:mon.b> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T22:21:28.759 DEBUG:teuthology.orchestra.run.smithi177:mon.c> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T22:21:28.762 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T22:21:28.762 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T22:21:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: Updating smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: Updating smithi177:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: Updating smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:21:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:29 smithi040 ceph-mon[30787]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi040:172.21.15.40=a;smithi146:172.21.15.146=b;smithi177:172.21.15.177=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:29 smithi040 ceph-mon[30787]: Saving service mon spec with placement smithi040:172.21.15.40=a;smithi146:172.21.15.146=b;smithi177:172.21.15.177=c;count:3 2024-09-11T22:21:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:29 smithi040 ceph-mon[30787]: Deploying daemon mon.c on smithi177 2024-09-11T22:21:30.403 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:31.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:30 smithi040 ceph-mon[30787]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.340+0000 7fb101b9f640 1 -- 172.21.15.177:0/240984755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 msgr2=0x7fb0fc106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.340+0000 7fb101b9f640 1 --2- 172.21.15.177:0/240984755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 0x7fb0fc106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009810 tx=0x7fb0ec02a540 comp rx=0 tx=0).stop 2024-09-11T22:21:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.340+0000 7fb101b9f640 1 -- 172.21.15.177:0/240984755 shutdown_connections 2024-09-11T22:21:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.340+0000 7fb101b9f640 1 --2- 172.21.15.177:0/240984755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 0x7fb0fc106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.340+0000 7fb101b9f640 1 -- 172.21.15.177:0/240984755 >> 172.21.15.177:0/240984755 conn(0x7fb0fc077310 msgr2=0x7fb0fc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.340+0000 7fb101b9f640 1 -- 172.21.15.177:0/240984755 shutdown_connections 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.340+0000 7fb101b9f640 1 -- 172.21.15.177:0/240984755 wait complete. 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.340+0000 7fb101b9f640 1 Processor -- start 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.341+0000 7fb101b9f640 1 -- start start 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.341+0000 7fb101b9f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 0x7fb0fc195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.341+0000 7fb101b9f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0fc10ab70 con 0x7fb0fc106540 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.341+0000 7fb0fb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 0x7fb0fc195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.341+0000 7fb0fb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 0x7fb0fc195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.177:35010/0 (socket says 172.21.15.177:35010) 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.341+0000 7fb0fb7fe640 1 -- 172.21.15.177:0/3581658131 learned_addr learned my addr 172.21.15.177:0/3581658131 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.342+0000 7fb0fb7fe640 1 -- 172.21.15.177:0/3581658131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0fc06a4b0 con 0x7fb0fc106540 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.342+0000 7fb0fb7fe640 1 --2- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 0x7fb0fc195dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0045e0 tx=0x7fb0ec004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.342+0000 7fb0f8ff9640 1 -- 172.21.15.177:0/3581658131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0ec030e70 con 0x7fb0fc106540 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.342+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0fc196300 con 0x7fb0fc106540 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.342+0000 7fb0f8ff9640 1 -- 172.21.15.177:0/3581658131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0ec0318e0 con 0x7fb0fc106540 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.342+0000 7fb0f8ff9640 1 -- 172.21.15.177:0/3581658131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0ec0049c0 con 0x7fb0fc106540 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.342+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0fc196760 con 0x7fb0fc106540 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.343+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0fc101bb0 con 0x7fb0fc106540 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.343+0000 7fb0f8ff9640 1 -- 172.21.15.177:0/3581658131 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb0ec039040 con 0x7fb0fc106540 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.343+0000 7fb0f8ff9640 1 --2- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb0e4039060 0x7fb0e403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.343+0000 7fb0f8ff9640 1 -- 172.21.15.177:0/3581658131 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb0ec06d2c0 con 0x7fb0fc106540 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.344+0000 7fb0faffd640 1 --2- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb0e4039060 0x7fb0e403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.344+0000 7fb0faffd640 1 --2- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb0e4039060 0x7fb0e403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00098c0 tx=0x7fb0f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.349+0000 7fb0f8ff9640 1 -- 172.21.15.177:0/3581658131 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb0ec040030 con 0x7fb0fc106540 2024-09-11T22:21:31.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.592+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb0fc069ca0 con 0x7fb0fc106540 2024-09-11T22:21:31.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.592+0000 7fb0f8ff9640 1 -- 172.21.15.177:0/3581658131 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fb0ec03b3b0 con 0x7fb0fc106540 2024-09-11T22:21:31.593 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:21:31.593 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":1,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","modified":"2024-09-11T22:20:01.413928Z","created":"2024-09-11T22:20:01.413928Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T22:21:31.593 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 1 2024-09-11T22:21:31.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb0e4039060 msgr2=0x7fb0e403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:31.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 --2- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb0e4039060 0x7fb0e403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00098c0 tx=0x7fb0f0006db0 comp rx=0 tx=0).stop 2024-09-11T22:21:31.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 msgr2=0x7fb0fc195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:31.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 --2- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 0x7fb0fc195dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0045e0 tx=0x7fb0ec004610 comp rx=0 tx=0).stop 2024-09-11T22:21:31.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 shutdown_connections 2024-09-11T22:21:31.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 --2- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb0e4039060 0x7fb0e403b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:31.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 --2- 172.21.15.177:0/3581658131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0fc106540 0x7fb0fc195dc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:31.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 >> 172.21.15.177:0/3581658131 conn(0x7fb0fc077310 msgr2=0x7fb0fc0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:31.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 shutdown_connections 2024-09-11T22:21:31.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:31.595+0000 7fb101b9f640 1 -- 172.21.15.177:0/3581658131 wait complete. 2024-09-11T22:21:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:31 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/3581658131' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:32.698 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T22:21:33.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: Deploying cephadm binary to smithi177 2024-09-11T22:21:33.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: Updating smithi146:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: Added host smithi177 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/361768852' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/361768852' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T22:21:33.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi177", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:33.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: Updating smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: Updating smithi177:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: Updating smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi040:172.21.15.40=a;smithi146:172.21.15.146=b;smithi177:172.21.15.177=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: Saving service mon spec with placement smithi040:172.21.15.40=a;smithi146:172.21.15.146=b;smithi177:172.21.15.177=c;count:3 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: Deploying daemon mon.c on smithi177 2024-09-11T22:21:33.036 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:33.037 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/3581658131' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:33.037 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 ceph-mon[35530]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T22:21:33.037 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 bash[35511]: 4dbf9b00d293d2e14b2a19c5a29fba77013695690931a7f8d87e5fed9e31fa33 2024-09-11T22:21:33.037 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:32 smithi177 systemd[1]: Started Ceph mon.c for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:21:33.190 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T22:21:33.190 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T22:21:33.449 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:37.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:37.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:37.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: mon.a calling monitor election 2024-09-11T22:21:37.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:37.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:37.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:37.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: mon.c calling monitor election 2024-09-11T22:21:37.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: monmap epoch 2 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: last_changed 2024-09-11T22:21:32.703692+0000 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: min_mon_release 19 (squid) 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: election_strategy: 1 2024-09-11T22:21:37.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: fsmap 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: mgrmap e13: x(active, since 40s) 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: overall HEALTH_OK 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:37.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:38.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:38.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:38.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: mon.a calling monitor election 2024-09-11T22:21:38.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:38.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:38.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:38.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: mon.c calling monitor election 2024-09-11T22:21:38.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:38.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: monmap epoch 2 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: last_changed 2024-09-11T22:21:32.703692+0000 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: min_mon_release 19 (squid) 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: election_strategy: 1 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-11T22:21:38.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: fsmap 2024-09-11T22:21:38.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:38.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: mgrmap e13: x(active, since 40s) 2024-09-11T22:21:38.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: overall HEALTH_OK 2024-09-11T22:21:38.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:38.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:38.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:38.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:38.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.319+0000 7fca2b5f6640 1 -- 172.21.15.177:0/3674689612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca0c003530 msgr2=0x7fca0c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.319+0000 7fca2b5f6640 1 --2- 172.21.15.177:0/3674689612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca0c003530 0x7fca0c0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca241016a0 tx=0x7fca1c02c490 comp rx=0 tx=0).stop 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.320+0000 7fca2b5f6640 1 -- 172.21.15.177:0/3674689612 shutdown_connections 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.320+0000 7fca2b5f6640 1 --2- 172.21.15.177:0/3674689612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca0c003530 0x7fca0c0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.320+0000 7fca2b5f6640 1 -- 172.21.15.177:0/3674689612 >> 172.21.15.177:0/3674689612 conn(0x7fca240fc220 msgr2=0x7fca240fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.320+0000 7fca2b5f6640 1 -- 172.21.15.177:0/3674689612 shutdown_connections 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.320+0000 7fca2b5f6640 1 -- 172.21.15.177:0/3674689612 wait complete. 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.320+0000 7fca2b5f6640 1 Processor -- start 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca2b5f6640 1 -- start start 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca2b5f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 0x7fca24197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca2b5f6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca241977d0 0x7fca2419bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca2b5f6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fca24108670 con 0x7fca241977d0 2024-09-11T22:21:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca2b5f6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fca241084f0 con 0x7fca0c003530 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca29392640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 0x7fca24197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca29392640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 0x7fca24197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59120/0 (socket says 172.21.15.177:59120) 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca29392640 1 -- 172.21.15.177:0/4193529593 learned_addr learned my addr 172.21.15.177:0/4193529593 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca28b91640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca241977d0 0x7fca2419bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca29392640 1 -- 172.21.15.177:0/4193529593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 msgr2=0x7fca24197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca29392640 1 -- 172.21.15.177:0/4193529593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 msgr2=0x7fca24197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca29392640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 0x7fca24197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.321+0000 7fca29392640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 0x7fca24197290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.322+0000 7fca28b91640 1 -- 172.21.15.177:0/4193529593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 msgr2=0x7fca24197290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.322+0000 7fca28b91640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 0x7fca24197290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.322+0000 7fca28b91640 1 -- 172.21.15.177:0/4193529593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24197df0 con 0x7fca241977d0 2024-09-11T22:21:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.322+0000 7fca28b91640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca241977d0 0x7fca2419bb60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca1800b3d0 tx=0x7fca1800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:38.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.322+0000 7fca227fc640 1 -- 172.21.15.177:0/4193529593 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fca18011630 con 0x7fca241977d0 2024-09-11T22:21:38.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.322+0000 7fca227fc640 1 -- 172.21.15.177:0/4193529593 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca18011cb0 con 0x7fca241977d0 2024-09-11T22:21:38.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.322+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2419c0a0 con 0x7fca241977d0 2024-09-11T22:21:38.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.322+0000 7fca227fc640 1 -- 172.21.15.177:0/4193529593 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fca18010df0 con 0x7fca241977d0 2024-09-11T22:21:38.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.322+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2419c660 con 0x7fca241977d0 2024-09-11T22:21:38.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.323+0000 7fca227fc640 1 -- 172.21.15.177:0/4193529593 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fca18018020 con 0x7fca241977d0 2024-09-11T22:21:38.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.323+0000 7fca227fc640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fca10038e00 0x7fca1003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:38.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.323+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2419c970 con 0x7fca241977d0 2024-09-11T22:21:38.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.324+0000 7fca227fc640 1 -- 172.21.15.177:0/4193529593 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fca1804bc80 con 0x7fca241977d0 2024-09-11T22:21:38.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.324+0000 7fca29392640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fca10038e00 0x7fca1003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:38.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.324+0000 7fca29392640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fca10038e00 0x7fca1003b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fca1c012c10 tx=0x7fca1c0323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:38.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.329+0000 7fca227fc640 1 -- 172.21.15.177:0/4193529593 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca1801f020 con 0x7fca241977d0 2024-09-11T22:21:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.561+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fca24198620 con 0x7fca241977d0 2024-09-11T22:21:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.562+0000 7fca227fc640 1 -- 172.21.15.177:0/4193529593 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fca18018310 con 0x7fca241977d0 2024-09-11T22:21:38.562 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:21:38.562 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":2,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","modified":"2024-09-11T22:21:32.703692Z","created":"2024-09-11T22:20:01.413928Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T22:21:38.563 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 2 2024-09-11T22:21:38.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fca10038e00 msgr2=0x7fca1003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fca10038e00 0x7fca1003b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fca1c012c10 tx=0x7fca1c0323a0 comp rx=0 tx=0).stop 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca241977d0 msgr2=0x7fca2419bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca241977d0 0x7fca2419bb60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca1800b3d0 tx=0x7fca1800b890 comp rx=0 tx=0).stop 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 shutdown_connections 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fca10038e00 0x7fca1003b2c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca241977d0 0x7fca2419bb60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 --2- 172.21.15.177:0/4193529593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca0c003530 0x7fca24197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 >> 172.21.15.177:0/4193529593 conn(0x7fca240fc220 msgr2=0x7fca2406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 shutdown_connections 2024-09-11T22:21:38.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:38.564+0000 7fca2b5f6640 1 -- 172.21.15.177:0/4193529593 wait complete. 2024-09-11T22:21:38.911 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:38 smithi177 ceph-mon[35530]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:38.911 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:38 smithi177 ceph-mon[35530]: Deploying daemon mon.b on smithi146 2024-09-11T22:21:38.911 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:38 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/4193529593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:38.911 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:38 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:39.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:38 smithi040 ceph-mon[30787]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:39.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:38 smithi040 ceph-mon[30787]: Deploying daemon mon.b on smithi146 2024-09-11T22:21:39.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:38 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/4193529593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:39.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:38 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:40.190 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T22:21:40.190 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T22:21:40.443 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:40.879 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:40 smithi177 ceph-mon[35530]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:40.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.878+0000 7fb907b6e640 1 -- 172.21.15.177:0/934859537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb900102840 msgr2=0x7fb900102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:40.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.878+0000 7fb907b6e640 1 --2- 172.21.15.177:0/934859537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb900102840 0x7fb900102c20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009880 tx=0x7fb8fc02a670 comp rx=0 tx=0).stop 2024-09-11T22:21:40.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.878+0000 7fb907b6e640 1 -- 172.21.15.177:0/934859537 shutdown_connections 2024-09-11T22:21:40.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.878+0000 7fb907b6e640 1 --2- 172.21.15.177:0/934859537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb900102840 0x7fb900102c20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.878+0000 7fb907b6e640 1 -- 172.21.15.177:0/934859537 >> 172.21.15.177:0/934859537 conn(0x7fb9000fc280 msgr2=0x7fb9000fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.878+0000 7fb907b6e640 1 -- 172.21.15.177:0/934859537 shutdown_connections 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.878+0000 7fb907b6e640 1 -- 172.21.15.177:0/934859537 wait complete. 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb907b6e640 1 Processor -- start 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb907b6e640 1 -- start start 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb907b6e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb900102840 0x7fb9001004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb907b6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 0x7fb900100e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb907b6e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb90010bdb0 con 0x7fb900102840 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb907b6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb90010bc30 con 0x7fb9001009e0 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb905109640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 0x7fb900100e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb905109640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 0x7fb900100e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59134/0 (socket says 172.21.15.177:59134) 2024-09-11T22:21:40.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb905109640 1 -- 172.21.15.177:0/3997619597 learned_addr learned my addr 172.21.15.177:0/3997619597 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb905109640 1 -- 172.21.15.177:0/3997619597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 msgr2=0x7fb900100e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb905109640 1 -- 172.21.15.177:0/3997619597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 msgr2=0x7fb900100e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.879+0000 7fb905109640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 0x7fb900100e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb90590a640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb900102840 0x7fb9001004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb905109640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 0x7fb900100e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb90590a640 1 -- 172.21.15.177:0/3997619597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 msgr2=0x7fb900100e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb90590a640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 0x7fb900100e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb90590a640 1 -- 172.21.15.177:0/3997619597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb900102340 con 0x7fb900102840 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb90590a640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb900102840 0x7fb9001004a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009880 tx=0x7fb8fc032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb8f6ffd640 1 -- 172.21.15.177:0/3997619597 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb8fc035070 con 0x7fb900102840 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9001a3670 con 0x7fb900102840 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb8f6ffd640 1 -- 172.21.15.177:0/3997619597 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8fc032e40 con 0x7fb900102840 2024-09-11T22:21:40.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.880+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9001a3c00 con 0x7fb900102840 2024-09-11T22:21:40.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.881+0000 7fb8f6ffd640 1 -- 172.21.15.177:0/3997619597 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb8fc03bb20 con 0x7fb900102840 2024-09-11T22:21:40.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.882+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb90006a4f0 con 0x7fb900102840 2024-09-11T22:21:40.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.882+0000 7fb8f6ffd640 1 -- 172.21.15.177:0/3997619597 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb8fc042030 con 0x7fb900102840 2024-09-11T22:21:40.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.882+0000 7fb8f6ffd640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb8ec038e00 0x7fb8ec03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:40.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.882+0000 7fb8f6ffd640 1 -- 172.21.15.177:0/3997619597 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb8fc040070 con 0x7fb900102840 2024-09-11T22:21:40.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.882+0000 7fb905109640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb8ec038e00 0x7fb8ec03b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:40.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.883+0000 7fb905109640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb8ec038e00 0x7fb8ec03b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009100 tx=0x7fb8f0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:40.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:40.888+0000 7fb8f6ffd640 1 -- 172.21.15.177:0/3997619597 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb8fc03be20 con 0x7fb900102840 2024-09-11T22:21:41.102 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 systemd[1]: Starting Ceph mon.b for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:21:41.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.115+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb900102ca0 con 0x7fb900102840 2024-09-11T22:21:41.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.115+0000 7fb8f6ffd640 1 -- 172.21.15.177:0/3997619597 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fb8fc02f300 con 0x7fb900102840 2024-09-11T22:21:41.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:21:41.116 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":2,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","modified":"2024-09-11T22:21:32.703692Z","created":"2024-09-11T22:20:01.413928Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T22:21:41.116 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 2 2024-09-11T22:21:41.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.117+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb8ec038e00 msgr2=0x7fb8ec03b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.117+0000 7fb907b6e640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb8ec038e00 0x7fb8ec03b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009100 tx=0x7fb8f0008040 comp rx=0 tx=0).stop 2024-09-11T22:21:41.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.117+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb900102840 msgr2=0x7fb9001004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:41.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.117+0000 7fb907b6e640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb900102840 0x7fb9001004a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009880 tx=0x7fb8fc032c50 comp rx=0 tx=0).stop 2024-09-11T22:21:41.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.117+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 shutdown_connections 2024-09-11T22:21:41.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.117+0000 7fb907b6e640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb8ec038e00 0x7fb8ec03b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.117+0000 7fb907b6e640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9001009e0 0x7fb900100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.117+0000 7fb907b6e640 1 --2- 172.21.15.177:0/3997619597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb900102840 0x7fb9001004a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:41.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.117+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 >> 172.21.15.177:0/3997619597 conn(0x7fb9000fc280 msgr2=0x7fb900105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:41.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.118+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 shutdown_connections 2024-09-11T22:21:41.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:41.118+0000 7fb907b6e640 1 -- 172.21.15.177:0/3997619597 wait complete. 2024-09-11T22:21:41.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:40 smithi040 ceph-mon[30787]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.394 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 podman[34977]: 2024-09-11 22:21:41.192574375 +0000 UTC m=+0.016066014 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:21:41.394 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 podman[34977]: 2024-09-11 22:21:41.294842821 +0000 UTC m=+0.118334465 container create f8bd6c8361dc4932b08d5fec9381874283eeed3ebd976b398f01a88101901af8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T22:21:41.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 podman[34977]: 2024-09-11 22:21:41.497228937 +0000 UTC m=+0.320720575 container init f8bd6c8361dc4932b08d5fec9381874283eeed3ebd976b398f01a88101901af8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-11T22:21:41.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 podman[34977]: 2024-09-11 22:21:41.500464042 +0000 UTC m=+0.323955679 container start f8bd6c8361dc4932b08d5fec9381874283eeed3ebd976b398f01a88101901af8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T22:21:41.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T22:21:41.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T22:21:41.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pidfile_write: ignore empty --pid-file 2024-09-11T22:21:41.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: load: jerasure load: lrc 2024-09-11T22:21:41.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: RocksDB version: 7.9.2 2024-09-11T22:21:41.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Git sha 0 2024-09-11T22:21:41.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: DB SUMMARY 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: DB Session ID: HJZPT5YTTLYYV6I9W9HD 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: CURRENT file: CURRENT 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.error_if_exists: 0 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.create_if_missing: 0 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.paranoid_checks: 1 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T22:21:41.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T22:21:41.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T22:21:41.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.env: 0x55ed41495940 2024-09-11T22:21:41.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T22:21:41.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.info_log: 0x55ed429db6e0 2024-09-11T22:21:41.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T22:21:41.838 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.statistics: (nil) 2024-09-11T22:21:41.838 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.use_fsync: 0 2024-09-11T22:21:41.838 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_log_file_size: 0 2024-09-11T22:21:41.838 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T22:21:41.838 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T22:21:41.838 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T22:21:41.838 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T22:21:41.838 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.allow_fallocate: 1 2024-09-11T22:21:41.838 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.use_direct_reads: 0 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.db_log_dir: 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.wal_dir: 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T22:21:41.839 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.write_buffer_manager: 0x55ed429eadc0 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.unordered_write: 0 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T22:21:41.840 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T22:21:41.841 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T22:21:41.841 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.row_cache: None 2024-09-11T22:21:41.841 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.wal_filter: None 2024-09-11T22:21:41.841 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T22:21:41.841 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T22:21:41.841 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.two_write_queues: 0 2024-09-11T22:21:41.841 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T22:21:41.841 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.wal_compression: 0 2024-09-11T22:21:41.841 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.atomic_flush: 0 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.log_readahead_size: 0 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_background_jobs: 2 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_background_compactions: -1 2024-09-11T22:21:41.842 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_subcompactions: 1 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_open_files: -1 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T22:21:41.843 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_background_flushes: -1 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Compression algorithms supported: 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: kZSTD supported: 0 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: kXpressCompression supported: 0 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: kBZip2Compression supported: 0 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: kLZ4Compression supported: 1 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: kZlibCompression supported: 1 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: kSnappyCompression supported: 1 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T22:21:41.844 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.merge_operator: 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_filter: None 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ed429db320) 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout: cache_index_and_filter_blocks: 1 2024-09-11T22:21:41.845 INFO:journalctl@ceph.mon.b.smithi146.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: pin_top_level_index_and_filter: 1 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: index_type: 0 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: data_block_index_type: 0 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: index_shortening: 1 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: checksum: 4 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: no_block_cache: 0 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: block_cache: 0x55ed429cf1f0 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: block_cache_name: BinnedLRUCache 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: block_cache_options: 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: capacity : 536870912 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: num_shard_bits : 4 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: strict_capacity_limit : 0 2024-09-11T22:21:41.846 INFO:journalctl@ceph.mon.b.smithi146.stdout: high_pri_pool_ratio: 0.000 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: block_cache_compressed: (nil) 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: persistent_cache: (nil) 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: block_size: 4096 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: block_size_deviation: 10 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: block_restart_interval: 16 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: index_block_restart_interval: 1 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: metadata_block_size: 4096 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: partition_filters: 0 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: use_delta_encoding: 1 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: filter_policy: bloomfilter 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: whole_key_filtering: 1 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: verify_compression: 0 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: read_amp_bytes_per_bit: 0 2024-09-11T22:21:41.847 INFO:journalctl@ceph.mon.b.smithi146.stdout: format_version: 5 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout: enable_index_compression: 1 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout: block_align: 0 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout: max_auto_readahead_size: 262144 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout: prepopulate_block_cache: 0 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout: initial_auto_readahead_size: 8192 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression: NoCompression 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.num_levels: 7 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T22:21:41.848 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T22:21:41.849 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T22:21:41.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T22:21:41.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T22:21:41.852 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.inplace_update_support: 0 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.bloom_locality: 0 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.max_successive_merges: 0 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.ttl: 2592000 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T22:21:41.853 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.enable_blob_files: false 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.min_blob_size: 0 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e6f7d9df-ade5-442b-b88b-e4184e0cf098 2024-09-11T22:21:41.854 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093301527304, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093301527717, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726093301, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e6f7d9df-ade5-442b-b88b-e4184e0cf098", "db_session_id": "HJZPT5YTTLYYV6I9W9HD", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726093301527814, "job": 1, "event": "recovery_finished"} 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ed429fce00 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: DB pointer 0x55ed42af8000 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout: ** DB Stats ** 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T22:21:41.855 INFO:journalctl@ceph.mon.b.smithi146.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: ** Compaction Stats [default] ** 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T22:21:41.856 INFO:journalctl@ceph.mon.b.smithi146.stdout: 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: ** Compaction Stats [default] ** 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T22:21:41.857 INFO:journalctl@ceph.mon.b.smithi146.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout: Block cache BinnedLRUCache@0x55ed429cf1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout: 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: using public_addr v2:172.21.15.146:0/0 -> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: starting mon.b rank -1 at public addrs [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] at bind addrs [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:41.858 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(???) e0 preinit fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).mds e1 new map 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout: e1 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout: btime 2024-09-11T22:20:05:624820+0000 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout: legacy client fscid: -1 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout: 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout: No filesystems configured 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T22:21:41.859 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Deploying cephadm binary to smithi177 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Updating smithi146:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Added host smithi177 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:41.860 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/361768852' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/361768852' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.861 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi177", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Updating smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Updating smithi177:/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Updating smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:41.862 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi040:172.21.15.40=a;smithi146:172.21.15.146=b;smithi177:172.21.15.177=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Saving service mon spec with placement smithi040:172.21.15.40=a;smithi146:172.21.15.146=b;smithi177:172.21.15.177=c;count:3 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Deploying daemon mon.c on smithi177 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/3581658131' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.a calling monitor election 2024-09-11T22:21:41.863 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.c calling monitor election 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: monmap epoch 2 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: last_changed 2024-09-11T22:21:32.703692+0000 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:21:41.864 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: min_mon_release 19 (squid) 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: election_strategy: 1 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: fsmap 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mgrmap e13: x(active, since 40s) 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: overall HEALTH_OK 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:41.865 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:41.866 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:41.866 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.866 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: Deploying daemon mon.b on smithi146 2024-09-11T22:21:41.866 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/4193529593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:41.866 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:41.866 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:41.866 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 ceph-mon[34996]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T22:21:41.866 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 bash[34977]: f8bd6c8361dc4932b08d5fec9381874283eeed3ebd976b398f01a88101901af8 2024-09-11T22:21:41.866 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:41 smithi146 systemd[1]: Started Ceph mon.b for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:21:42.737 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T22:21:42.737 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T22:21:42.988 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:46.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.643+0000 7f82473ca640 1 -- 172.21.15.177:0/1354375999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822c003530 msgr2=0x7f822c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.643+0000 7f82473ca640 1 --2- 172.21.15.177:0/1354375999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822c003530 0x7f822c0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82401016a0 tx=0x7f823c02c150 comp rx=0 tx=0).stop 2024-09-11T22:21:46.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.643+0000 7f82473ca640 1 -- 172.21.15.177:0/1354375999 shutdown_connections 2024-09-11T22:21:46.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.643+0000 7f82473ca640 1 --2- 172.21.15.177:0/1354375999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f822c003530 0x7f822c0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.643+0000 7f82473ca640 1 -- 172.21.15.177:0/1354375999 >> 172.21.15.177:0/1354375999 conn(0x7f82400fc220 msgr2=0x7f82400fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:46.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.643+0000 7f82473ca640 1 -- 172.21.15.177:0/1354375999 shutdown_connections 2024-09-11T22:21:46.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.643+0000 7f82473ca640 1 -- 172.21.15.177:0/1354375999 wait complete. 2024-09-11T22:21:46.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.644+0000 7f82473ca640 1 Processor -- start 2024-09-11T22:21:46.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.644+0000 7f82473ca640 1 -- start start 2024-09-11T22:21:46.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f82473ca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 0x7f82401972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f82473ca640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8240197810 0x7f824019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f82473ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f824019c0e0 0x7f824019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f82473ca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8240108670 con 0x7f824019c0e0 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f82473ca640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82401084f0 con 0x7f8240197810 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f82473ca640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f82401087f0 con 0x7f822c003530 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8245166640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 0x7f82401972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8245166640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 0x7f82401972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35668/0 (socket says 172.21.15.177:35668) 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8245166640 1 -- 172.21.15.177:0/165151145 learned_addr learned my addr 172.21.15.177:0/165151145 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8244965640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8240197810 0x7f824019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8245166640 1 -- 172.21.15.177:0/165151145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 msgr2=0x7f82401972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8245166640 1 -- 172.21.15.177:0/165151145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 msgr2=0x7f82401972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8245166640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 0x7f82401972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8245967640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f824019c0e0 0x7f824019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8245166640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 0x7f82401972d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:46.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8244965640 1 -- 172.21.15.177:0/165151145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8240197810 msgr2=0x7f824019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8244965640 1 -- 172.21.15.177:0/165151145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8240197810 msgr2=0x7f824019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8244965640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8240197810 0x7f824019bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.645+0000 7f8244965640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8240197810 0x7f824019bba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f8245967640 1 -- 172.21.15.177:0/165151145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 msgr2=0x7f82401972d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f8245967640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 0x7f82401972d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f8245967640 1 -- 172.21.15.177:0/165151145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8240197810 msgr2=0x7f824019bba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f8245967640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8240197810 0x7f824019bba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f8245967640 1 -- 172.21.15.177:0/165151145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82401a3e50 con 0x7f824019c0e0 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f8245967640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f824019c0e0 0x7f824019c590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f823800bd50 tx=0x7f823800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f82367fc640 1 -- 172.21.15.177:0/165151145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238019070 con 0x7f824019c0e0 2024-09-11T22:21:46.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f82367fc640 1 -- 172.21.15.177:0/165151145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8238014920 con 0x7f824019c0e0 2024-09-11T22:21:46.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82401a4080 con 0x7f824019c0e0 2024-09-11T22:21:46.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f82367fc640 1 -- 172.21.15.177:0/165151145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238012990 con 0x7f824019c0e0 2024-09-11T22:21:46.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.646+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82401a4590 con 0x7f824019c0e0 2024-09-11T22:21:46.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.647+0000 7f82367fc640 1 -- 172.21.15.177:0/165151145 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f823801c070 con 0x7f824019c0e0 2024-09-11T22:21:46.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.648+0000 7f82367fc640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f82240394f0 0x7f822403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:46.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.648+0000 7f82367fc640 1 -- 172.21.15.177:0/165151145 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f823804be80 con 0x7f824019c0e0 2024-09-11T22:21:46.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.648+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82401097a0 con 0x7f824019c0e0 2024-09-11T22:21:46.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.648+0000 7f8245166640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f82240394f0 0x7f822403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:46.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.649+0000 7f8245166640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f82240394f0 0x7f822403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f823c005fd0 tx=0x7f823c005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:46.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.654+0000 7f82367fc640 1 -- 172.21.15.177:0/165151145 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f823800e0a0 con 0x7f824019c0e0 2024-09-11T22:21:46.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.898+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f82401a4930 con 0x7f824019c0e0 2024-09-11T22:21:46.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.898+0000 7f82367fc640 1 -- 172.21.15.177:0/165151145 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f8238027030 con 0x7f824019c0e0 2024-09-11T22:21:46.899 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:46.899 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: mon.c calling monitor election 2024-09-11T22:21:46.899 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:46.899 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: mon.a calling monitor election 2024-09-11T22:21:46.899 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.899 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:46.899 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.899 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: monmap epoch 3 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: last_changed 2024-09-11T22:21:41.552121+0000 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: min_mon_release 19 (squid) 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: election_strategy: 1 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:21:46.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-11T22:21:46.901 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-09-11T22:21:46.901 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: fsmap 2024-09-11T22:21:46.901 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:46.901 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: mgrmap e13: x(active, since 49s) 2024-09-11T22:21:46.901 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: overall HEALTH_OK 2024-09-11T22:21:46.901 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:46.901 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:46.901 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:46.901 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:46.902 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:21:46.902 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":3,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","modified":"2024-09-11T22:21:41.552121Z","created":"2024-09-11T22:20:01.413928Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:3300","nonce":0},{"type":"v1","addr":"172.21.15.146:6789","nonce":0}]},"addr":"172.21.15.146:6789/0","public_addr":"172.21.15.146:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T22:21:46.902 INFO:teuthology.orchestra.run.smithi177.stderr:dumped monmap epoch 3 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f82240394f0 msgr2=0x7f822403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f82240394f0 0x7f822403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f823c005fd0 tx=0x7f823c005d50 comp rx=0 tx=0).stop 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f824019c0e0 msgr2=0x7f824019c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f824019c0e0 0x7f824019c590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f823800bd50 tx=0x7f823800be40 comp rx=0 tx=0).stop 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 shutdown_connections 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f82240394f0 0x7f822403b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f824019c0e0 0x7f824019c590 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8240197810 0x7f824019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 --2- 172.21.15.177:0/165151145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f822c003530 0x7f82401972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 >> 172.21.15.177:0/165151145 conn(0x7f82400fc220 msgr2=0x7f8240105890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 shutdown_connections 2024-09-11T22:21:46.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:46.901+0000 7f82473ca640 1 -- 172.21.15.177:0/165151145 wait complete. 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: mon.c calling monitor election 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: mon.a calling monitor election 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: monmap epoch 3 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: last_changed 2024-09-11T22:21:41.552121+0000 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: min_mon_release 19 (squid) 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: election_strategy: 1 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-11T22:21:46.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-09-11T22:21:46.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: fsmap 2024-09-11T22:21:46.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:46.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: mgrmap e13: x(active, since 49s) 2024-09-11T22:21:46.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: overall HEALTH_OK 2024-09-11T22:21:46.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:46.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:46.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:46.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:47.487 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T22:21:47.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T22:21:47.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:47.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:47 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/165151145' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:47.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:47.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:47.872 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:47 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/165151145' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:47.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:47.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.355+0000 7f19b0c00640 1 -- 172.21.15.40:0/3098179896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac109770 msgr2=0x7f19ac109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.355+0000 7f19b0c00640 1 --2- 172.21.15.40:0/3098179896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac109770 0x7f19ac109b50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f199c009880 tx=0x7f199c02a5d0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.355+0000 7f19b0c00640 1 -- 172.21.15.40:0/3098179896 shutdown_connections 2024-09-11T22:21:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.355+0000 7f19b0c00640 1 --2- 172.21.15.40:0/3098179896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac109770 0x7f19ac109b50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.355+0000 7f19b0c00640 1 -- 172.21.15.40:0/3098179896 >> 172.21.15.40:0/3098179896 conn(0x7f19ac0ff450 msgr2=0x7f19ac101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.355+0000 7f19b0c00640 1 -- 172.21.15.40:0/3098179896 shutdown_connections 2024-09-11T22:21:48.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.355+0000 7f19b0c00640 1 -- 172.21.15.40:0/3098179896 wait complete. 2024-09-11T22:21:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.356+0000 7f19b0c00640 1 Processor -- start 2024-09-11T22:21:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.356+0000 7f19b0c00640 1 -- start start 2024-09-11T22:21:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19b0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 0x7f19ac199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19b0c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac199ad0 0x7f19ac19de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19b0c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac19e3a0 0x7f19ac19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19b0c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac10de30 con 0x7f19ac19e3a0 2024-09-11T22:21:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19b0c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac10dcb0 con 0x7f19ac109770 2024-09-11T22:21:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19b0c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac10dfb0 con 0x7f19ac199ad0 2024-09-11T22:21:48.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 0x7f19ac199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 0x7f19ac199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:34624/0 (socket says 172.21.15.40:34624) 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9e00640 1 -- 172.21.15.40:0/2627652397 learned_addr learned my addr 172.21.15.40:0/2627652397 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9400640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac199ad0 0x7f19ac19de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19aa800640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac19e3a0 0x7f19ac19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9e00640 1 -- 172.21.15.40:0/2627652397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 msgr2=0x7f19ac199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9e00640 1 -- 172.21.15.40:0/2627652397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 msgr2=0x7f19ac199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9e00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 0x7f19ac199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9e00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 0x7f19ac199590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9400640 1 -- 172.21.15.40:0/2627652397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 msgr2=0x7f19ac199590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9400640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 0x7f19ac199590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9400640 1 -- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac19e3a0 msgr2=0x7f19ac19e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9400640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac19e3a0 0x7f19ac19e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.357+0000 7f19a9400640 1 -- 172.21.15.40:0/2627652397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac1a6110 con 0x7f19ac199ad0 2024-09-11T22:21:48.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.358+0000 7f19aa800640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac19e3a0 0x7f19ac19e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:48.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.358+0000 7f19a9400640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac199ad0 0x7f19ac19de60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f199800b450 tx=0x7f199800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:48.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.358+0000 7f19a2a00640 1 -- 172.21.15.40:0/2627652397 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998004230 con 0x7f19ac199ad0 2024-09-11T22:21:48.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.358+0000 7f19a2a00640 1 -- 172.21.15.40:0/2627652397 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19980043d0 con 0x7f19ac199ad0 2024-09-11T22:21:48.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.358+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ac1a6340 con 0x7f19ac199ad0 2024-09-11T22:21:48.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.358+0000 7f19a2a00640 1 -- 172.21.15.40:0/2627652397 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998003cb0 con 0x7f19ac199ad0 2024-09-11T22:21:48.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.358+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ac1a68a0 con 0x7f19ac199ad0 2024-09-11T22:21:48.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.359+0000 7f19a2a00640 1 -- 172.21.15.40:0/2627652397 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f199800f050 con 0x7f19ac199ad0 2024-09-11T22:21:48.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.360+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac109bd0 con 0x7f19ac199ad0 2024-09-11T22:21:48.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.360+0000 7f19a2a00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f19900394f0 0x7f199003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:48.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.360+0000 7f19a2a00640 1 -- 172.21.15.40:0/2627652397 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f199804c1f0 con 0x7f19ac199ad0 2024-09-11T22:21:48.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.360+0000 7f19a9e00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f19900394f0 0x7f199003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:48.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.361+0000 7f19a9e00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f19900394f0 0x7f199003b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f199c005ab0 tx=0x7f199c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:48.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.365+0000 7f19a2a00640 1 -- 172.21.15.40:0/2627652397 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f199800d040 con 0x7f19ac199ad0 2024-09-11T22:21:48.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.554+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f19ac1a6c90 con 0x7f19ac199ad0 2024-09-11T22:21:48.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.555+0000 7f19a2a00640 1 -- 172.21.15.40:0/2627652397 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f1998014160 con 0x7f19ac199ad0 2024-09-11T22:21:48.556 INFO:teuthology.orchestra.run.smithi040.stdout:# minimal ceph.conf for c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:48.556 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-09-11T22:21:48.557 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:48.557 INFO:teuthology.orchestra.run.smithi040.stdout: mon_host = [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] 2024-09-11T22:21:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f19900394f0 msgr2=0x7f199003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f19900394f0 0x7f199003b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f199c005ab0 tx=0x7f199c005a20 comp rx=0 tx=0).stop 2024-09-11T22:21:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac199ad0 msgr2=0x7f19ac19de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac199ad0 0x7f19ac19de60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f199800b450 tx=0x7f199800b910 comp rx=0 tx=0).stop 2024-09-11T22:21:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 shutdown_connections 2024-09-11T22:21:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f19900394f0 0x7f199003b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19ac19e3a0 0x7f19ac19e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac199ad0 0x7f19ac19de60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 --2- 172.21.15.40:0/2627652397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19ac109770 0x7f19ac199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.557+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 >> 172.21.15.40:0/2627652397 conn(0x7f19ac0ff450 msgr2=0x7f19ac107280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.558+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 shutdown_connections 2024-09-11T22:21:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:48.558+0000 7f19b0c00640 1 -- 172.21.15.40:0/2627652397 wait complete. 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: mon.c calling monitor election 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: mon.a calling monitor election 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: monmap epoch 3 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: last_changed 2024-09-11T22:21:41.552121+0000 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: min_mon_release 19 (squid) 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: election_strategy: 1 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: fsmap 2024-09-11T22:21:48.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: mgrmap e13: x(active, since 49s) 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: overall HEALTH_OK 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/165151145' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:48.836 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:49.242 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T22:21:49.243 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:21:49.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T22:21:49.303 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:21:49.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:49.400 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:21:49.400 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T22:21:49.429 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:21:49.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:49.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: mon.b calling monitor election 2024-09-11T22:21:49.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: Updating smithi040:/etc/ceph/ceph.conf 2024-09-11T22:21:49.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: Updating smithi146:/etc/ceph/ceph.conf 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: Updating smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: Updating smithi146:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: mon.b calling monitor election 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: mon.c calling monitor election 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: mon.a calling monitor election 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: monmap epoch 3 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: last_changed 2024-09-11T22:21:41.552121+0000 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:21:49.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: min_mon_release 19 (squid) 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: election_strategy: 1 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: fsmap 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: mgrmap e13: x(active, since 51s) 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: overall HEALTH_OK 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: Updating smithi040:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:49 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.494 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:21:49.494 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T22:21:49.517 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: mon.b calling monitor election 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: Updating smithi040:/etc/ceph/ceph.conf 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: Updating smithi146:/etc/ceph/ceph.conf 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: Updating smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: Updating smithi146:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: mon.b calling monitor election 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: mon.c calling monitor election 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: mon.a calling monitor election 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: monmap epoch 3 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: last_changed 2024-09-11T22:21:41.552121+0000 2024-09-11T22:21:49.518 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: min_mon_release 19 (squid) 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: election_strategy: 1 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: fsmap 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: mgrmap e13: x(active, since 51s) 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: overall HEALTH_OK 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: Updating smithi040:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:49.519 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.520 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:49 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.522 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:21:49.522 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T22:21:49.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: mon.b calling monitor election 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: Updating smithi040:/etc/ceph/ceph.conf 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: Updating smithi146:/etc/ceph/ceph.conf 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: Updating smithi177:/etc/ceph/ceph.conf 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: Updating smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: Updating smithi146:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: mon.b calling monitor election 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: mon.c calling monitor election 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: mon.a calling monitor election 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: monmap epoch 3 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: last_changed 2024-09-11T22:21:41.552121+0000 2024-09-11T22:21:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: created 2024-09-11T22:20:01.413928+0000 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: min_mon_release 19 (squid) 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: election_strategy: 1 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: 0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: 1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.c 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: 2: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: fsmap 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: mgrmap e13: x(active, since 51s) 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: overall HEALTH_OK 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: Updating smithi040:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:49 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:49.588 INFO:tasks.cephadm:Adding mgr.x on smithi040 2024-09-11T22:21:49.588 INFO:tasks.cephadm:Adding mgr.y on smithi146 2024-09-11T22:21:49.588 INFO:tasks.cephadm:Adding mgr.z on smithi177 2024-09-11T22:21:49.588 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi040=x;smithi146=y;smithi177=z' 2024-09-11T22:21:49.864 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:21:50.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.263+0000 7f57c1953640 1 -- 172.21.15.177:0/493206036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57bc1016e0 msgr2=0x7f57bc101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.263+0000 7f57c1953640 1 --2- 172.21.15.177:0/493206036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57bc1016e0 0x7f57bc101ae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009880 tx=0x7f57ac02a5d0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.264+0000 7f57c1953640 1 -- 172.21.15.177:0/493206036 shutdown_connections 2024-09-11T22:21:50.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.264+0000 7f57c1953640 1 --2- 172.21.15.177:0/493206036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57bc1016e0 0x7f57bc101ae0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.264+0000 7f57c1953640 1 -- 172.21.15.177:0/493206036 >> 172.21.15.177:0/493206036 conn(0x7f57bc0fce90 msgr2=0x7f57bc0ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:50.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.264+0000 7f57c1953640 1 -- 172.21.15.177:0/493206036 shutdown_connections 2024-09-11T22:21:50.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.264+0000 7f57c1953640 1 -- 172.21.15.177:0/493206036 wait complete. 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.264+0000 7f57c1953640 1 Processor -- start 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.264+0000 7f57c1953640 1 -- start start 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c1953640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc1016e0 0x7f57bc196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c1953640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57bc1974f0 0x7f57bc19c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c1953640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57bc197970 0x7f57bc19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c1953640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc1077f0 con 0x7f57bc197970 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c1953640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc107670 con 0x7f57bc1974f0 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c1953640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc107970 con 0x7f57bc1016e0 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57baffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc1016e0 0x7f57bc196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57baffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc1016e0 0x7f57bc196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35670/0 (socket says 172.21.15.177:35670) 2024-09-11T22:21:50.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57baffd640 1 -- 172.21.15.177:0/4165833216 learned_addr learned my addr 172.21.15.177:0/4165833216 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57bb7fe640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57bc197970 0x7f57bc19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57ba7fc640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57bc1974f0 0x7f57bc19c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57baffd640 1 -- 172.21.15.177:0/4165833216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57bc1974f0 msgr2=0x7f57bc19c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57baffd640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57bc1974f0 0x7f57bc19c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57baffd640 1 -- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57bc197970 msgr2=0x7f57bc19eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57baffd640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57bc197970 0x7f57bc19eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57baffd640 1 -- 172.21.15.177:0/4165833216 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57bc19f3b0 con 0x7f57bc1016e0 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57baffd640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc1016e0 0x7f57bc196fb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f57ac005ab0 tx=0x7f57ac032d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c0951640 1 -- 172.21.15.177:0/4165833216 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac03f030 con 0x7f57bc1016e0 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c0951640 1 -- 172.21.15.177:0/4165833216 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ac003ce0 con 0x7f57bc1016e0 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57bc19f640 con 0x7f57bc1016e0 2024-09-11T22:21:50.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c0951640 1 -- 172.21.15.177:0/4165833216 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac035070 con 0x7f57bc1016e0 2024-09-11T22:21:50.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.265+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57bc19fbf0 con 0x7f57bc1016e0 2024-09-11T22:21:50.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.266+0000 7f57c0951640 1 -- 172.21.15.177:0/4165833216 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f57ac042030 con 0x7f57bc1016e0 2024-09-11T22:21:50.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.267+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57bc1905b0 con 0x7f57bc1016e0 2024-09-11T22:21:50.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.267+0000 7f57c0951640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57a40394f0 0x7f57a403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.267+0000 7f57c0951640 1 -- 172.21.15.177:0/4165833216 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f57ac06c6e0 con 0x7f57bc1016e0 2024-09-11T22:21:50.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.267+0000 7f57ba7fc640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57a40394f0 0x7f57a403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.267+0000 7f57ba7fc640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57a40394f0 0x7f57a403b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57bc1984d0 tx=0x7f57b0009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:50.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.272+0000 7f57c0951640 1 -- 172.21.15.177:0/4165833216 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57ac03be20 con 0x7f57bc1016e0 2024-09-11T22:21:50.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.448+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi040=x;smithi146=y;smithi177=z", "target": ["mon-mgr", ""]}) -- 0x7f57bc0626c0 con 0x7f57a40394f0 2024-09-11T22:21:50.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.454+0000 7f57c0951640 1 -- 172.21.15.177:0/4165833216 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f57bc0626c0 con 0x7f57a40394f0 2024-09-11T22:21:50.455 INFO:teuthology.orchestra.run.smithi177.stdout:Scheduled mgr update... 2024-09-11T22:21:50.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57a40394f0 msgr2=0x7f57a403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57a40394f0 0x7f57a403b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57bc1984d0 tx=0x7f57b0009190 comp rx=0 tx=0).stop 2024-09-11T22:21:50.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc1016e0 msgr2=0x7f57bc196fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc1016e0 0x7f57bc196fb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f57ac005ab0 tx=0x7f57ac032d00 comp rx=0 tx=0).stop 2024-09-11T22:21:50.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 shutdown_connections 2024-09-11T22:21:50.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57a40394f0 0x7f57a403b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57bc197970 0x7f57bc19eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57bc1974f0 0x7f57bc19c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 --2- 172.21.15.177:0/4165833216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc1016e0 0x7f57bc196fb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 >> 172.21.15.177:0/4165833216 conn(0x7f57bc0fce90 msgr2=0x7f57bc0fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:50.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 shutdown_connections 2024-09-11T22:21:50.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:21:50.456+0000 7f57c1953640 1 -- 172.21.15.177:0/4165833216 wait complete. 2024-09-11T22:21:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T22:21:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: Reconfiguring daemon mon.a on smithi040 2024-09-11T22:21:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: Reconfiguring daemon mon.a on smithi040 2024-09-11T22:21:50.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T22:21:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: Reconfiguring daemon mon.a on smithi040 2024-09-11T22:21:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:21:51.111 DEBUG:teuthology.orchestra.run.smithi146:mgr.y> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T22:21:51.114 DEBUG:teuthology.orchestra.run.smithi177:mgr.z> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.z.service 2024-09-11T22:21:51.117 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T22:21:51.117 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:21:51.117 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:21:51.154 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:21:51.154 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-09-11T22:21:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:21:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:51.231 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-11T22:21:51.231 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:51.231 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:51.231 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-11 22:21:06.842463905 +0000 2024-09-11T22:21:51.231 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-11 22:16:12.710456403 +0000 2024-09-11T22:21:51.231 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-11 22:16:12.710456403 +0000 2024-09-11T22:21:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-11 22:16:12.710456403 +0000 2024-09-11T22:21:51.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:21:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-11T22:21:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-11T22:21:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000298761 s, 1.7 MB/s 2024-09-11T22:21:51.330 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:21:51.369 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-09-11T22:21:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:21:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:51.447 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-11T22:21:51.447 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:51.447 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:51.447 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-11 22:21:06.888463249 +0000 2024-09-11T22:21:51.447 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-11 22:16:13.184450236 +0000 2024-09-11T22:21:51.447 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-11 22:16:13.184450236 +0000 2024-09-11T22:21:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-11 22:16:13.184450236 +0000 2024-09-11T22:21:51.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:21:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-11T22:21:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-11T22:21:51.543 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000276756 s, 1.9 MB/s 2024-09-11T22:21:51.547 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:21:51.584 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-09-11T22:21:51.624 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:51 smithi040 ceph-mon[30787]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi040=x;smithi146=y;smithi177=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:51.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:51 smithi040 ceph-mon[30787]: Saving service mgr spec with placement smithi040=x;smithi146=y;smithi177=z;count:3 2024-09-11T22:21:51.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:51.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:51.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:51.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:51.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:51.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:21:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:51.661 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-11T22:21:51.661 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:51.661 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:51.661 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-11 22:21:06.938462536 +0000 2024-09-11T22:21:51.661 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-11 22:16:13.657444406 +0000 2024-09-11T22:21:51.661 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-11 22:16:13.657444406 +0000 2024-09-11T22:21:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-11 22:16:13.657444406 +0000 2024-09-11T22:21:51.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:21:51.755 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-11T22:21:51.756 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-11T22:21:51.756 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000292665 s, 1.7 MB/s 2024-09-11T22:21:51.758 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:21:51.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:51 smithi177 ceph-mon[35530]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi040=x;smithi146=y;smithi177=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:51.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:51 smithi177 ceph-mon[35530]: Saving service mgr spec with placement smithi040=x;smithi146=y;smithi177=z;count:3 2024-09-11T22:21:51.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:51.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:51.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:51.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:51.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:51.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:51.797 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-09-11T22:21:51.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:51 smithi146 ceph-mon[34996]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi040=x;smithi146=y;smithi177=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:51.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:51 smithi146 ceph-mon[34996]: Saving service mgr spec with placement smithi040=x;smithi146=y;smithi177=z;count:3 2024-09-11T22:21:51.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:51.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:51.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:21:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:51.876 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-09-11T22:21:51.876 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:51.876 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:51.876 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-11 22:21:06.984461880 +0000 2024-09-11T22:21:51.876 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-11 22:16:14.155438269 +0000 2024-09-11T22:21:51.876 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-11 22:16:14.155438269 +0000 2024-09-11T22:21:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-11 22:16:14.155438269 +0000 2024-09-11T22:21:51.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:21:51.972 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-11T22:21:51.972 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-11T22:21:51.972 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.00028425 s, 1.8 MB/s 2024-09-11T22:21:51.975 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:21:52.013 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-11T22:21:52.014 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:21:52.033 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:21:52.033 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-09-11T22:21:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:21:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:52.095 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-11T22:21:52.095 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:52.095 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:52.095 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-11 22:21:40.982157918 +0000 2024-09-11T22:21:52.095 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-11 22:15:35.396342158 +0000 2024-09-11T22:21:52.095 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-11 22:15:35.396342158 +0000 2024-09-11T22:21:52.095 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-11 22:15:35.396342158 +0000 2024-09-11T22:21:52.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:21:52.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-11T22:21:52.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-11T22:21:52.163 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000239952 s, 2.1 MB/s 2024-09-11T22:21:52.164 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:21:52.223 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-09-11T22:21:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:21:52.282 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-11T22:21:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-11 22:21:40.983157902 +0000 2024-09-11T22:21:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-11 22:15:35.722337258 +0000 2024-09-11T22:21:52.282 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-11 22:15:35.722337258 +0000 2024-09-11T22:21:52.283 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-11 22:15:35.722337258 +0000 2024-09-11T22:21:52.283 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:21:52.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-11T22:21:52.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-11T22:21:52.349 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000198512 s, 2.6 MB/s 2024-09-11T22:21:52.350 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:21:52.409 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-09-11T22:21:52.466 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:21:52.466 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T22:21:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-11 22:21:40.983157902 +0000 2024-09-11T22:21:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-11 22:15:36.045332404 +0000 2024-09-11T22:21:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-11 22:15:36.045332404 +0000 2024-09-11T22:21:52.466 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-11 22:15:36.045332404 +0000 2024-09-11T22:21:52.466 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:21:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-11T22:21:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-11T22:21:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000212066 s, 2.4 MB/s 2024-09-11T22:21:52.533 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:21:52.590 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-09-11T22:21:52.616 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:52 smithi040 ceph-mon[30787]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:52.616 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:52 smithi040 ceph-mon[30787]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T22:21:52.617 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:52 smithi040 ceph-mon[30787]: Reconfiguring daemon mgr.x on smithi040 2024-09-11T22:21:52.645 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:21:52.645 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:52.646 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-11T22:21:52.646 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:52.646 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:52.646 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-11 22:21:40.983157902 +0000 2024-09-11T22:21:52.646 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-11 22:15:36.378327399 +0000 2024-09-11T22:21:52.646 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-11 22:15:36.378327399 +0000 2024-09-11T22:21:52.646 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-11 22:15:36.378327399 +0000 2024-09-11T22:21:52.646 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:21:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-11T22:21:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-11T22:21:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000317282 s, 1.6 MB/s 2024-09-11T22:21:52.714 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:21:52.770 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-11T22:21:52.770 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:21:52.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:52 smithi177 ceph-mon[35530]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:52.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:52 smithi177 ceph-mon[35530]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T22:21:52.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:52 smithi177 ceph-mon[35530]: Reconfiguring daemon mgr.x on smithi040 2024-09-11T22:21:52.791 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:21:52.791 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-09-11T22:21:52.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:52 smithi146 ceph-mon[34996]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:52.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:52 smithi146 ceph-mon[34996]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T22:21:52.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:52 smithi146 ceph-mon[34996]: Reconfiguring daemon mgr.x on smithi040 2024-09-11T22:21:52.850 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:21:52.850 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:52.850 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T22:21:52.850 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:52.850 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:52.850 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-11 22:21:31.718520977 +0000 2024-09-11T22:21:52.850 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-11 22:15:35.387127876 +0000 2024-09-11T22:21:52.850 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-11 22:15:35.387127876 +0000 2024-09-11T22:21:52.850 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-11 22:15:35.387127876 +0000 2024-09-11T22:21:52.850 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:21:52.918 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-11T22:21:52.919 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-11T22:21:52.919 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000224201 s, 2.3 MB/s 2024-09-11T22:21:52.920 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:21:52.979 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-09-11T22:21:53.036 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:21:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:53.037 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T22:21:53.037 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:53.037 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:53.037 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-11 22:21:31.719520948 +0000 2024-09-11T22:21:53.037 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-11 22:15:35.717118073 +0000 2024-09-11T22:21:53.037 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-11 22:15:35.717118073 +0000 2024-09-11T22:21:53.037 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-11 22:15:35.717118073 +0000 2024-09-11T22:21:53.037 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:21:53.103 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-11T22:21:53.104 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-11T22:21:53.104 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000206893 s, 2.5 MB/s 2024-09-11T22:21:53.105 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:21:53.163 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-09-11T22:21:53.219 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:21:53.220 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:53.220 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T22:21:53.220 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:53.220 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:53.220 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-11 22:21:31.719520948 +0000 2024-09-11T22:21:53.220 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-11 22:15:36.035108627 +0000 2024-09-11T22:21:53.220 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-11 22:15:36.035108627 +0000 2024-09-11T22:21:53.220 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-11 22:15:36.035108627 +0000 2024-09-11T22:21:53.220 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:21:53.285 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-11T22:21:53.285 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-11T22:21:53.285 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000236816 s, 2.2 MB/s 2024-09-11T22:21:53.286 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:21:53.344 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-09-11T22:21:53.400 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:21:53.400 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:21:53.400 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-11T22:21:53.400 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:53.400 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:21:53.400 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-11 22:21:31.719520948 +0000 2024-09-11T22:21:53.401 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-11 22:15:36.361098943 +0000 2024-09-11T22:21:53.401 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-11 22:15:36.361098943 +0000 2024-09-11T22:21:53.401 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-09-11 22:15:36.361098943 +0000 2024-09-11T22:21:53.401 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:21:53.464 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-11T22:21:53.464 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-11T22:21:53.464 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000212728 s, 2.4 MB/s 2024-09-11T22:21:53.466 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:21:53.522 INFO:tasks.cephadm:Deploying osd.0 on smithi040 with /dev/vg_nvme/lv_4... 2024-09-11T22:21:53.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T22:21:53.900 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:53.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:53.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:53 smithi040 ceph-mon[30787]: Reconfiguring mon.b (monmap changed)... 2024-09-11T22:21:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:53 smithi040 ceph-mon[30787]: Reconfiguring daemon mon.b on smithi146 2024-09-11T22:21:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:53 smithi177 ceph-mon[35530]: Reconfiguring mon.b (monmap changed)... 2024-09-11T22:21:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:53 smithi177 ceph-mon[35530]: Reconfiguring daemon mon.b on smithi146 2024-09-11T22:21:54.072 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:54.073 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:54.073 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:53 smithi146 ceph-mon[34996]: Reconfiguring mon.b (monmap changed)... 2024-09-11T22:21:54.073 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:54.073 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:54.073 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:54.073 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:53 smithi146 ceph-mon[34996]: Reconfiguring daemon mon.b on smithi146 2024-09-11T22:21:54.754 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:54 smithi177 ceph-mon[35530]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:54.754 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:54.754 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:54.754 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:54.754 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:54.754 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:54.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:54 smithi040 ceph-mon[30787]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:54.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:54.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:54.940 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:54.940 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:54.940 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:55.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:54 smithi146 ceph-mon[34996]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T22:21:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T22:21:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:55.848 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: Reconfiguring mon.c (monmap changed)... 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: Reconfiguring daemon mon.c on smithi177 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:55.849 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:56.001 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: Reconfiguring mon.c (monmap changed)... 2024-09-11T22:21:56.001 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: Reconfiguring daemon mon.c on smithi177 2024-09-11T22:21:56.001 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:56.001 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:56.001 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:56.001 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:56.001 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:56.002 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:56.002 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:56.002 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:56.002 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:56.002 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:56.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: Reconfiguring mon.c (monmap changed)... 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: Reconfiguring daemon mon.c on smithi177 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:56.651 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:21:56.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi040:vg_nvme/lv_4 2024-09-11T22:21:56.915 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:56 smithi177 ceph-mon[35530]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:56.915 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:56 smithi177 ceph-mon[35530]: Deploying daemon mgr.z on smithi177 2024-09-11T22:21:56.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:56 smithi040 ceph-mon[30787]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:56.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:56 smithi040 ceph-mon[30787]: Deploying daemon mgr.z on smithi177 2024-09-11T22:21:57.055 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:21:57.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:56 smithi146 ceph-mon[34996]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:57.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:56 smithi146 ceph-mon[34996]: Deploying daemon mgr.z on smithi177 2024-09-11T22:21:57.281 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 systemd[1]: Starting Ceph mgr.z for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:21:57.532 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 podman[37314]: 2024-09-11 22:21:57.281487725 +0000 UTC m=+0.101676816 container create 85c43e1283747ef6d203dd4754bd0a067b00eb83ca445ed3ab2ebbbd036d13a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-11T22:21:57.532 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 podman[37314]: 2024-09-11 22:21:57.195474117 +0000 UTC m=+0.015663222 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:21:57.532 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 podman[37314]: 2024-09-11 22:21:57.458596355 +0000 UTC m=+0.278785447 container init 85c43e1283747ef6d203dd4754bd0a067b00eb83ca445ed3ab2ebbbd036d13a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-11T22:21:57.533 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 podman[37314]: 2024-09-11 22:21:57.4613698 +0000 UTC m=+0.281558894 container start 85c43e1283747ef6d203dd4754bd0a067b00eb83ca445ed3ab2ebbbd036d13a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-11T22:21:57.533 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 ceph-mgr[37333]: -- 172.21.15.177:0/2856937990 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fb2ee70e0 con 0x563fb2ec4800 2024-09-11T22:21:57.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.549+0000 7fcbb7800640 1 -- 172.21.15.40:0/3180316750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbb0104f60 msgr2=0x7fcbb01053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.549+0000 7fcbb7800640 1 --2- 172.21.15.40:0/3180316750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbb0104f60 0x7fcbb01053e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009900 tx=0x7fcb9c02a3f0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.549+0000 7fcbb7800640 1 -- 172.21.15.40:0/3180316750 shutdown_connections 2024-09-11T22:21:57.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.549+0000 7fcbb7800640 1 --2- 172.21.15.40:0/3180316750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb0105920 0x7fcbb010c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.549+0000 7fcbb7800640 1 --2- 172.21.15.40:0/3180316750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbb0104f60 0x7fcbb01053e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.549+0000 7fcbb7800640 1 --2- 172.21.15.40:0/3180316750 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0103e00 0x7fcbb0104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.549+0000 7fcbb7800640 1 -- 172.21.15.40:0/3180316750 >> 172.21.15.40:0/3180316750 conn(0x7fcbb00ff5b0 msgr2=0x7fcbb01019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:57.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.549+0000 7fcbb7800640 1 -- 172.21.15.40:0/3180316750 shutdown_connections 2024-09-11T22:21:57.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.549+0000 7fcbb7800640 1 -- 172.21.15.40:0/3180316750 wait complete. 2024-09-11T22:21:57.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.550+0000 7fcbb7800640 1 Processor -- start 2024-09-11T22:21:57.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.550+0000 7fcbb7800640 1 -- start start 2024-09-11T22:21:57.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.550+0000 7fcbb7800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb0103e00 0x7fcbb019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.550+0000 7fcbb7800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0104f60 0x7fcbb019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.550+0000 7fcbb7800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbb0105920 0x7fcbb01a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.550+0000 7fcbb7800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb010fae0 con 0x7fcbb0105920 2024-09-11T22:21:57.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.550+0000 7fcbb7800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb010f960 con 0x7fcbb0103e00 2024-09-11T22:21:57.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.550+0000 7fcbb7800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb010fc60 con 0x7fcbb0104f60 2024-09-11T22:21:57.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbb4e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb0103e00 0x7fcbb019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbafe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0104f60 0x7fcbb019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbb4e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb0103e00 0x7fcbb019a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:49632/0 (socket says 172.21.15.40:49632) 2024-09-11T22:21:57.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbb4e00640 1 -- 172.21.15.40:0/2217017035 learned_addr learned my addr 172.21.15.40:0/2217017035 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:21:57.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbb5800640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbb0105920 0x7fcbb01a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbafe00640 1 -- 172.21.15.40:0/2217017035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb0103e00 msgr2=0x7fcbb019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbafe00640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb0103e00 0x7fcbb019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbafe00640 1 -- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbb0105920 msgr2=0x7fcbb01a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbafe00640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbb0105920 0x7fcbb01a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbafe00640 1 -- 172.21.15.40:0/2217017035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb01a1d60 con 0x7fcbb0104f60 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.551+0000 7fcbafe00640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0104f60 0x7fcbb019a670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009230 tx=0x7fcb9c032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.552+0000 7fcbad600640 1 -- 172.21.15.40:0/2217017035 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c03f030 con 0x7fcbb0104f60 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.552+0000 7fcbad600640 1 -- 172.21.15.40:0/2217017035 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb9c003ce0 con 0x7fcbb0104f60 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.552+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb01a1ff0 con 0x7fcbb0104f60 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.552+0000 7fcbad600640 1 -- 172.21.15.40:0/2217017035 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c035070 con 0x7fcbb0104f60 2024-09-11T22:21:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.552+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb01a23e0 con 0x7fcbb0104f60 2024-09-11T22:21:57.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.553+0000 7fcbad600640 1 -- 172.21.15.40:0/2217017035 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcb9c042030 con 0x7fcbb0104f60 2024-09-11T22:21:57.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.553+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb010b150 con 0x7fcbb0104f60 2024-09-11T22:21:57.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.553+0000 7fcbad600640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb980392c0 0x7fcb9803b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:57.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.553+0000 7fcbad600640 1 -- 172.21.15.40:0/2217017035 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcb9c06c950 con 0x7fcbb0104f60 2024-09-11T22:21:57.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.554+0000 7fcbb4e00640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb980392c0 0x7fcb9803b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:57.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.554+0000 7fcbb4e00640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb980392c0 0x7fcb9803b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009fd0 tx=0x7fcba4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:57.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.559+0000 7fcbad600640 1 -- 172.21.15.40:0/2217017035 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb9c040e00 con 0x7fcbb0104f60 2024-09-11T22:21:57.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:21:57.757+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fcbb0062630 con 0x7fcb980392c0 2024-09-11T22:21:57.797 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 bash[37314]: 85c43e1283747ef6d203dd4754bd0a067b00eb83ca445ed3ab2ebbbd036d13a4 2024-09-11T22:21:57.797 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 systemd[1]: Started Ceph mgr.z for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:21:57.797 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:57.591+0000 7f7319205040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:21:57.797 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:57.650+0000 7f7319205040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:21:57.797 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:57.796+0000 7f7319205040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:21:58.145 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:57 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:57.862+0000 7f7319205040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:21:58.145 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:58.007+0000 7f7319205040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:21:58.145 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:58.144+0000 7f7319205040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:21:58.782 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:58.460+0000 7f7319205040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:21:58.782 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:58.520+0000 7f7319205040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:21:58.782 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:58.704+0000 7f7319205040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: Deploying daemon mgr.y on smithi146 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:21:58.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:21:58.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:21:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:58.945 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:58.945 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:58.945 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:58.945 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:58.945 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:58.946 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:58.946 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:58.946 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:58.946 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: Deploying daemon mgr.y on smithi146 2024-09-11T22:21:58.946 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:58.946 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:21:58.946 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:21:58.946 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:21:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:58.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: Deploying daemon mgr.y on smithi146 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:21:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:21:58.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:21:58.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:21:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:21:59.584 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:21:59 smithi146 systemd[1]: Starting Ceph mgr.y for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:21:59.851 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:21:59 smithi146 podman[36348]: 2024-09-11 22:21:59.490640484 +0000 UTC m=+0.015736331 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:21:59.852 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:21:59 smithi146 podman[36348]: 2024-09-11 22:21:59.596391019 +0000 UTC m=+0.121486903 container create a87c00a9e03af6c1dc19d598e9fec5e8435f435d995dbf4186c2050b9dd2d17b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T22:21:59.852 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:21:59 smithi146 podman[36348]: 2024-09-11 22:21:59.823933457 +0000 UTC m=+0.349029295 container init a87c00a9e03af6c1dc19d598e9fec5e8435f435d995dbf4186c2050b9dd2d17b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3) 2024-09-11T22:21:59.852 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:21:59 smithi146 podman[36348]: 2024-09-11 22:21:59.826682305 +0000 UTC m=+0.351778146 container start a87c00a9e03af6c1dc19d598e9fec5e8435f435d995dbf4186c2050b9dd2d17b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-11T22:21:59.878 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:59 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:59.583+0000 7f7319205040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:21:59.878 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:21:59 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:21:59.654+0000 7f7319205040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:22:00.163 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:21:59 smithi146 ceph-mgr[36367]: -- 172.21.15.146:0/3811282874 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617cf2b90e0 con 0x5617cf296800 2024-09-11T22:22:00.163 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:21:59 smithi146 bash[36348]: a87c00a9e03af6c1dc19d598e9fec5e8435f435d995dbf4186c2050b9dd2d17b 2024-09-11T22:22:00.163 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:21:59 smithi146 systemd[1]: Started Ceph mgr.y for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:22:00.163 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:21:59 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:21:59.947+0000 7fc72a408040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:22:00.164 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:00.007+0000 7fc72a408040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:22:00.164 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:00.162+0000 7fc72a408040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:22:00.548 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:00.232+0000 7fc72a408040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:22:00.548 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:00.389+0000 7fc72a408040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:22:00.548 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:00.547+0000 7fc72a408040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:22:00.778 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:00.481+0000 7f7319205040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:22:00.779 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:00.628+0000 7f7319205040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:22:00.779 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:00.777+0000 7f7319205040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:22:00.779 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-mon[35530]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:00.779 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.779 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.779 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.779 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.779 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:00.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-mon[34996]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:00.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:00.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:00 smithi040 ceph-mon[30787]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:00.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:00 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:00 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:00 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:00 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:00.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:00 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:01.032 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:00 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:00.844+0000 7f7319205040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:22:01.032 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:01.000+0000 7f7319205040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:22:01.133 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:00.880+0000 7fc72a408040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:22:01.133 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:00 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:00.942+0000 7fc72a408040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:22:01.373 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:01.069+0000 7f7319205040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:22:01.373 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:01.130+0000 7f7319205040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:22:01.373 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:01.306+0000 7f7319205040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:22:01.373 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:01.372+0000 7f7319205040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:22:01.583 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:01.131+0000 7fc72a408040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:22:01.644 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:01.441+0000 7f7319205040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:01.524+0000 7f7319205040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:01.584+0000 7f7319205040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:01.644+0000 7f7319205040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1228566998' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82d9fecb-4353-4e63-991f-ef618ea5ae21"}]: dispatch 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82d9fecb-4353-4e63-991f-ef618ea5ae21"}]: dispatch 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82d9fecb-4353-4e63-991f-ef618ea5ae21"}]': finished 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.646 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.646 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.646 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:01.646 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:01.646 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.646 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/453568112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:01.646 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:01.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1228566998' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82d9fecb-4353-4e63-991f-ef618ea5ae21"}]: dispatch 2024-09-11T22:22:01.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82d9fecb-4353-4e63-991f-ef618ea5ae21"}]: dispatch 2024-09-11T22:22:01.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82d9fecb-4353-4e63-991f-ef618ea5ae21"}]': finished 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/453568112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:01.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:02.034 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1228566998' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82d9fecb-4353-4e63-991f-ef618ea5ae21"}]: dispatch 2024-09-11T22:22:02.034 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82d9fecb-4353-4e63-991f-ef618ea5ae21"}]: dispatch 2024-09-11T22:22:02.034 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82d9fecb-4353-4e63-991f-ef618ea5ae21"}]': finished 2024-09-11T22:22:02.034 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/453568112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:02.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:02.333 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:02.033+0000 7fc72a408040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:22:02.333 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:02.100+0000 7fc72a408040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:22:02.694 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z[37329]: 2024-09-11T22:22:02.433+0000 7f7319205040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: Standby manager daemon z started 2024-09-11T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:22:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:22:02.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:02 smithi040 ceph-mon[30787]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:22:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: Standby manager daemon z started 2024-09-11T22:22:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:22:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:22:03.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:22:03.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:02 smithi177 ceph-mon[35530]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:22:03.078 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:03.078 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:03.078 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:03.078 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:03.078 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:03.078 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: Standby manager daemon z started 2024-09-11T22:22:03.078 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T22:22:03.078 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:22:03.078 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T22:22:03.079 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-mon[34996]: from='mgr.? 172.21.15.177:0/3012402719' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:22:03.079 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:02.821+0000 7fc72a408040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:22:03.079 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:02 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:02.936+0000 7fc72a408040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:22:03.079 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.076+0000 7fc72a408040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:22:03.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:03.105+0000 7fcbad600640 1 -- 172.21.15.40:0/2217017035 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7fcb9c003800 con 0x7fcbb0104f60 2024-09-11T22:22:03.333 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.139+0000 7fc72a408040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:22:03.333 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.286+0000 7fc72a408040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:22:03.633 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.354+0000 7fc72a408040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:22:03.633 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.412+0000 7fc72a408040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:22:03.633 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.568+0000 7fc72a408040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:22:03.633 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.632+0000 7fc72a408040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:22:03.898 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.699+0000 7fc72a408040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:22:03.898 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.780+0000 7fc72a408040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:22:03.899 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.839+0000 7fc72a408040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:22:03.899 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:03.897+0000 7fc72a408040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:22:04.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:04 smithi146 ceph-mon[34996]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:04.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:04 smithi146 ceph-mon[34996]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-11T22:22:04.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:04 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:22:04.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:04 smithi040 ceph-mon[30787]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:04.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:04 smithi040 ceph-mon[30787]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-11T22:22:04.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:04 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:22:04.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:04 smithi177 ceph-mon[35530]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:04.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:04 smithi177 ceph-mon[35530]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-11T22:22:04.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:04 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T22:22:05.083 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:22:04 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y[36363]: 2024-09-11T22:22:04.678+0000 7fc72a408040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:22:05.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:05.118+0000 7fcbad600640 1 -- 172.21.15.40:0/2217017035 <== mon.1 v2:172.21.15.177:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fcb9c03bc60 con 0x7fcbb0104f60 2024-09-11T22:22:05.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:05 smithi040 ceph-mon[30787]: Standby manager daemon y started 2024-09-11T22:22:05.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:05 smithi040 ceph-mon[30787]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:22:05.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:05 smithi040 ceph-mon[30787]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:22:05.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:05 smithi040 ceph-mon[30787]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:22:05.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:05 smithi040 ceph-mon[30787]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:22:05.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:05 smithi177 ceph-mon[35530]: Standby manager daemon y started 2024-09-11T22:22:05.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:05 smithi177 ceph-mon[35530]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:22:05.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:05 smithi177 ceph-mon[35530]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:22:05.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:05 smithi177 ceph-mon[35530]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:22:05.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:05 smithi177 ceph-mon[35530]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:22:05.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:05 smithi146 ceph-mon[34996]: Standby manager daemon y started 2024-09-11T22:22:05.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:05 smithi146 ceph-mon[34996]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T22:22:05.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:05 smithi146 ceph-mon[34996]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T22:22:05.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:05 smithi146 ceph-mon[34996]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T22:22:05.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:05 smithi146 ceph-mon[34996]: from='mgr.? 172.21.15.146:0/1446381108' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T22:22:06.165 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:06 smithi040 ceph-mon[30787]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:06.165 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:06 smithi040 ceph-mon[30787]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-11T22:22:06.165 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:22:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:06 smithi177 ceph-mon[35530]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:06 smithi177 ceph-mon[35530]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-11T22:22:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:22:06.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:06 smithi146 ceph-mon[34996]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:06.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:06 smithi146 ceph-mon[34996]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-11T22:22:06.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T22:22:08.403 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:08 smithi040 ceph-mon[30787]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:08.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:08 smithi177 ceph-mon[35530]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:08.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:08 smithi146 ceph-mon[34996]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:10.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:10 smithi040 ceph-mon[30787]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:10.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T22:22:10.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:10.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:10 smithi040 ceph-mon[30787]: Deploying daemon osd.0 on smithi040 2024-09-11T22:22:10.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:10 smithi177 ceph-mon[35530]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:10.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T22:22:10.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:10.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:10 smithi177 ceph-mon[35530]: Deploying daemon osd.0 on smithi040 2024-09-11T22:22:10.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:10 smithi146 ceph-mon[34996]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:10.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T22:22:10.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:10.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:10 smithi146 ceph-mon[34996]: Deploying daemon osd.0 on smithi040 2024-09-11T22:22:12.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:12 smithi040 ceph-mon[30787]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:12.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:12 smithi177 ceph-mon[35530]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:12.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:12 smithi146 ceph-mon[34996]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:14.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:14 smithi040 ceph-mon[30787]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:14.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:14 smithi177 ceph-mon[35530]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:14.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:14 smithi146 ceph-mon[34996]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:16.305 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:16 smithi040 ceph-mon[30787]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:16.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:16 smithi177 ceph-mon[35530]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:16.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:16 smithi146 ceph-mon[34996]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:17.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:17 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:17.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:17 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:17.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:17 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:17.485 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:17 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:17.485 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:17 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:17.485 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:17 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:17.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:17 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:17.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:17 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:17.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:17 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:18.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:18 smithi040 ceph-mon[30787]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:18.416 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:18 smithi177 ceph-mon[35530]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:18.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:18 smithi146 ceph-mon[34996]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:20.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:20 smithi040 ceph-mon[30787]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:20.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:20.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:20.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:20.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:20.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:20.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:20 smithi177 ceph-mon[35530]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:20.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:20.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:20.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:20.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:20.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:20.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:20 smithi146 ceph-mon[34996]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:20.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:20.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:20.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:20.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:20.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.790+0000 7fcbad600640 1 -- 172.21.15.40:0/2217017035 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcbb0062630 con 0x7fcb980392c0 2024-09-11T22:22:21.791 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 0 on host 'smithi040' 2024-09-11T22:22:21.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.792+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb980392c0 msgr2=0x7fcb9803b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.792+0000 7fcbb7800640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb980392c0 0x7fcb9803b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009fd0 tx=0x7fcba4009500 comp rx=0 tx=0).stop 2024-09-11T22:22:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0104f60 msgr2=0x7fcbb019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0104f60 0x7fcbb019a670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009230 tx=0x7fcb9c032ce0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 shutdown_connections 2024-09-11T22:22:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb980392c0 0x7fcb9803b780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbb0105920 0x7fcbb01a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0104f60 0x7fcbb019a670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 --2- 172.21.15.40:0/2217017035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb0103e00 0x7fcbb019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 >> 172.21.15.40:0/2217017035 conn(0x7fcbb00ff5b0 msgr2=0x7fcbb0108320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 shutdown_connections 2024-09-11T22:22:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:22:21.793+0000 7fcbb7800640 1 -- 172.21.15.40:0/2217017035 wait complete. 2024-09-11T22:22:22.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:22 smithi177 ceph-mon[35530]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:22.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:22.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:22.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:22.299 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:22 smithi040 ceph-mon[30787]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:22.299 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:22.299 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:22.299 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:22.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:22 smithi146 ceph-mon[34996]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:22.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:22.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:22.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:22.515 DEBUG:teuthology.orchestra.run.smithi040:osd.0> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T22:22:22.519 INFO:tasks.cephadm:Deploying osd.1 on smithi146 with /dev/vg_nvme/lv_4... 2024-09-11T22:22:22.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T22:22:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:22:23.228 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:23 smithi146 ceph-mon[34996]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T22:22:23.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:23 smithi040 ceph-mon[30787]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T22:22:23.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:23 smithi177 ceph-mon[35530]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T22:22:24.151 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:24 smithi146 ceph-mon[34996]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:24.151 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:24 smithi146 ceph-mon[34996]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T22:22:24.151 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:24 smithi146 ceph-mon[34996]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T22:22:24.151 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:24 smithi146 ceph-mon[34996]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:22:24.151 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:24.281 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:24 smithi040 ceph-mon[30787]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:24.282 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:24 smithi040 ceph-mon[30787]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T22:22:24.282 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:24 smithi040 ceph-mon[30787]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T22:22:24.282 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:24 smithi040 ceph-mon[30787]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:22:24.282 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:24.282 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:22:24 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0[42166]: 2024-09-11T22:22:24.047+0000 7f4069800640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T22:22:24.282 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:22:24 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0[42166]: 2024-09-11T22:22:24.050+0000 7f4064800640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:22:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:24 smithi177 ceph-mon[35530]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:24 smithi177 ceph-mon[35530]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T22:22:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:24 smithi177 ceph-mon[35530]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T22:22:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:24 smithi177 ceph-mon[35530]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:22:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:25.247 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:25 smithi146 ceph-mon[34996]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:22:25.247 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:25 smithi146 ceph-mon[34996]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T22:22:25.247 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:25.247 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:25.249 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:22:25.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_4 2024-09-11T22:22:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:25 smithi040 ceph-mon[30787]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:22:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:25 smithi040 ceph-mon[30787]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T22:22:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:25.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:25.519 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:22:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:25 smithi177 ceph-mon[35530]: from='osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:22:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:25 smithi177 ceph-mon[35530]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T22:22:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:25.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.983+0000 7f037cfc8640 1 -- 172.21.15.146:0/2341310413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03781026a0 msgr2=0x7f0378104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:25.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.983+0000 7f037cfc8640 1 --2- 172.21.15.146:0/2341310413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03781026a0 0x7f0378104a90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0368009900 tx=0x7f036802a410 comp rx=0 tx=0).stop 2024-09-11T22:22:25.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.983+0000 7f037cfc8640 1 -- 172.21.15.146:0/2341310413 shutdown_connections 2024-09-11T22:22:25.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.983+0000 7f037cfc8640 1 --2- 172.21.15.146:0/2341310413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0378107900 0x7f0378109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.983+0000 7f037cfc8640 1 --2- 172.21.15.146:0/2341310413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0378104fd0 0x7f03781073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.983+0000 7f037cfc8640 1 --2- 172.21.15.146:0/2341310413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03781026a0 0x7f0378104a90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.983+0000 7f037cfc8640 1 -- 172.21.15.146:0/2341310413 >> 172.21.15.146:0/2341310413 conn(0x7f03780fc2a0 msgr2=0x7f03780fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.983+0000 7f037cfc8640 1 -- 172.21.15.146:0/2341310413 shutdown_connections 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.983+0000 7f037cfc8640 1 -- 172.21.15.146:0/2341310413 wait complete. 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.984+0000 7f037cfc8640 1 Processor -- start 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.984+0000 7f037cfc8640 1 -- start start 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.984+0000 7f037cfc8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03781026a0 0x7f0378197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.984+0000 7f037cfc8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0378104fd0 0x7f03781984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.984+0000 7f037cfc8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0378107900 0x7f037819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.984+0000 7f037cfc8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f037810d8d0 con 0x7f03781026a0 2024-09-11T22:22:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f037cfc8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f037810d750 con 0x7f0378104fd0 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f037cfc8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f037810da50 con 0x7f0378107900 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0378104fd0 0x7f03781984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0378104fd0 0x7f03781984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40156/0 (socket says 172.21.15.146:40156) 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036dd9b640 1 -- 172.21.15.146:0/1421189152 learned_addr learned my addr 172.21.15.146:0/1421189152 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f037659c640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03781026a0 0x7f0378197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f0376d9d640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0378107900 0x7f037819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036dd9b640 1 -- 172.21.15.146:0/1421189152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0378107900 msgr2=0x7f037819f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036dd9b640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0378107900 0x7f037819f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036dd9b640 1 -- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03781026a0 msgr2=0x7f0378197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036dd9b640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03781026a0 0x7f0378197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036dd9b640 1 -- 172.21.15.146:0/1421189152 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037819fbb0 con 0x7f0378104fd0 2024-09-11T22:22:25.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036dd9b640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0378104fd0 0x7f03781984c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f036000d740 tx=0x7f036000dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036ffff640 1 -- 172.21.15.146:0/1421189152 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360017070 con 0x7f0378104fd0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036ffff640 1 -- 172.21.15.146:0/1421189152 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f036000de50 con 0x7f0378104fd0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037819fea0 con 0x7f0378104fd0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f036ffff640 1 -- 172.21.15.146:0/1421189152 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360004e00 con 0x7f0378104fd0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.985+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03781a0300 con 0x7f0378104fd0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.986+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03780fdd90 con 0x7f0378104fd0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.987+0000 7f036ffff640 1 -- 172.21.15.146:0/1421189152 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f0360004fa0 con 0x7f0378104fd0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.988+0000 7f036ffff640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f03640a2b20 0x7f03640a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.988+0000 7f036ffff640 1 -- 172.21.15.146:0/1421189152 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f03600cceb0 con 0x7f0378104fd0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.988+0000 7f037659c640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f03640a2b20 0x7f03640a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:25.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.989+0000 7f037659c640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f03640a2b20 0x7f03640a4fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03680314e0 tx=0x7f0368000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:25.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:25.993+0000 7f036ffff640 1 -- 172.21.15.146:0/1421189152 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f036009b230 con 0x7f0378104fd0 2024-09-11T22:22:26.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:26.172+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0378062630 con 0x7f03640a2b20 2024-09-11T22:22:26.313 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:22:26.313 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] boot 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:26.314 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:26.315 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:26 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.315 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:22:26.315 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:22:26.315 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:26.315 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:26.315 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] boot 2024-09-11T22:22:26.316 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T22:22:26.316 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:26.316 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.316 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.316 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:26.316 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.316 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:26.316 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:26.316 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:26 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:22:26.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:22:26.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T22:22:26.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: osd.0 [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] boot 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:26 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:27.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:27 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi040 2024-09-11T22:22:27.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:27 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi040 to 17094M 2024-09-11T22:22:27.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:27 smithi146 ceph-mon[34996]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T22:22:27.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:27 smithi146 ceph-mon[34996]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:27.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:27.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:27.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:27.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:27 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi040 2024-09-11T22:22:27.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:27 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi040 to 17094M 2024-09-11T22:22:27.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:27 smithi040 ceph-mon[30787]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T22:22:27.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:27 smithi040 ceph-mon[30787]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:27.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:27.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:27.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:27.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:27 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi040 2024-09-11T22:22:27.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:27 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi040 to 17094M 2024-09-11T22:22:27.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:27 smithi177 ceph-mon[35530]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T22:22:27.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:27 smithi177 ceph-mon[35530]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:27.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:27.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:27.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:28.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:28 smithi146 ceph-mon[34996]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:28.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:28 smithi040 ceph-mon[30787]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:28.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:28 smithi177 ceph-mon[35530]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:29.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:29 smithi146 ceph-mon[34996]: from='client.? 172.21.15.146:0/1094330495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b36cbf5-f4e4-462a-bbb9-81d2853f01bc"}]: dispatch 2024-09-11T22:22:29.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:29 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b36cbf5-f4e4-462a-bbb9-81d2853f01bc"}]: dispatch 2024-09-11T22:22:29.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:29 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b36cbf5-f4e4-462a-bbb9-81d2853f01bc"}]': finished 2024-09-11T22:22:29.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:29 smithi146 ceph-mon[34996]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T22:22:29.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:29.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:29 smithi146 ceph-mon[34996]: from='client.? 172.21.15.146:0/918857241' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:29.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:29 smithi040 ceph-mon[30787]: from='client.? 172.21.15.146:0/1094330495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b36cbf5-f4e4-462a-bbb9-81d2853f01bc"}]: dispatch 2024-09-11T22:22:29.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:29 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b36cbf5-f4e4-462a-bbb9-81d2853f01bc"}]: dispatch 2024-09-11T22:22:29.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:29 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b36cbf5-f4e4-462a-bbb9-81d2853f01bc"}]': finished 2024-09-11T22:22:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:29 smithi040 ceph-mon[30787]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T22:22:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:29 smithi040 ceph-mon[30787]: from='client.? 172.21.15.146:0/918857241' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:29.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:29 smithi177 ceph-mon[35530]: from='client.? 172.21.15.146:0/1094330495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b36cbf5-f4e4-462a-bbb9-81d2853f01bc"}]: dispatch 2024-09-11T22:22:29.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:29 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b36cbf5-f4e4-462a-bbb9-81d2853f01bc"}]: dispatch 2024-09-11T22:22:29.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:29 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b36cbf5-f4e4-462a-bbb9-81d2853f01bc"}]': finished 2024-09-11T22:22:29.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:29 smithi177 ceph-mon[35530]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T22:22:29.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:29.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:29 smithi177 ceph-mon[35530]: from='client.? 172.21.15.146:0/918857241' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:30.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:30 smithi040 ceph-mon[30787]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:30.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:30 smithi177 ceph-mon[35530]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:30.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:30 smithi146 ceph-mon[34996]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:32.772 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:32 smithi146 ceph-mon[34996]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:32.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:32 smithi177 ceph-mon[35530]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:32.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:32 smithi040 ceph-mon[30787]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:34.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:34 smithi177 ceph-mon[35530]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:34.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:34 smithi146 ceph-mon[34996]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:34.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:34 smithi040 ceph-mon[30787]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:36 smithi177 ceph-mon[35530]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T22:22:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:36.823 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:36 smithi146 ceph-mon[34996]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:36.823 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T22:22:36.823 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:36.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:36 smithi040 ceph-mon[30787]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:36.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T22:22:36.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:37.755 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:37 smithi146 ceph-mon[34996]: Deploying daemon osd.1 on smithi146 2024-09-11T22:22:37.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:37 smithi177 ceph-mon[35530]: Deploying daemon osd.1 on smithi146 2024-09-11T22:22:37.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:37 smithi040 ceph-mon[30787]: Deploying daemon osd.1 on smithi146 2024-09-11T22:22:38.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:38 smithi146 ceph-mon[34996]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:38.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:38 smithi177 ceph-mon[35530]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:38.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:38 smithi040 ceph-mon[30787]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:40.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:40 smithi177 ceph-mon[35530]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:40.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:40 smithi146 ceph-mon[34996]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:40.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:40 smithi040 ceph-mon[30787]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:42.770 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:42 smithi146 ceph-mon[34996]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:42.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:42 smithi177 ceph-mon[35530]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:42.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:42 smithi040 ceph-mon[30787]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:43.582 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:43 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:43.582 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:43 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:43.582 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:43 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:43.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:43 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:43.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:43 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:43.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:43 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:43.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:43 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:43.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:43 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:43.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:43 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:45.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:44 smithi146 ceph-mon[34996]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:44 smithi040 ceph-mon[30787]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:44 smithi177 ceph-mon[35530]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:46.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:46 smithi146 ceph-mon[34996]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:46.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:46 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:46.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:46 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:46.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:46 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:46.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:46 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:46.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:46 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:46 smithi040 ceph-mon[30787]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:46.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:46.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:46.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:46.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:46 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:46.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:46 smithi177 ceph-mon[35530]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:46.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:46.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:46.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:46.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:46.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:46 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.959+0000 7f036ffff640 1 -- 172.21.15.146:0/1421189152 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0378062630 con 0x7f03640a2b20 2024-09-11T22:22:46.961 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 1 on host 'smithi146' 2024-09-11T22:22:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.961+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f03640a2b20 msgr2=0x7f03640a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f03640a2b20 0x7f03640a4fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03680314e0 tx=0x7f0368000bc0 comp rx=0 tx=0).stop 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0378104fd0 msgr2=0x7f03781984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0378104fd0 0x7f03781984c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f036000d740 tx=0x7f036000dc00 comp rx=0 tx=0).stop 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 shutdown_connections 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f03640a2b20 0x7f03640a4fe0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0378107900 0x7f037819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0378104fd0 0x7f03781984c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 --2- 172.21.15.146:0/1421189152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03781026a0 0x7f0378197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 >> 172.21.15.146:0/1421189152 conn(0x7f03780fc2a0 msgr2=0x7f0378103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 shutdown_connections 2024-09-11T22:22:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:22:46.962+0000 7f037cfc8640 1 -- 172.21.15.146:0/1421189152 wait complete. 2024-09-11T22:22:47.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:47 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:47.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:47 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:47.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:47 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:47.649 DEBUG:teuthology.orchestra.run.smithi146:osd.1> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T22:22:47.651 INFO:tasks.cephadm:Deploying osd.2 on smithi177 with /dev/vg_nvme/lv_4... 2024-09-11T22:22:47.652 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T22:22:47.679 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:47.679 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:47.679 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:22:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:47.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:22:48.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:48 smithi146 ceph-mon[34996]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:48.709 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:48 smithi177 ceph-mon[35530]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:48.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:48 smithi040 ceph-mon[30787]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:49.046 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:22:48 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1[39449]: 2024-09-11T22:22:48.847+0000 7fbb9350c640 -1 osd.1 0 log_to_monitors true 2024-09-11T22:22:49.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:49 smithi177 ceph-mon[35530]: from='osd.1 [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:49.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:49 smithi177 ceph-mon[35530]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:49 smithi146 ceph-mon[34996]: from='osd.1 [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:49.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:49 smithi146 ceph-mon[34996]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:49.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:49 smithi040 ceph-mon[30787]: from='osd.1 [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:49.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:49 smithi040 ceph-mon[30787]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T22:22:50.324 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:22:50.351 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_4 2024-09-11T22:22:50.626 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:50 smithi177 ceph-mon[35530]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:50.626 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:50 smithi177 ceph-mon[35530]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T22:22:50.626 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:50 smithi177 ceph-mon[35530]: from='osd.1 [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:22:50.626 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:50 smithi177 ceph-mon[35530]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T22:22:50.626 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:50.626 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:50 smithi177 ceph-mon[35530]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:22:50.640 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:22:50.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:50 smithi040 ceph-mon[30787]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:50.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:50 smithi040 ceph-mon[30787]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T22:22:50.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:50 smithi040 ceph-mon[30787]: from='osd.1 [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:22:50.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:50 smithi040 ceph-mon[30787]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T22:22:50.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:50.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:50 smithi040 ceph-mon[30787]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:22:50.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:50 smithi146 ceph-mon[34996]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:50.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:50 smithi146 ceph-mon[34996]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T22:22:50.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:50 smithi146 ceph-mon[34996]: from='osd.1 [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:22:50.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:50 smithi146 ceph-mon[34996]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T22:22:50.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:50.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:50 smithi146 ceph-mon[34996]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:22:50.834 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:22:50 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1[39449]: 2024-09-11T22:22:50.403+0000 7fbb8f48f640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T22:22:50.834 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:22:50 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1[39449]: 2024-09-11T22:22:50.408+0000 7fbb8b2b7640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:22:51.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.092+0000 7fd638599640 1 -- 172.21.15.177:0/3038234741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 msgr2=0x7fd630102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.092+0000 7fd638599640 1 --2- 172.21.15.177:0/3038234741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 0x7fd630102150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd620009900 tx=0x7fd62002a410 comp rx=0 tx=0).stop 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.092+0000 7fd638599640 1 -- 172.21.15.177:0/3038234741 shutdown_connections 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.092+0000 7fd638599640 1 --2- 172.21.15.177:0/3038234741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd630102690 0x7fd630108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.092+0000 7fd638599640 1 --2- 172.21.15.177:0/3038234741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 0x7fd630102150 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.092+0000 7fd638599640 1 --2- 172.21.15.177:0/3038234741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd630100ad0 0x7fd630100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.092+0000 7fd638599640 1 -- 172.21.15.177:0/3038234741 >> 172.21.15.177:0/3038234741 conn(0x7fd6300fc280 msgr2=0x7fd6300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.092+0000 7fd638599640 1 -- 172.21.15.177:0/3038234741 shutdown_connections 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.092+0000 7fd638599640 1 -- 172.21.15.177:0/3038234741 wait complete. 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd638599640 1 Processor -- start 2024-09-11T22:22:51.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd638599640 1 -- start start 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd638599640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd630100ad0 0x7fd63006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd638599640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 0x7fd63019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd638599640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd630102690 0x7fd63019f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd638599640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd63010c7b0 con 0x7fd630102690 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd638599640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd63010c630 con 0x7fd630100ad0 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd638599640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd63010c930 con 0x7fd630101cd0 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd635b34640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 0x7fd63019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd635b34640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 0x7fd63019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51712/0 (socket says 172.21.15.177:51712) 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd635b34640 1 -- 172.21.15.177:0/666116074 learned_addr learned my addr 172.21.15.177:0/666116074 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:22:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd636335640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd630100ad0 0x7fd63006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.093+0000 7fd636b36640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd630102690 0x7fd63019f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd635b34640 1 -- 172.21.15.177:0/666116074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd630100ad0 msgr2=0x7fd63006aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd635b34640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd630100ad0 0x7fd63006aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd635b34640 1 -- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd630102690 msgr2=0x7fd63019f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd635b34640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd630102690 0x7fd63019f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd635b34640 1 -- 172.21.15.177:0/666116074 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63019fbc0 con 0x7fd630101cd0 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd636335640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd630100ad0 0x7fd63006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd636b36640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd630102690 0x7fd63019f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd635b34640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 0x7fd63019cc90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd620009230 tx=0x7fd620004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd6277fe640 1 -- 172.21.15.177:0/666116074 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62003f030 con 0x7fd630101cd0 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63019fdf0 con 0x7fd630101cd0 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd6277fe640 1 -- 172.21.15.177:0/666116074 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd620003ce0 con 0x7fd630101cd0 2024-09-11T22:22:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd6277fe640 1 -- 172.21.15.177:0/666116074 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620035070 con 0x7fd630101cd0 2024-09-11T22:22:51.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.094+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6301a02d0 con 0x7fd630101cd0 2024-09-11T22:22:51.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.095+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd630107e70 con 0x7fd630101cd0 2024-09-11T22:22:51.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.096+0000 7fd6277fe640 1 -- 172.21.15.177:0/666116074 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fd620042030 con 0x7fd630101cd0 2024-09-11T22:22:51.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.097+0000 7fd6277fe640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd61c0a2b70 0x7fd61c0a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:51.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.097+0000 7fd6277fe640 1 -- 172.21.15.177:0/666116074 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fd6200edd30 con 0x7fd630101cd0 2024-09-11T22:22:51.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.097+0000 7fd636335640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd61c0a2b70 0x7fd61c0a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:51.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.098+0000 7fd636335640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd61c0a2b70 0x7fd61c0a5030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd630101b30 tx=0x7fd62c005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.101+0000 7fd6277fe640 1 -- 172.21.15.177:0/666116074 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6200f2070 con 0x7fd630101cd0 2024-09-11T22:22:51.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:22:51.282+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd630062630 con 0x7fd61c0a2b70 2024-09-11T22:22:51.644 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:22:51.644 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T22:22:51.644 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:51.644 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:51.644 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi146 2024-09-11T22:22:51.644 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi146 to 17088M 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:51.645 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:22:51.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi146 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi146 to 17088M 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:51.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:51.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:51.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:22:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T22:22:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi146 2024-09-11T22:22:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:22:51.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi146 to 17088M 2024-09-11T22:22:51.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:51.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:22:51.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:22:51.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:22:51.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:22:51.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:22:52.654 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:52 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:22:52.654 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:52 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:22:52.655 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:52 smithi177 ceph-mon[35530]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:52.655 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:52 smithi177 ceph-mon[35530]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:52.655 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:52 smithi177 ceph-mon[35530]: osd.1 [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] boot 2024-09-11T22:22:52.655 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:52 smithi177 ceph-mon[35530]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T22:22:52.655 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:52 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:52.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:52 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:22:52.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:52 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:22:52.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:52 smithi040 ceph-mon[30787]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:52.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:52 smithi040 ceph-mon[30787]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:52.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:52 smithi040 ceph-mon[30787]: osd.1 [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] boot 2024-09-11T22:22:52.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:52 smithi040 ceph-mon[30787]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T22:22:52.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:52 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:52.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:52 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:22:52.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:52 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:22:52.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:52 smithi146 ceph-mon[34996]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-11T22:22:52.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:52 smithi146 ceph-mon[34996]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:22:52.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:52 smithi146 ceph-mon[34996]: osd.1 [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] boot 2024-09-11T22:22:52.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:52 smithi146 ceph-mon[34996]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T22:22:52.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:52 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T22:22:53.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:53 smithi177 ceph-mon[35530]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T22:22:53.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:53 smithi146 ceph-mon[34996]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T22:22:53.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:53 smithi040 ceph-mon[30787]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T22:22:54.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:54 smithi146 ceph-mon[34996]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:54.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:54 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/4041130576' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58cf9867-bceb-454d-9fce-95755e4ab2fb"}]: dispatch 2024-09-11T22:22:54.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:54 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58cf9867-bceb-454d-9fce-95755e4ab2fb"}]: dispatch 2024-09-11T22:22:54.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:54 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "58cf9867-bceb-454d-9fce-95755e4ab2fb"}]': finished 2024-09-11T22:22:54.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:54 smithi146 ceph-mon[34996]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T22:22:54.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:54.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:54 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/2953482882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:54.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:54 smithi040 ceph-mon[30787]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:54 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/4041130576' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58cf9867-bceb-454d-9fce-95755e4ab2fb"}]: dispatch 2024-09-11T22:22:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:54 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58cf9867-bceb-454d-9fce-95755e4ab2fb"}]: dispatch 2024-09-11T22:22:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:54 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "58cf9867-bceb-454d-9fce-95755e4ab2fb"}]': finished 2024-09-11T22:22:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:54 smithi040 ceph-mon[30787]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T22:22:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:54 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/2953482882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:54 smithi177 ceph-mon[35530]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:54 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/4041130576' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58cf9867-bceb-454d-9fce-95755e4ab2fb"}]: dispatch 2024-09-11T22:22:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:54 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "58cf9867-bceb-454d-9fce-95755e4ab2fb"}]: dispatch 2024-09-11T22:22:55.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:54 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "58cf9867-bceb-454d-9fce-95755e4ab2fb"}]': finished 2024-09-11T22:22:55.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:54 smithi177 ceph-mon[35530]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T22:22:55.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:22:55.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:54 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/2953482882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:22:56.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:56 smithi146 ceph-mon[34996]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:56.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:56 smithi040 ceph-mon[30787]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:57.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:56 smithi177 ceph-mon[35530]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:58.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:22:58 smithi146 ceph-mon[34996]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:58.903 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:22:58 smithi177 ceph-mon[35530]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:22:58.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:22:58 smithi040 ceph-mon[30787]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:00.767 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:00 smithi177 ceph-mon[35530]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:00.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:00 smithi146 ceph-mon[34996]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:00.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:00 smithi040 ceph-mon[30787]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:01.717 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T22:23:01.717 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:01.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T22:23:01.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T22:23:01.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:02.810 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:02 smithi177 ceph-mon[35530]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:02.811 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:02 smithi177 ceph-mon[35530]: Deploying daemon osd.2 on smithi177 2024-09-11T22:23:02.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:02 smithi146 ceph-mon[34996]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:02.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:02 smithi146 ceph-mon[34996]: Deploying daemon osd.2 on smithi177 2024-09-11T22:23:02.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:02 smithi040 ceph-mon[30787]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:02.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:02 smithi040 ceph-mon[30787]: Deploying daemon osd.2 on smithi177 2024-09-11T22:23:04.806 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:04 smithi177 ceph-mon[35530]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:04.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:04 smithi146 ceph-mon[34996]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:04.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:04 smithi040 ceph-mon[30787]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:06.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:06 smithi177 ceph-mon[35530]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:06.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:06 smithi146 ceph-mon[34996]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:06.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:06 smithi040 ceph-mon[30787]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:08.760 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:08 smithi177 ceph-mon[35530]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:08.761 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:08 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:08.761 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:08 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:08.761 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:08 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:08.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:08 smithi146 ceph-mon[34996]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:08.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:08 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:08.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:08 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:08.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:08 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:08.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:08 smithi040 ceph-mon[30787]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:08.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:08 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:08.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:08 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:08.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:08 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:10 smithi146 ceph-mon[34996]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:10 smithi040 ceph-mon[30787]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:11.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:10 smithi177 ceph-mon[35530]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:11.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:11.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:11.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:11.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:11.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:11.365 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 2 on host 'smithi177' 2024-09-11T22:23:11.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.364+0000 7fd6277fe640 1 -- 172.21.15.177:0/666116074 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd630062630 con 0x7fd61c0a2b70 2024-09-11T22:23:11.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd61c0a2b70 msgr2=0x7fd61c0a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:11.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd61c0a2b70 0x7fd61c0a5030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd630101b30 tx=0x7fd62c005e70 comp rx=0 tx=0).stop 2024-09-11T22:23:11.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 msgr2=0x7fd63019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:11.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 0x7fd63019cc90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd620009230 tx=0x7fd620004360 comp rx=0 tx=0).stop 2024-09-11T22:23:11.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 shutdown_connections 2024-09-11T22:23:11.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd61c0a2b70 0x7fd61c0a5030 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd630102690 0x7fd63019f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd630101cd0 0x7fd63019cc90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 --2- 172.21.15.177:0/666116074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd630100ad0 0x7fd63006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.366+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 >> 172.21.15.177:0/666116074 conn(0x7fd6300fc280 msgr2=0x7fd630105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.367+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 shutdown_connections 2024-09-11T22:23:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:23:11.367+0000 7fd638599640 1 -- 172.21.15.177:0/666116074 wait complete. 2024-09-11T22:23:11.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:11.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:11.716 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:11.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:11.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:12.001 DEBUG:teuthology.orchestra.run.smithi177:osd.2> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T22:23:12.003 INFO:tasks.cephadm:Deploying osd.3 on smithi040 with /dev/vg_nvme/lv_3... 2024-09-11T22:23:12.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T22:23:12.380 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:23:12.794 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:12 smithi040 ceph-mon[30787]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:12.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:12 smithi146 ceph-mon[34996]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:13.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:12 smithi177 ceph-mon[35530]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:14.033 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:13 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2[40487]: 2024-09-11T22:23:13.733+0000 7f1aca61f640 -1 osd.2 0 log_to_monitors true 2024-09-11T22:23:14.698 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:14 smithi040 ceph-mon[30787]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:14.699 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:14 smithi040 ceph-mon[30787]: from='osd.2 [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:23:14.699 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:14 smithi040 ceph-mon[30787]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:23:14.740 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:14 smithi177 ceph-mon[35530]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:14.740 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:14 smithi177 ceph-mon[35530]: from='osd.2 [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:23:14.740 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:14 smithi177 ceph-mon[35530]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:23:15.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:14 smithi146 ceph-mon[34996]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:15.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:14 smithi146 ceph-mon[34996]: from='osd.2 [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:23:15.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:14 smithi146 ceph-mon[34996]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T22:23:15.370 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:23:15.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi040:vg_nvme/lv_3 2024-09-11T22:23:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:23:15.915 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='osd.2 [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi177 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi177 to 17087M 2024-09-11T22:23:15.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:15.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:15.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:15.917 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:15 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:16.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T22:23:16.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T22:23:16.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:16.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='osd.2 [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:23:16.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:23:16.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi177 2024-09-11T22:23:16.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:16.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:16.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:16.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi177 to 17087M 2024-09-11T22:23:16.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:16.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:16.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:16.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:15 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:16.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='osd.2 [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi177 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi177 to 17087M 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:16.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:16.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:16.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:15 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:16.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.269+0000 7f9dbe200640 1 -- 172.21.15.40:0/2050413371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db8102e00 msgr2=0x7f9db8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.269+0000 7f9dbe200640 1 --2- 172.21.15.40:0/2050413371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db8102e00 0x7f9db8103280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009860 tx=0x7f9da402a340 comp rx=0 tx=0).stop 2024-09-11T22:23:16.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.269+0000 7f9dbe200640 1 -- 172.21.15.40:0/2050413371 shutdown_connections 2024-09-11T22:23:16.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.269+0000 7f9dbe200640 1 --2- 172.21.15.40:0/2050413371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db81037c0 0x7f9db810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.269+0000 7f9dbe200640 1 --2- 172.21.15.40:0/2050413371 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db8102e00 0x7f9db8103280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.269+0000 7f9dbe200640 1 --2- 172.21.15.40:0/2050413371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db8101c00 0x7f9db8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.269+0000 7f9dbe200640 1 -- 172.21.15.40:0/2050413371 >> 172.21.15.40:0/2050413371 conn(0x7f9db80fd390 msgr2=0x7f9db80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.269+0000 7f9dbe200640 1 -- 172.21.15.40:0/2050413371 shutdown_connections 2024-09-11T22:23:16.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.269+0000 7f9dbe200640 1 -- 172.21.15.40:0/2050413371 wait complete. 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.270+0000 7f9dbe200640 1 Processor -- start 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.270+0000 7f9dbe200640 1 -- start start 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.270+0000 7f9dbe200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db8101c00 0x7f9db819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.270+0000 7f9dbe200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db8102e00 0x7f9db819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.270+0000 7f9dbe200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db81037c0 0x7f9db81a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.270+0000 7f9dbe200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9db810d880 con 0x7f9db8101c00 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.270+0000 7f9dbe200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9db810d700 con 0x7f9db8102e00 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.270+0000 7f9dbe200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9db810da00 con 0x7f9db81037c0 2024-09-11T22:23:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db8101c00 0x7f9db819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db81037c0 0x7f9db81a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db81037c0 0x7f9db81a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:47240/0 (socket says 172.21.15.40:47240) 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7e00640 1 -- 172.21.15.40:0/3945954086 learned_addr learned my addr 172.21.15.40:0/3945954086 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db8101c00 0x7f9db819a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43586/0 (socket says 172.21.15.40:43586) 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db6a00640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db8102e00 0x7f9db819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7e00640 1 -- 172.21.15.40:0/3945954086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db8102e00 msgr2=0x7f9db819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7e00640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db8102e00 0x7f9db819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7e00640 1 -- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db8101c00 msgr2=0x7f9db819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7e00640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db8101c00 0x7f9db819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7e00640 1 -- 172.21.15.40:0/3945954086 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db81a1d20 con 0x7f9db81037c0 2024-09-11T22:23:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.271+0000 7f9db7400640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db8101c00 0x7f9db819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:16.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.272+0000 7f9db7e00640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db81037c0 0x7f9db81a16b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9db000efc0 tx=0x7f9db000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.272+0000 7f9dafe00640 1 -- 172.21.15.40:0/3945954086 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0003970 con 0x7f9db81037c0 2024-09-11T22:23:16.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.272+0000 7f9dafe00640 1 -- 172.21.15.40:0/3945954086 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9db0004020 con 0x7f9db81037c0 2024-09-11T22:23:16.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.272+0000 7f9dafe00640 1 -- 172.21.15.40:0/3945954086 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db000b9f0 con 0x7f9db81037c0 2024-09-11T22:23:16.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.272+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db81a1fb0 con 0x7f9db81037c0 2024-09-11T22:23:16.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.272+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db81a2410 con 0x7f9db81037c0 2024-09-11T22:23:16.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.273+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db81a26a0 con 0x7f9db81037c0 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.275+0000 7f9dafe00640 1 -- 172.21.15.40:0/3945954086 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f9db001d020 con 0x7f9db81037c0 2024-09-11T22:23:16.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.276+0000 7f9dafe00640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9d9c0a2ba0 0x7f9d9c0a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.276+0000 7f9dafe00640 1 -- 172.21.15.40:0/3945954086 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f9db00cd750 con 0x7f9db81037c0 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.276+0000 7f9db7400640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9d9c0a2ba0 0x7f9d9c0a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:16.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.277+0000 7f9db7400640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9d9c0a2ba0 0x7f9d9c0a5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9db8102c60 tx=0x7f9da8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:16.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.280+0000 7f9dafe00640 1 -- 172.21.15.40:0/3945954086 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9db009bd60 con 0x7f9db81037c0 2024-09-11T22:23:16.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:16.473+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9db8109d40 con 0x7f9d9c0a2ba0 2024-09-11T22:23:16.532 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2[40487]: 2024-09-11T22:23:16.244+0000 7f1ac65a2640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T22:23:16.532 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2[40487]: 2024-09-11T22:23:16.248+0000 7f1abe3c2640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:23:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:16 smithi040 ceph-mon[30787]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:16 smithi040 ceph-mon[30787]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:23:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:16 smithi040 ceph-mon[30787]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T22:23:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:16.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:16.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:16 smithi040 ceph-mon[30787]: from='osd.2 ' entity='osd.2' 2024-09-11T22:23:16.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:16.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:16.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:17.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-mon[35530]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:17.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-mon[35530]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:23:17.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-mon[35530]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T22:23:17.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:17.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:17.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-mon[35530]: from='osd.2 ' entity='osd.2' 2024-09-11T22:23:17.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:17.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:17.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:17.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:16 smithi146 ceph-mon[34996]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:17.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:16 smithi146 ceph-mon[34996]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:23:17.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:16 smithi146 ceph-mon[34996]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T22:23:17.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:17.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:17.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:16 smithi146 ceph-mon[34996]: from='osd.2 ' entity='osd.2' 2024-09-11T22:23:17.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:17.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:17.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:17.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:17 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:23:17.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:17 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:23:17.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:17 smithi040 ceph-mon[30787]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:17.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:17 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:17.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:17 smithi040 ceph-mon[30787]: osd.2 [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] boot 2024-09-11T22:23:17.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:17 smithi040 ceph-mon[30787]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T22:23:17.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:17 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:18.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:17 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:23:18.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:17 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:23:18.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:17 smithi177 ceph-mon[35530]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:18.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:17 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:18.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:17 smithi177 ceph-mon[35530]: osd.2 [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] boot 2024-09-11T22:23:18.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:17 smithi177 ceph-mon[35530]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T22:23:18.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:17 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:18.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:17 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:23:18.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:17 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:23:18.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:17 smithi146 ceph-mon[34996]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:18.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:17 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:18.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:17 smithi146 ceph-mon[34996]: osd.2 [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] boot 2024-09-11T22:23:18.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:17 smithi146 ceph-mon[34996]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T22:23:18.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:17 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T22:23:18.786 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:18 smithi040 ceph-mon[30787]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:18.851 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:18 smithi146 ceph-mon[34996]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:19.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:18 smithi177 ceph-mon[35530]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-11T22:23:19.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:19 smithi040 ceph-mon[30787]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T22:23:19.916 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:19 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:23:20.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:19 smithi177 ceph-mon[35530]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T22:23:20.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:19 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:23:20.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:19 smithi146 ceph-mon[34996]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T22:23:20.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:19 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:23:20.978 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: pgmap v80: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:20.978 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2953239357' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "194a6e6d-dc39-44b3-9e96-2b0420de5f53"}]: dispatch 2024-09-11T22:23:20.978 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "194a6e6d-dc39-44b3-9e96-2b0420de5f53"}]: dispatch 2024-09-11T22:23:20.978 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T22:23:20.978 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "194a6e6d-dc39-44b3-9e96-2b0420de5f53"}]': finished 2024-09-11T22:23:20.978 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T22:23:20.978 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:20.978 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:23:20.979 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2525345807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:20.979 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:23:20.979 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T22:23:20.979 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:20.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: pgmap v80: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:20.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2953239357' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "194a6e6d-dc39-44b3-9e96-2b0420de5f53"}]: dispatch 2024-09-11T22:23:20.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "194a6e6d-dc39-44b3-9e96-2b0420de5f53"}]: dispatch 2024-09-11T22:23:20.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T22:23:20.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "194a6e6d-dc39-44b3-9e96-2b0420de5f53"}]': finished 2024-09-11T22:23:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T22:23:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:23:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2525345807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:23:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T22:23:20.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:21.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: pgmap v80: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2953239357' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "194a6e6d-dc39-44b3-9e96-2b0420de5f53"}]: dispatch 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "194a6e6d-dc39-44b3-9e96-2b0420de5f53"}]: dispatch 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "194a6e6d-dc39-44b3-9e96-2b0420de5f53"}]': finished 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2525345807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T22:23:21.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:21.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:21.637+0000 7f9dafe00640 1 -- 172.21.15.40:0/3945954086 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9db0097cd0 con 0x7f9db81037c0 2024-09-11T22:23:21.638 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:23:21 smithi040 sudo[46985]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:23:21.638 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:23:21 smithi040 sudo[46985]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:21.638 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:23:21 smithi040 sudo[46985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:21.638 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:23:21 smithi040 sudo[46985]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:21.888 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:23:21 smithi040 sudo[47175]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:23:22.234 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:23:21 smithi040 sudo[47175]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:22.234 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:23:21 smithi040 sudo[47175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:22.235 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:23:21 smithi040 sudo[47175]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:22.419 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:23:22 smithi146 sudo[43562]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:23:22.419 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:23:22 smithi146 sudo[43562]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:22.419 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:23:22 smithi146 sudo[43562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:22.419 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:23:22 smithi146 sudo[43562]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:22.834 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:23:22 smithi146 sudo[43565]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:23:22.834 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:23:22 smithi146 sudo[43565]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:22.834 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:23:22 smithi146 sudo[43565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:22.834 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:23:22 smithi146 sudo[43565]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:22 smithi146 ceph-mon[34996]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:22 smithi146 ceph-mon[34996]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T22:23:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:22 smithi146 ceph-mon[34996]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T22:23:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:22.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:22.952 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:22 smithi177 sudo[44119]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:23:22.953 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:22 smithi177 sudo[44119]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:22.953 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:22 smithi177 sudo[44119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:22.953 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:22 smithi177 sudo[44119]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:22.953 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:22 smithi177 ceph-mon[35530]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:22.954 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:22 smithi177 ceph-mon[35530]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T22:23:22.954 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:22 smithi177 ceph-mon[35530]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T22:23:22.954 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:22.955 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:22.955 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:22.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:22 smithi040 ceph-mon[30787]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:22.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:22 smithi040 ceph-mon[30787]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T22:23:22.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:22 smithi040 ceph-mon[30787]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T22:23:22.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:22.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:22.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:23.282 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:22 smithi177 sudo[44122]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:23:23.282 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:22 smithi177 sudo[44122]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:23.282 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:22 smithi177 sudo[44122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:23.282 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:23:22 smithi177 sudo[44122]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:23.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:23 smithi040 sudo[47931]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:23:23.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:23 smithi040 sudo[47931]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:23.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:23 smithi040 sudo[47931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:23.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:23 smithi040 sudo[47931]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:24.460 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:24 smithi040 sudo[48027]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:23:24.461 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:24 smithi040 sudo[48027]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:24.461 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:24 smithi040 sudo[48027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:24.461 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:24 smithi040 sudo[48027]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:24.624 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:24 smithi177 sudo[44125]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:23:24.624 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:24 smithi177 sudo[44125]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:24.624 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:24 smithi177 sudo[44125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:24.625 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:24 smithi177 sudo[44125]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:24.890 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:24.890 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:24 smithi146 sudo[43568]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T22:23:24.890 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:24 smithi146 sudo[43568]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:24.890 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:24 smithi146 sudo[43568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:24.890 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:24 smithi146 sudo[43568]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:25.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:24 smithi177 sudo[44128]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:23:25.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:24 smithi177 sudo[44128]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:25.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:24 smithi177 sudo[44128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:25.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:24 smithi177 sudo[44128]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:25.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:25.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 sudo[43571]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T22:23:25.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 sudo[43571]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T22:23:25.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 sudo[43571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T22:23:25.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 sudo[43571]: pam_unix(sudo:session): session closed for user root 2024-09-11T22:23:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:23:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:23:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:23:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:23:25.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:23:25.676 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:25 smithi040 ceph-mon[30787]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:23:26.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:26.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:23:26.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:23:26.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:23:26.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:23:26.034 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:25 smithi177 ceph-mon[35530]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:23:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:23:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:23:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:23:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:23:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:23:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:23:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:23:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:23:26.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:23:26.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:23:26.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T22:23:26.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:23:26.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:23:26.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:23:26.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:25 smithi146 ceph-mon[34996]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T22:23:26.739 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:26 smithi040 ceph-mon[30787]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:27.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:26 smithi177 ceph-mon[35530]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:27.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:26 smithi146 ceph-mon[34996]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:28.928 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:28 smithi040 ceph-mon[30787]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:28.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T22:23:28.929 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:29.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:28 smithi177 ceph-mon[35530]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:29.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T22:23:29.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:29.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:28 smithi146 ceph-mon[34996]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:29.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T22:23:29.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:29.896 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:29 smithi040 ceph-mon[30787]: Deploying daemon osd.3 on smithi040 2024-09-11T22:23:30.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:29 smithi177 ceph-mon[35530]: Deploying daemon osd.3 on smithi040 2024-09-11T22:23:30.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:29 smithi146 ceph-mon[34996]: Deploying daemon osd.3 on smithi040 2024-09-11T22:23:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:30 smithi040 ceph-mon[30787]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-11T22:23:31.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:30 smithi177 ceph-mon[35530]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-11T22:23:31.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:30 smithi146 ceph-mon[34996]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-09-11T22:23:32.842 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:32 smithi040 ceph-mon[30787]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-11T22:23:33.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:32 smithi177 ceph-mon[35530]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-11T22:23:33.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:32 smithi146 ceph-mon[34996]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-09-11T22:23:34.962 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:34 smithi040 ceph-mon[30787]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-11T22:23:35.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:34 smithi177 ceph-mon[35530]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-11T22:23:35.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:34 smithi146 ceph-mon[34996]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-09-11T22:23:36.944 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:36 smithi040 ceph-mon[30787]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-11T22:23:36.944 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:36.944 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:36.944 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:37.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:36 smithi177 ceph-mon[35530]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-11T22:23:37.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:37.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:37.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:37.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:36 smithi146 ceph-mon[34996]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-11T22:23:37.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:38.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:38 smithi040 ceph-mon[30787]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-11T22:23:39.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:38 smithi177 ceph-mon[35530]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-11T22:23:39.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:38 smithi146 ceph-mon[34996]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-11T22:23:40.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:39 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:39 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:39 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:40.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:39 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:40.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:39 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:39 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:39 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:39 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:40.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:39 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:40.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:39 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:39 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:39 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:39 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:40.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:39 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:40.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:39 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.703+0000 7f9dafe00640 1 -- 172.21.15.40:0/3945954086 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9db8109d40 con 0x7f9d9c0a2ba0 2024-09-11T22:23:40.704 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 3 on host 'smithi040' 2024-09-11T22:23:40.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9d9c0a2ba0 msgr2=0x7f9d9c0a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9d9c0a2ba0 0x7f9d9c0a5060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9db8102c60 tx=0x7f9da8005f90 comp rx=0 tx=0).stop 2024-09-11T22:23:40.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db81037c0 msgr2=0x7f9db81a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:40.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db81037c0 0x7f9db81a16b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9db000efc0 tx=0x7f9db000c800 comp rx=0 tx=0).stop 2024-09-11T22:23:40.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 shutdown_connections 2024-09-11T22:23:40.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9d9c0a2ba0 0x7f9d9c0a5060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9db81037c0 0x7f9db81a16b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9db8102e00 0x7f9db819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 --2- 172.21.15.40:0/3945954086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9db8101c00 0x7f9db819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:40.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 >> 172.21.15.40:0/3945954086 conn(0x7f9db80fd390 msgr2=0x7f9db8108620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:40.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.706+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 shutdown_connections 2024-09-11T22:23:40.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:23:40.707+0000 7f9dbe200640 1 -- 172.21.15.40:0/3945954086 wait complete. 2024-09-11T22:23:40.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:40 smithi040 ceph-mon[30787]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-11T22:23:40.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:40.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:40.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:40 smithi177 ceph-mon[35530]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-11T22:23:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:41.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:40 smithi146 ceph-mon[34996]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-11T22:23:41.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:23:41.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:41.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:41.424 DEBUG:teuthology.orchestra.run.smithi040:osd.3> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T22:23:41.428 INFO:tasks.cephadm:Deploying osd.4 on smithi146 with /dev/vg_nvme/lv_3... 2024-09-11T22:23:41.428 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T22:23:41.683 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:23:41.689 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:23:41 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3[48792]: 2024-09-11T22:23:41.574+0000 7f6c0068c640 -1 osd.3 0 log_to_monitors true 2024-09-11T22:23:41.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:41 smithi040 ceph-mon[30787]: from='osd.3 [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T22:23:41.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:41 smithi040 ceph-mon[30787]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T22:23:42.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:41 smithi146 ceph-mon[34996]: from='osd.3 [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T22:23:42.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:41 smithi146 ceph-mon[34996]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T22:23:42.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:41 smithi177 ceph-mon[35530]: from='osd.3 [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T22:23:42.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:41 smithi177 ceph-mon[35530]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T22:23:42.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:42 smithi040 ceph-mon[30787]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:42.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:42 smithi040 ceph-mon[30787]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T22:23:42.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:42 smithi040 ceph-mon[30787]: from='osd.3 [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:23:42.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:42 smithi040 ceph-mon[30787]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T22:23:42.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:42 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:42.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:42 smithi040 ceph-mon[30787]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:23:43.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:42 smithi146 ceph-mon[34996]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:43.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:42 smithi146 ceph-mon[34996]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T22:23:43.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:42 smithi146 ceph-mon[34996]: from='osd.3 [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:23:43.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:42 smithi146 ceph-mon[34996]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T22:23:43.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:42 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:43.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:42 smithi146 ceph-mon[34996]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:23:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:42 smithi177 ceph-mon[35530]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:42 smithi177 ceph-mon[35530]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T22:23:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:42 smithi177 ceph-mon[35530]: from='osd.3 [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:23:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:42 smithi177 ceph-mon[35530]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T22:23:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:42 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:43.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:42 smithi177 ceph-mon[35530]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:23:43.871 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:23:43 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3[48792]: 2024-09-11T22:23:43.574+0000 7f6bfb200640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T22:23:43.871 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:23:43 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3[48792]: 2024-09-11T22:23:43.596+0000 7f6bf1200640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:23:44.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:43 smithi040 ceph-mon[30787]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:23:44.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:43 smithi040 ceph-mon[30787]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T22:23:44.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:43 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:44.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:43 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:44.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:43 smithi040 ceph-mon[30787]: from='osd.3 ' entity='osd.3' 2024-09-11T22:23:44.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:43 smithi177 ceph-mon[35530]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:23:44.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:43 smithi177 ceph-mon[35530]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T22:23:44.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:43 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:44.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:43 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:44.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:43 smithi177 ceph-mon[35530]: from='osd.3 ' entity='osd.3' 2024-09-11T22:23:44.286 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:43 smithi146 ceph-mon[34996]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:23:44.287 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:43 smithi146 ceph-mon[34996]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T22:23:44.287 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:43 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:44.287 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:43 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:44.287 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:43 smithi146 ceph-mon[34996]: from='osd.3 ' entity='osd.3' 2024-09-11T22:23:44.289 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:23:44.316 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_3 2024-09-11T22:23:44.573 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:23:44.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:44 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:23:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:44 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:23:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:44 smithi040 ceph-mon[30787]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:44 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:44 smithi040 ceph-mon[30787]: osd.3 [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] boot 2024-09-11T22:23:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:44 smithi040 ceph-mon[30787]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T22:23:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:44 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.016+0000 7fbd2e349640 1 -- 172.21.15.146:0/3258533391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd28107920 msgr2=0x7fbd28109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.016+0000 7fbd2e349640 1 --2- 172.21.15.146:0/3258533391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd28107920 0x7fbd28109d10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009ca0 tx=0x7fbd2002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:23:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.016+0000 7fbd2e349640 1 -- 172.21.15.146:0/3258533391 shutdown_connections 2024-09-11T22:23:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.016+0000 7fbd2e349640 1 --2- 172.21.15.146:0/3258533391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd28107920 0x7fbd28109d10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.016+0000 7fbd2e349640 1 --2- 172.21.15.146:0/3258533391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd28104ff0 0x7fbd281073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.016+0000 7fbd2e349640 1 --2- 172.21.15.146:0/3258533391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd281026c0 0x7fbd28104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.016+0000 7fbd2e349640 1 -- 172.21.15.146:0/3258533391 >> 172.21.15.146:0/3258533391 conn(0x7fbd280fc280 msgr2=0x7fbd280fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.016+0000 7fbd2e349640 1 -- 172.21.15.146:0/3258533391 shutdown_connections 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.016+0000 7fbd2e349640 1 -- 172.21.15.146:0/3258533391 wait complete. 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.017+0000 7fbd2e349640 1 Processor -- start 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.017+0000 7fbd2e349640 1 -- start start 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.017+0000 7fbd2e349640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd281026c0 0x7fbd2819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.017+0000 7fbd2e349640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd28104ff0 0x7fbd2819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.017+0000 7fbd2e349640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28107920 0x7fbd281a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.017+0000 7fbd2e349640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2810d8e0 con 0x7fbd28104ff0 2024-09-11T22:23:45.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.017+0000 7fbd2e349640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2810d760 con 0x7fbd281026c0 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.017+0000 7fbd2e349640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2810da60 con 0x7fbd28107920 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.017+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd281026c0 0x7fbd2819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd281026c0 0x7fbd2819a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38448/0 (socket says 172.21.15.146:38448) 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd27fff640 1 -- 172.21.15.146:0/2745812410 learned_addr learned my addr 172.21.15.146:0/2745812410 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd277fe640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd28104ff0 0x7fbd2819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd2c8e6640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28107920 0x7fbd281a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd27fff640 1 -- 172.21.15.146:0/2745812410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28107920 msgr2=0x7fbd281a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd27fff640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28107920 0x7fbd281a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd27fff640 1 -- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd28104ff0 msgr2=0x7fbd2819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd27fff640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd28104ff0 0x7fbd2819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd27fff640 1 -- 172.21.15.146:0/2745812410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd281a1d00 con 0x7fbd281026c0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd2c8e6640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28107920 0x7fbd281a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd27fff640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd281026c0 0x7fbd2819a0d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800b4a0 tx=0x7fbd1800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd257fa640 1 -- 172.21.15.146:0/2745812410 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18014070 con 0x7fbd281026c0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd281a1ff0 con 0x7fbd281026c0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd257fa640 1 -- 172.21.15.146:0/2745812410 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd18010af0 con 0x7fbd281026c0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.018+0000 7fbd257fa640 1 -- 172.21.15.146:0/2745812410 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18017d10 con 0x7fbd281026c0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.019+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd281a2520 con 0x7fbd281026c0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.019+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd28109410 con 0x7fbd281026c0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.021+0000 7fbd257fa640 1 -- 172.21.15.146:0/2745812410 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbd18017070 con 0x7fbd281026c0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.021+0000 7fbd257fa640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbd100a2c30 0x7fbd100a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.021+0000 7fbd257fa640 1 -- 172.21.15.146:0/2745812410 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3698+0+0 (secure 0 0 0) 0x7fbd180cd590 con 0x7fbd281026c0 2024-09-11T22:23:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.022+0000 7fbd277fe640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbd100a2c30 0x7fbd100a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.022+0000 7fbd277fe640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbd100a2c30 0x7fbd100a50f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c005e10 tx=0x7fbd1c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.025+0000 7fbd257fa640 1 -- 172.21.15.146:0/2745812410 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd1809b6f0 con 0x7fbd281026c0 2024-09-11T22:23:45.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:23:45.207+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbd28062630 con 0x7fbd100a2c30 2024-09-11T22:23:45.208 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:44 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:23:45.208 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:44 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:23:45.208 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:44 smithi146 ceph-mon[34996]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:45.208 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:45.208 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:44 smithi146 ceph-mon[34996]: osd.3 [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] boot 2024-09-11T22:23:45.208 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:44 smithi146 ceph-mon[34996]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T22:23:45.208 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:44 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:23:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:44 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:23:45.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:44 smithi177 ceph-mon[35530]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-11T22:23:45.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:45.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:44 smithi177 ceph-mon[35530]: osd.3 [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] boot 2024-09-11T22:23:45.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:44 smithi177 ceph-mon[35530]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T22:23:45.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:46.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:46.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T22:23:46.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:46.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:46.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:46.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:46.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:46.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:46.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:46.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.329 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T22:23:46.329 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:23:46.329 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:23:46.329 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:46.329 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.329 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.329 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:46.329 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:23:46.329 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.330 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:46.330 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:23:46.330 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:23:46.979 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:46 smithi040 ceph-mon[30787]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:46.979 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:46 smithi040 ceph-mon[30787]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:46.979 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:46 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi040 2024-09-11T22:23:46.979 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:46 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi040 to 8547M 2024-09-11T22:23:46.979 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:46 smithi040 ceph-mon[30787]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T22:23:47.282 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:46 smithi146 ceph-mon[34996]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:47.282 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:46 smithi146 ceph-mon[34996]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:47.282 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:46 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi040 2024-09-11T22:23:47.282 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:46 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi040 to 8547M 2024-09-11T22:23:47.283 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:46 smithi146 ceph-mon[34996]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T22:23:47.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:46 smithi177 ceph-mon[35530]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:47.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:46 smithi177 ceph-mon[35530]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:23:47.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:46 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi040 2024-09-11T22:23:47.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:46 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi040 to 8547M 2024-09-11T22:23:47.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:46 smithi177 ceph-mon[35530]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T22:23:48.173 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:47 smithi146 ceph-mon[34996]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T22:23:48.174 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:47 smithi146 ceph-mon[34996]: from='client.? 172.21.15.146:0/1047752411' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8f7992-9ad7-4a0c-82eb-5e56257c79d2"}]: dispatch 2024-09-11T22:23:48.174 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:47 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8f7992-9ad7-4a0c-82eb-5e56257c79d2"}]: dispatch 2024-09-11T22:23:48.174 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:47 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b8f7992-9ad7-4a0c-82eb-5e56257c79d2"}]': finished 2024-09-11T22:23:48.174 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:47 smithi146 ceph-mon[34996]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T22:23:48.174 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:47 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:48.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:47 smithi040 ceph-mon[30787]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T22:23:48.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:47 smithi040 ceph-mon[30787]: from='client.? 172.21.15.146:0/1047752411' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8f7992-9ad7-4a0c-82eb-5e56257c79d2"}]: dispatch 2024-09-11T22:23:48.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:47 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8f7992-9ad7-4a0c-82eb-5e56257c79d2"}]: dispatch 2024-09-11T22:23:48.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:47 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b8f7992-9ad7-4a0c-82eb-5e56257c79d2"}]': finished 2024-09-11T22:23:48.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:47 smithi040 ceph-mon[30787]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T22:23:48.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:48.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:47 smithi177 ceph-mon[35530]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T22:23:48.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:47 smithi177 ceph-mon[35530]: from='client.? 172.21.15.146:0/1047752411' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8f7992-9ad7-4a0c-82eb-5e56257c79d2"}]: dispatch 2024-09-11T22:23:48.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:47 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b8f7992-9ad7-4a0c-82eb-5e56257c79d2"}]: dispatch 2024-09-11T22:23:48.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:47 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b8f7992-9ad7-4a0c-82eb-5e56257c79d2"}]': finished 2024-09-11T22:23:48.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:47 smithi177 ceph-mon[35530]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T22:23:48.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:23:49.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:48 smithi040 ceph-mon[30787]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:49.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:48 smithi040 ceph-mon[30787]: from='client.? 172.21.15.146:0/2744638242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:49.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:48 smithi177 ceph-mon[35530]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:49.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:48 smithi177 ceph-mon[35530]: from='client.? 172.21.15.146:0/2744638242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:49.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:48 smithi146 ceph-mon[34996]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:23:49.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:48 smithi146 ceph-mon[34996]: from='client.? 172.21.15.146:0/2744638242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:23:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:49 smithi040 ceph-mon[30787]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-11T22:23:50.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:49 smithi177 ceph-mon[35530]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-11T22:23:50.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:49 smithi146 ceph-mon[34996]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-11T22:23:52.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:51 smithi040 ceph-mon[30787]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:23:52.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:51 smithi177 ceph-mon[35530]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:23:52.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:51 smithi146 ceph-mon[34996]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:23:54.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:53 smithi040 ceph-mon[30787]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-11T22:23:54.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:53 smithi177 ceph-mon[35530]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-11T22:23:54.320 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:53 smithi146 ceph-mon[34996]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-11T22:23:56.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:55 smithi177 ceph-mon[35530]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:23:56.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T22:23:56.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:56.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:55 smithi146 ceph-mon[34996]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:23:56.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T22:23:56.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:56.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:55 smithi040 ceph-mon[30787]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:23:56.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T22:23:56.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:23:57.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:56 smithi177 ceph-mon[35530]: Deploying daemon osd.4 on smithi146 2024-09-11T22:23:57.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:56 smithi146 ceph-mon[34996]: Deploying daemon osd.4 on smithi146 2024-09-11T22:23:57.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:56 smithi040 ceph-mon[30787]: Deploying daemon osd.4 on smithi146 2024-09-11T22:23:58.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:57 smithi177 ceph-mon[35530]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:23:58.330 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:57 smithi146 ceph-mon[34996]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:23:58.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:57 smithi040 ceph-mon[30787]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:24:00.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:23:59 smithi177 ceph-mon[35530]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:23:59 smithi146 ceph-mon[34996]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:00.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:23:59 smithi040 ceph-mon[30787]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:02.260 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:01 smithi146 ceph-mon[34996]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:02.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:01 smithi177 ceph-mon[35530]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:02.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:01 smithi040 ceph-mon[30787]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:03.113 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:03 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:03.113 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:03 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:03.113 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:03 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:03 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:03 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:03 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:03.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:03 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:03.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:03 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:03.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:03 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:04 smithi040 ceph-mon[30787]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:04.738 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:04 smithi146 ceph-mon[34996]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:04.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:04 smithi177 ceph-mon[35530]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:06.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:06 smithi146 ceph-mon[34996]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:06.427 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:06.428 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.469+0000 7fbd257fa640 1 -- 172.21.15.146:0/2745812410 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbd28062630 con 0x7fbd100a2c30 2024-09-11T22:24:06.471 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 4 on host 'smithi146' 2024-09-11T22:24:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbd100a2c30 msgr2=0x7fbd100a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbd100a2c30 0x7fbd100a50f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c005e10 tx=0x7fbd1c005da0 comp rx=0 tx=0).stop 2024-09-11T22:24:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd281026c0 msgr2=0x7fbd2819a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd281026c0 0x7fbd2819a0d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800b4a0 tx=0x7fbd1800b960 comp rx=0 tx=0).stop 2024-09-11T22:24:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 shutdown_connections 2024-09-11T22:24:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbd100a2c30 0x7fbd100a50f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd28107920 0x7fbd281a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd28104ff0 0x7fbd2819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 --2- 172.21.15.146:0/2745812410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd281026c0 0x7fbd2819a0d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 >> 172.21.15.146:0/2745812410 conn(0x7fbd280fc280 msgr2=0x7fbd28101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 shutdown_connections 2024-09-11T22:24:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:24:06.472+0000 7fbd2e349640 1 -- 172.21.15.146:0/2745812410 wait complete. 2024-09-11T22:24:06.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:06 smithi040 ceph-mon[30787]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:06.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:06.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:06.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:06.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:06.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:06 smithi177 ceph-mon[35530]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:07.142 DEBUG:teuthology.orchestra.run.smithi146:osd.4> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T22:24:07.144 INFO:tasks.cephadm:Deploying osd.5 on smithi177 with /dev/vg_nvme/lv_3... 2024-09-11T22:24:07.144 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T22:24:07.412 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:07.413 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:07.413 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:24:07.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:07.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:07.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:07.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:07.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:07.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:08.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:08 smithi146 ceph-mon[34996]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:08.617 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:08 smithi177 ceph-mon[35530]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:08.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:08 smithi040 ceph-mon[30787]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:09.084 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:24:08 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4[46306]: 2024-09-11T22:24:08.696+0000 7f4381ef2640 -1 osd.4 0 log_to_monitors true 2024-09-11T22:24:09.553 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:09 smithi177 ceph-mon[35530]: from='osd.4 [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:24:09.553 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:09 smithi177 ceph-mon[35530]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:24:09.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:09 smithi146 ceph-mon[34996]: from='osd.4 [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:24:09.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:09 smithi146 ceph-mon[34996]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:24:09.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:09 smithi040 ceph-mon[30787]: from='osd.4 [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:24:09.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:09 smithi040 ceph-mon[30787]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T22:24:10.162 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:24:10.196 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_3 2024-09-11T22:24:10.450 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:24:10.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:10.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T22:24:10.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='osd.4 [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:24:10.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T22:24:10.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:10.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:24:10.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:10.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:10.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:10.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:10.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.833 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4[46306]: 2024-09-11T22:24:10.491+0000 7f437de75640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T22:24:10.834 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4[46306]: 2024-09-11T22:24:10.497+0000 7f4379c9d640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:24:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T22:24:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='osd.4 [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:24:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T22:24:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:10.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:24:10.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:10.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:10.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:10.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:10.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.902+0000 7f2f48272640 1 -- 172.21.15.177:0/1708285195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f400ffed0 msgr2=0x7f2f401002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.902+0000 7f2f48272640 1 --2- 172.21.15.177:0/1708285195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f400ffed0 0x7f2f401002d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009930 tx=0x7f2f3c02a420 comp rx=0 tx=0).stop 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.902+0000 7f2f48272640 1 -- 172.21.15.177:0/1708285195 shutdown_connections 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.902+0000 7f2f48272640 1 --2- 172.21.15.177:0/1708285195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f40103870 0x7f2f4010a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.902+0000 7f2f48272640 1 --2- 172.21.15.177:0/1708285195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40102eb0 0x7f2f40103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.902+0000 7f2f48272640 1 --2- 172.21.15.177:0/1708285195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f400ffed0 0x7f2f401002d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.902+0000 7f2f48272640 1 -- 172.21.15.177:0/1708285195 >> 172.21.15.177:0/1708285195 conn(0x7f2f400fba40 msgr2=0x7f2f400fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.902+0000 7f2f48272640 1 -- 172.21.15.177:0/1708285195 shutdown_connections 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.902+0000 7f2f48272640 1 -- 172.21.15.177:0/1708285195 wait complete. 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f48272640 1 Processor -- start 2024-09-11T22:24:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f48272640 1 -- start start 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f48272640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f400ffed0 0x7f2f40198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f48272640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f40102eb0 0x7f2f40198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f48272640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40103870 0x7f2f4019f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f48272640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4010d890 con 0x7f2f400ffed0 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f48272640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4010d710 con 0x7f2f40103870 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f48272640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4010da10 con 0x7f2f40102eb0 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f4580d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f40102eb0 0x7f2f40198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f4580d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f40102eb0 0x7f2f40198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47866/0 (socket says 172.21.15.177:47866) 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f4580d640 1 -- 172.21.15.177:0/3415584889 learned_addr learned my addr 172.21.15.177:0/3415584889 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f4600e640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f400ffed0 0x7f2f40198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f4580d640 1 -- 172.21.15.177:0/3415584889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40103870 msgr2=0x7f2f4019f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f4580d640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40103870 0x7f2f4019f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f4580d640 1 -- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f400ffed0 msgr2=0x7f2f40198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f4580d640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f400ffed0 0x7f2f40198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.903+0000 7f2f4580d640 1 -- 172.21.15.177:0/3415584889 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4019fc30 con 0x7f2f40102eb0 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.904+0000 7f2f4580d640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f40102eb0 0x7f2f40198540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000d950 tx=0x7f2f3000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.904+0000 7f2f377fe640 1 -- 172.21.15.177:0/3415584889 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30017070 con 0x7f2f40102eb0 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.904+0000 7f2f377fe640 1 -- 172.21.15.177:0/3415584889 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f30009c30 con 0x7f2f40102eb0 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.904+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4019ff20 con 0x7f2f40102eb0 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.904+0000 7f2f377fe640 1 -- 172.21.15.177:0/3415584889 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000f6b0 con 0x7f2f40102eb0 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.904+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f401a03d0 con 0x7f2f40102eb0 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.905+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f401091f0 con 0x7f2f40102eb0 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.906+0000 7f2f377fe640 1 -- 172.21.15.177:0/3415584889 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2f300109d0 con 0x7f2f40102eb0 2024-09-11T22:24:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.906+0000 7f2f377fe640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f2c0a2bb0 0x7f2f2c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.907+0000 7f2f377fe640 1 -- 172.21.15.177:0/3415584889 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7f2f300cdb50 con 0x7f2f40102eb0 2024-09-11T22:24:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.907+0000 7f2f4600e640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f2c0a2bb0 0x7f2f2c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.907+0000 7f2f4600e640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f2c0a2bb0 0x7f2f2c0a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c031610 tx=0x7f2f3c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:10.910+0000 7f2f377fe640 1 -- 172.21.15.177:0/3415584889 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f30009de0 con 0x7f2f40102eb0 2024-09-11T22:24:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='osd.4 [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:10.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:11.084+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2f40062630 con 0x7f2f2c0a2bb0 2024-09-11T22:24:11.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:11 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi146 2024-09-11T22:24:11.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:11 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi146 to 8544M 2024-09-11T22:24:11.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:11 smithi177 ceph-mon[35530]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:24:11.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:11 smithi177 ceph-mon[35530]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T22:24:11.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:11.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:11.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:11.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:11.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:11.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:11 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi146 2024-09-11T22:24:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:11 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi146 to 8544M 2024-09-11T22:24:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:11 smithi146 ceph-mon[34996]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:24:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:11 smithi146 ceph-mon[34996]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T22:24:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:11.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:11.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:11 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi146 2024-09-11T22:24:11.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:11 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi146 to 8544M 2024-09-11T22:24:11.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:11 smithi040 ceph-mon[30787]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:24:11.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:11 smithi040 ceph-mon[30787]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T22:24:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:12.781 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:12 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:24:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:12 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:24:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:12 smithi177 ceph-mon[35530]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:12 smithi177 ceph-mon[35530]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:12 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:12 smithi177 ceph-mon[35530]: osd.4 [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] boot 2024-09-11T22:24:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:12 smithi177 ceph-mon[35530]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T22:24:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:12 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:12 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:24:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:12 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:24:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:12 smithi146 ceph-mon[34996]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:12 smithi146 ceph-mon[34996]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:12 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:12 smithi146 ceph-mon[34996]: osd.4 [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] boot 2024-09-11T22:24:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:12 smithi146 ceph-mon[34996]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T22:24:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:12 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:12.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:12 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:24:12.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:12 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:24:12.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:12 smithi040 ceph-mon[30787]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-11T22:24:12.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:12 smithi040 ceph-mon[30787]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:12.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:12 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:12.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:12 smithi040 ceph-mon[30787]: osd.4 [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] boot 2024-09-11T22:24:12.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:12 smithi040 ceph-mon[30787]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T22:24:12.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:12 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T22:24:13.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:13 smithi177 ceph-mon[35530]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T22:24:13.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:13 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/2792082977' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30dda4ee-fb76-4fc6-accf-c8e15cef504b"}]: dispatch 2024-09-11T22:24:13.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:13 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30dda4ee-fb76-4fc6-accf-c8e15cef504b"}]: dispatch 2024-09-11T22:24:13.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:13 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30dda4ee-fb76-4fc6-accf-c8e15cef504b"}]': finished 2024-09-11T22:24:13.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:13 smithi177 ceph-mon[35530]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T22:24:13.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:13 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:13.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:13 smithi146 ceph-mon[34996]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T22:24:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:13 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/2792082977' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30dda4ee-fb76-4fc6-accf-c8e15cef504b"}]: dispatch 2024-09-11T22:24:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:13 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30dda4ee-fb76-4fc6-accf-c8e15cef504b"}]: dispatch 2024-09-11T22:24:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:13 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30dda4ee-fb76-4fc6-accf-c8e15cef504b"}]': finished 2024-09-11T22:24:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:13 smithi146 ceph-mon[34996]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T22:24:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:13 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:13 smithi040 ceph-mon[30787]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T22:24:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:13 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/2792082977' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30dda4ee-fb76-4fc6-accf-c8e15cef504b"}]: dispatch 2024-09-11T22:24:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:13 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30dda4ee-fb76-4fc6-accf-c8e15cef504b"}]: dispatch 2024-09-11T22:24:13.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:13 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30dda4ee-fb76-4fc6-accf-c8e15cef504b"}]': finished 2024-09-11T22:24:13.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:13 smithi040 ceph-mon[30787]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T22:24:13.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:13 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:14.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:14 smithi177 ceph-mon[35530]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:14.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:14 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/2150623359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:14.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:14 smithi146 ceph-mon[34996]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:14 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/2150623359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:14.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:14 smithi040 ceph-mon[30787]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:14.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:14 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/2150623359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:16.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:16 smithi177 ceph-mon[35530]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:16.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:16 smithi146 ceph-mon[34996]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:16 smithi040 ceph-mon[30787]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:18.641 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:18 smithi177 ceph-mon[35530]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:18.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:18 smithi146 ceph-mon[34996]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:18.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:18 smithi040 ceph-mon[30787]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:20.744 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:20 smithi177 ceph-mon[35530]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:20.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:20 smithi146 ceph-mon[34996]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:20.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:20 smithi040 ceph-mon[30787]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:22.696 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:22 smithi177 ceph-mon[35530]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:22.696 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T22:24:22.696 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:22.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:22 smithi146 ceph-mon[34996]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T22:24:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:22.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:22 smithi040 ceph-mon[30787]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:22.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T22:24:22.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:23.667 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:23 smithi177 ceph-mon[35530]: Deploying daemon osd.5 on smithi177 2024-09-11T22:24:23.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:23 smithi146 ceph-mon[34996]: Deploying daemon osd.5 on smithi177 2024-09-11T22:24:23.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:23 smithi040 ceph-mon[30787]: Deploying daemon osd.5 on smithi177 2024-09-11T22:24:24.757 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:24 smithi177 ceph-mon[35530]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:24.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:24 smithi146 ceph-mon[34996]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:24 smithi040 ceph-mon[30787]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:26.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:26 smithi146 ceph-mon[34996]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:26.898 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:26 smithi177 ceph-mon[35530]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:26.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:26 smithi040 ceph-mon[30787]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:28.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:28 smithi146 ceph-mon[34996]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:28.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:28.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:28.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:28.872 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:28 smithi177 ceph-mon[35530]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:28.873 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:28.873 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:28.873 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:28.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:28 smithi040 ceph-mon[30787]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:28.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:28.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:28.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:30.826 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:30 smithi177 ceph-mon[35530]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:30.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:30 smithi146 ceph-mon[34996]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:30 smithi040 ceph-mon[30787]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:31.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.809+0000 7f2f377fe640 1 -- 172.21.15.177:0/3415584889 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2f40062630 con 0x7f2f2c0a2bb0 2024-09-11T22:24:31.810 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 5 on host 'smithi177' 2024-09-11T22:24:31.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f2c0a2bb0 msgr2=0x7f2f2c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:31.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f2c0a2bb0 0x7f2f2c0a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c031610 tx=0x7f2f3c000bc0 comp rx=0 tx=0).stop 2024-09-11T22:24:31.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f40102eb0 msgr2=0x7f2f40198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:31.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f40102eb0 0x7f2f40198540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000d950 tx=0x7f2f3000de10 comp rx=0 tx=0).stop 2024-09-11T22:24:31.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 shutdown_connections 2024-09-11T22:24:31.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f2c0a2bb0 0x7f2f2c0a5070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:31.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f40103870 0x7f2f4019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:31.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f40102eb0 0x7f2f40198540 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:31.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 --2- 172.21.15.177:0/3415584889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f400ffed0 0x7f2f40198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:31.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 >> 172.21.15.177:0/3415584889 conn(0x7f2f400fba40 msgr2=0x7f2f401063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:31.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 shutdown_connections 2024-09-11T22:24:31.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:24:31.813+0000 7f2f48272640 1 -- 172.21.15.177:0/3415584889 wait complete. 2024-09-11T22:24:32.404 DEBUG:teuthology.orchestra.run.smithi177:osd.5> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T22:24:32.407 INFO:tasks.cephadm:Deploying osd.6 on smithi040 with /dev/vg_nvme/lv_2... 2024-09-11T22:24:32.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T22:24:32.790 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:24:33.079 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:32 smithi177 ceph-mon[35530]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:33.079 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.079 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.079 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.079 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:32 smithi146 ceph-mon[34996]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:33.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.088 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:32 smithi040 ceph-mon[30787]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:33.089 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.089 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.089 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:33.089 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:34.520 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:24:34 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5[46963]: 2024-09-11T22:24:34.258+0000 7f35b6708640 -1 osd.5 0 log_to_monitors true 2024-09-11T22:24:34.980 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:34 smithi040 ceph-mon[30787]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:34.981 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:34 smithi040 ceph-mon[30787]: from='osd.5 [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:34.981 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:34 smithi040 ceph-mon[30787]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:35.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:34 smithi146 ceph-mon[34996]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:35.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:34 smithi146 ceph-mon[34996]: from='osd.5 [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:35.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:34 smithi146 ceph-mon[34996]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:35.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:34 smithi177 ceph-mon[35530]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:35.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:34 smithi177 ceph-mon[35530]: from='osd.5 [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:35.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:34 smithi177 ceph-mon[35530]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T22:24:36.032 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5[46963]: 2024-09-11T22:24:35.825+0000 7f35b268b640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T22:24:36.032 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5[46963]: 2024-09-11T22:24:35.832+0000 7f35ae4b3640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:24:36.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T22:24:36.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='osd.5 [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:36.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:35 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='osd.5 [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:36.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:36.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:36.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:35 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='osd.5 [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:36.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:35 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:36.277 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:24:36.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi040:vg_nvme/lv_2 2024-09-11T22:24:36.678 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:24:37.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi177 2024-09-11T22:24:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi177 to 8543M 2024-09-11T22:24:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:24:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T22:24:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: osd.5 [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] boot 2024-09-11T22:24:37.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T22:24:37.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:37.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:37.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:37.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:37.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:37.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:37.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi177 2024-09-11T22:24:37.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi177 to 8543M 2024-09-11T22:24:37.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:24:37.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T22:24:37.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:37.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:37.111 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: osd.5 [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] boot 2024-09-11T22:24:37.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T22:24:37.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:37.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:37.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:37.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:37.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:37.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-11T22:24:37.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi177 2024-09-11T22:24:37.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi177 to 8543M 2024-09-11T22:24:37.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:24:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T22:24:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: osd.5 [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] boot 2024-09-11T22:24:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T22:24:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T22:24:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:24:37.284 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:37.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.344+0000 7f52e4200640 1 -- 172.21.15.40:0/2195697333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc104f60 msgr2=0x7f52dc1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:37.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.344+0000 7f52e4200640 1 --2- 172.21.15.40:0/2195697333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc104f60 0x7f52dc1053e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009900 tx=0x7f52c802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:24:37.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.344+0000 7f52e4200640 1 -- 172.21.15.40:0/2195697333 shutdown_connections 2024-09-11T22:24:37.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.344+0000 7f52e4200640 1 --2- 172.21.15.40:0/2195697333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52dc105920 0x7f52dc10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:37.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.344+0000 7f52e4200640 1 --2- 172.21.15.40:0/2195697333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc104f60 0x7f52dc1053e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:37.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.344+0000 7f52e4200640 1 --2- 172.21.15.40:0/2195697333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52dc103e00 0x7f52dc104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:37.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.344+0000 7f52e4200640 1 -- 172.21.15.40:0/2195697333 >> 172.21.15.40:0/2195697333 conn(0x7f52dc0ff5b0 msgr2=0x7f52dc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:37.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.344+0000 7f52e4200640 1 -- 172.21.15.40:0/2195697333 shutdown_connections 2024-09-11T22:24:37.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.344+0000 7f52e4200640 1 -- 172.21.15.40:0/2195697333 wait complete. 2024-09-11T22:24:37.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.345+0000 7f52e4200640 1 Processor -- start 2024-09-11T22:24:37.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e4200640 1 -- start start 2024-09-11T22:24:37.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e4200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc103e00 0x7f52dc19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:37.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e4200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52dc104f60 0x7f52dc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:37.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e4200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52dc105920 0x7f52dc1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:37.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e4200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc10fab0 con 0x7f52dc103e00 2024-09-11T22:24:37.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e4200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc10f930 con 0x7f52dc105920 2024-09-11T22:24:37.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e4200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc10fc30 con 0x7f52dc104f60 2024-09-11T22:24:37.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e1800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc103e00 0x7f52dc19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:37.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e1800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc103e00 0x7f52dc19a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42962/0 (socket says 172.21.15.40:42962) 2024-09-11T22:24:37.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e1800640 1 -- 172.21.15.40:0/3028296252 learned_addr learned my addr 172.21.15.40:0/3028296252 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:24:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e2200640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52dc105920 0x7f52dc1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.346+0000 7f52e0e00640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52dc104f60 0x7f52dc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52e1800640 1 -- 172.21.15.40:0/3028296252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52dc104f60 msgr2=0x7f52dc19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52e1800640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52dc104f60 0x7f52dc19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52e1800640 1 -- 172.21.15.40:0/3028296252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52dc105920 msgr2=0x7f52dc1a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52e1800640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52dc105920 0x7f52dc1a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52e1800640 1 -- 172.21.15.40:0/3028296252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc1a1d30 con 0x7f52dc103e00 2024-09-11T22:24:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52e2200640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52dc105920 0x7f52dc1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:37.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52e1800640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc103e00 0x7f52dc19a100 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52d000e9f0 tx=0x7f52d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:37.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52da000640 1 -- 172.21.15.40:0/3028296252 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d000cd80 con 0x7f52dc103e00 2024-09-11T22:24:37.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52da000640 1 -- 172.21.15.40:0/3028296252 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52d0010910 con 0x7f52dc103e00 2024-09-11T22:24:37.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52dc1a1fc0 con 0x7f52dc103e00 2024-09-11T22:24:37.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52da000640 1 -- 172.21.15.40:0/3028296252 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d00188f0 con 0x7f52dc103e00 2024-09-11T22:24:37.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.347+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52dc1a2470 con 0x7f52dc103e00 2024-09-11T22:24:37.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.349+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52dc10b1c0 con 0x7f52dc103e00 2024-09-11T22:24:37.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.351+0000 7f52da000640 1 -- 172.21.15.40:0/3028296252 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f52d0010ac0 con 0x7f52dc103e00 2024-09-11T22:24:37.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.352+0000 7f52da000640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f52c40a2bb0 0x7f52c40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:37.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.352+0000 7f52da000640 1 -- 172.21.15.40:0/3028296252 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4562+0+0 (secure 0 0 0) 0x7f52d00ce560 con 0x7f52dc103e00 2024-09-11T22:24:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.352+0000 7f52e0e00640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f52c40a2bb0 0x7f52c40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:37.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.353+0000 7f52e0e00640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f52c40a2bb0 0x7f52c40a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52c8005ab0 tx=0x7f52c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:37.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.357+0000 7f52da000640 1 -- 172.21.15.40:0/3028296252 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52d009bc70 con 0x7f52dc103e00 2024-09-11T22:24:37.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:24:37.550+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f52dc062630 con 0x7f52c40a2bb0 2024-09-11T22:24:38.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:37 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:24:38.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:37 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:24:38.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:37 smithi040 ceph-mon[30787]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T22:24:38.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:38.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:38.181 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:38.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:37 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:24:38.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:37 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:24:38.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:37 smithi177 ceph-mon[35530]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T22:24:38.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:38.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:38.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:38.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:37 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:24:38.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:37 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:24:38.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:37 smithi146 ceph-mon[34996]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T22:24:38.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:37 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:24:38.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:37 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:24:38.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:37 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:39.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:38 smithi040 ceph-mon[30787]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:39.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:38 smithi040 ceph-mon[30787]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:39.185 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:38 smithi040 ceph-mon[30787]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T22:24:39.196 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:38 smithi177 ceph-mon[35530]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:39.196 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:38 smithi177 ceph-mon[35530]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:39.196 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:38 smithi177 ceph-mon[35530]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T22:24:39.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:38 smithi146 ceph-mon[34996]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:39.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:38 smithi146 ceph-mon[34996]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:24:39.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:38 smithi146 ceph-mon[34996]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T22:24:40.057 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:39 smithi040 ceph-mon[30787]: osdmap e40: 6 total, 6 up, 6 in 2024-09-11T22:24:40.057 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:39 smithi040 ceph-mon[30787]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:40.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:39 smithi177 ceph-mon[35530]: osdmap e40: 6 total, 6 up, 6 in 2024-09-11T22:24:40.922 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:39 smithi177 ceph-mon[35530]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:40.923 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:39 smithi146 ceph-mon[34996]: osdmap e40: 6 total, 6 up, 6 in 2024-09-11T22:24:40.923 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:39 smithi146 ceph-mon[34996]: pgmap v141: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:41.166 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:40 smithi040 ceph-mon[30787]: osdmap e41: 6 total, 6 up, 6 in 2024-09-11T22:24:41.166 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:40 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3121243490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2f90ba7-c6f0-4dab-be23-4ee01254e8e7"}]: dispatch 2024-09-11T22:24:41.166 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:40 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3121243490' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2f90ba7-c6f0-4dab-be23-4ee01254e8e7"}]': finished 2024-09-11T22:24:41.166 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:40 smithi040 ceph-mon[30787]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T22:24:41.166 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:40 smithi177 ceph-mon[35530]: osdmap e41: 6 total, 6 up, 6 in 2024-09-11T22:24:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:40 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3121243490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2f90ba7-c6f0-4dab-be23-4ee01254e8e7"}]: dispatch 2024-09-11T22:24:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:40 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3121243490' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2f90ba7-c6f0-4dab-be23-4ee01254e8e7"}]': finished 2024-09-11T22:24:41.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:40 smithi177 ceph-mon[35530]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T22:24:41.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:41.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:40 smithi146 ceph-mon[34996]: osdmap e41: 6 total, 6 up, 6 in 2024-09-11T22:24:41.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:40 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3121243490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2f90ba7-c6f0-4dab-be23-4ee01254e8e7"}]: dispatch 2024-09-11T22:24:41.337 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:40 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3121243490' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2f90ba7-c6f0-4dab-be23-4ee01254e8e7"}]': finished 2024-09-11T22:24:41.337 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:40 smithi146 ceph-mon[34996]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T22:24:41.337 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:24:42.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:41 smithi040 ceph-mon[30787]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:42.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:41 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3977674806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:42.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:41 smithi177 ceph-mon[35530]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:42.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:41 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3977674806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:42.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:41 smithi146 ceph-mon[34996]: pgmap v144: 1 pgs: 1 remapped+peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:42.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:41 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3977674806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:24:44.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:43 smithi177 ceph-mon[35530]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-11T22:24:44.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:43 smithi146 ceph-mon[34996]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-11T22:24:44.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:43 smithi040 ceph-mon[30787]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-11T22:24:46.230 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:45 smithi040 ceph-mon[30787]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:24:46.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:45 smithi177 ceph-mon[35530]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:24:46.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:45 smithi146 ceph-mon[34996]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:24:48.251 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:47 smithi040 ceph-mon[30787]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:24:48.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:47 smithi177 ceph-mon[35530]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:24:48.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:47 smithi146 ceph-mon[34996]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T22:24:50.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:49 smithi177 ceph-mon[35530]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-11T22:24:50.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:49 smithi146 ceph-mon[34996]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-11T22:24:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:49 smithi040 ceph-mon[30787]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-11T22:24:51.265 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T22:24:51.265 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:51.265 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:51 smithi040 ceph-mon[30787]: Deploying daemon osd.6 on smithi040 2024-09-11T22:24:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T22:24:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:51 smithi177 ceph-mon[35530]: Deploying daemon osd.6 on smithi040 2024-09-11T22:24:51.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T22:24:51.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:24:51.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:51 smithi146 ceph-mon[34996]: Deploying daemon osd.6 on smithi040 2024-09-11T22:24:52.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:52 smithi040 ceph-mon[30787]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-11T22:24:52.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:52 smithi177 ceph-mon[35530]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-11T22:24:52.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:52 smithi146 ceph-mon[34996]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-11T22:24:54.225 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:54 smithi040 ceph-mon[30787]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:24:54.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:54 smithi177 ceph-mon[35530]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:24:54.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:54 smithi146 ceph-mon[34996]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T22:24:56.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:56 smithi177 ceph-mon[35530]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:56.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:56 smithi146 ceph-mon[34996]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:56.386 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:56 smithi040 ceph-mon[30787]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:58.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:58 smithi040 ceph-mon[30787]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:58.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:58 smithi177 ceph-mon[35530]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:58.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:58 smithi146 ceph-mon[34996]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:24:59.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:59.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:59.252 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:24:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:59 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:59 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:24:59 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:59.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:59 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:24:59.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:59 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:24:59.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:24:59 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:00.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:00 smithi040 ceph-mon[30787]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:00.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:00 smithi177 ceph-mon[35530]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:00.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:00 smithi146 ceph-mon[34996]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:02.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:02 smithi040 ceph-mon[30787]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:02.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:03.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:02 smithi146 ceph-mon[34996]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:03.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:03.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:03.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:03.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:03.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:03.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.126+0000 7f52da000640 1 -- 172.21.15.40:0/3028296252 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f52dc062630 con 0x7f52c40a2bb0 2024-09-11T22:25:03.127 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 6 on host 'smithi040' 2024-09-11T22:25:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f52c40a2bb0 msgr2=0x7f52c40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f52c40a2bb0 0x7f52c40a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f52c8005ab0 tx=0x7f52c8000bc0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc103e00 msgr2=0x7f52dc19a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc103e00 0x7f52dc19a100 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52d000e9f0 tx=0x7f52d000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 shutdown_connections 2024-09-11T22:25:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f52c40a2bb0 0x7f52c40a5070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52dc105920 0x7f52dc1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52dc104f60 0x7f52dc19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 --2- 172.21.15.40:0/3028296252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52dc103e00 0x7f52dc19a100 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 >> 172.21.15.40:0/3028296252 conn(0x7f52dc0ff5b0 msgr2=0x7f52dc108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.128+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 shutdown_connections 2024-09-11T22:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:25:03.129+0000 7f52e4200640 1 -- 172.21.15.40:0/3028296252 wait complete. 2024-09-11T22:25:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:02 smithi177 ceph-mon[35530]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:03.914 DEBUG:teuthology.orchestra.run.smithi040:osd.6> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T22:25:03.918 INFO:tasks.cephadm:Deploying osd.7 on smithi146 with /dev/vg_nvme/lv_2... 2024-09-11T22:25:03.919 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T22:25:04.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:03 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:04.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:03 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:04.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:03 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:04.085 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:03 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:04.085 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:03 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:04.085 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:03 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:04.174 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:25:04.289 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:03 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:04.289 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:03 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:04.290 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:03 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:04.735 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:25:04 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6[55743]: 2024-09-11T22:25:04.560+0000 7f74b4e61640 -1 osd.6 0 log_to_monitors true 2024-09-11T22:25:04.938 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:04 smithi146 ceph-mon[34996]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:04.938 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:04 smithi146 ceph-mon[34996]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T22:25:05.149 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:04 smithi040 ceph-mon[30787]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:05.150 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:04 smithi040 ceph-mon[30787]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T22:25:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:04 smithi177 ceph-mon[35530]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:04 smithi177 ceph-mon[35530]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T22:25:05.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:05 smithi040 ceph-mon[30787]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T22:25:05.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:05 smithi040 ceph-mon[30787]: osdmap e43: 7 total, 6 up, 7 in 2024-09-11T22:25:05.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:05 smithi040 ceph-mon[30787]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:25:05.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:05 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:05.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:05 smithi040 ceph-mon[30787]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:25:06.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:05 smithi146 ceph-mon[34996]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T22:25:06.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:05 smithi146 ceph-mon[34996]: osdmap e43: 7 total, 6 up, 7 in 2024-09-11T22:25:06.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:05 smithi146 ceph-mon[34996]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:25:06.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:05 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:06.035 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:05 smithi146 ceph-mon[34996]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:25:06.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:05 smithi177 ceph-mon[35530]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T22:25:06.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:05 smithi177 ceph-mon[35530]: osdmap e43: 7 total, 6 up, 7 in 2024-09-11T22:25:06.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:05 smithi177 ceph-mon[35530]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:25:06.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:05 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:06.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:05 smithi177 ceph-mon[35530]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:25:06.750 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:25:06.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_2 2024-09-11T22:25:06.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:06 smithi040 ceph-mon[30787]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:06.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:06 smithi040 ceph-mon[30787]: osdmap e44: 7 total, 6 up, 7 in 2024-09-11T22:25:06.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:06.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:06.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:06 smithi040 ceph-mon[30787]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' 2024-09-11T22:25:06.985 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:25:06 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6[55743]: 2024-09-11T22:25:06.608+0000 7f74b0400640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T22:25:06.985 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:25:06 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6[55743]: 2024-09-11T22:25:06.629+0000 7f74a5a00640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:25:07.030 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:25:07.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:06 smithi146 ceph-mon[34996]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:07.086 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:06 smithi146 ceph-mon[34996]: osdmap e44: 7 total, 6 up, 7 in 2024-09-11T22:25:07.086 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:07.086 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:07.086 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:06 smithi146 ceph-mon[34996]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' 2024-09-11T22:25:07.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:06 smithi177 ceph-mon[35530]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:07.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:06 smithi177 ceph-mon[35530]: osdmap e44: 7 total, 6 up, 7 in 2024-09-11T22:25:07.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:07.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:07.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:06 smithi177 ceph-mon[35530]: from='osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363]' entity='osd.6' 2024-09-11T22:25:07.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 -- 172.21.15.146:0/1555739313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38401037d0 msgr2=0x7f384010a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 --2- 172.21.15.146:0/1555739313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38401037d0 0x7f384010a060 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3838009ca0 tx=0x7f383802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 -- 172.21.15.146:0/1555739313 shutdown_connections 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 --2- 172.21.15.146:0/1555739313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38401037d0 0x7f384010a060 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 --2- 172.21.15.146:0/1555739313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3840102e10 0x7f3840103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 --2- 172.21.15.146:0/1555739313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3840101c10 0x7f3840102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 -- 172.21.15.146:0/1555739313 >> 172.21.15.146:0/1555739313 conn(0x7f38400fd3c0 msgr2=0x7f38400ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 -- 172.21.15.146:0/1555739313 shutdown_connections 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 -- 172.21.15.146:0/1555739313 wait complete. 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 Processor -- start 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.533+0000 7f3846951640 1 -- start start 2024-09-11T22:25:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f3846951640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3840101c10 0x7f3840197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f3846951640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3840102e10 0x7f3840198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f3846951640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38401037d0 0x7f384019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f3846951640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f384010d8f0 con 0x7f38401037d0 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f3846951640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f384010d770 con 0x7f3840101c10 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f3846951640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f384010da70 con 0x7f3840102e10 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3840101c10 0x7f3840197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3840101c10 0x7f3840197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44260/0 (socket says 172.21.15.146:44260) 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383ffff640 1 -- 172.21.15.146:0/3305376985 learned_addr learned my addr 172.21.15.146:0/3305376985 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f3837fff640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3840102e10 0x7f3840198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f3844eee640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38401037d0 0x7f384019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383ffff640 1 -- 172.21.15.146:0/3305376985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3840102e10 msgr2=0x7f3840198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383ffff640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3840102e10 0x7f3840198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383ffff640 1 -- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38401037d0 msgr2=0x7f384019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383ffff640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38401037d0 0x7f384019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383ffff640 1 -- 172.21.15.146:0/3305376985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384019fb70 con 0x7f3840101c10 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383ffff640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3840101c10 0x7f3840197f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f383000c970 tx=0x7f383000cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.534+0000 7f383dffb640 1 -- 172.21.15.146:0/3305376985 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830004220 con 0x7f3840101c10 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.535+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384019fe60 con 0x7f3840101c10 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.535+0000 7f383dffb640 1 -- 172.21.15.146:0/3305376985 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38300043c0 con 0x7f3840101c10 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.535+0000 7f383dffb640 1 -- 172.21.15.146:0/3305376985 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383000f450 con 0x7f3840101c10 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.535+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38401a0330 con 0x7f3840101c10 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.536+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3840109010 con 0x7f3840101c10 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.537+0000 7f383dffb640 1 -- 172.21.15.146:0/3305376985 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f38300079b0 con 0x7f3840101c10 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.537+0000 7f383dffb640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f382c0a2bb0 0x7f382c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.537+0000 7f383dffb640 1 -- 172.21.15.146:0/3305376985 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4685+0+0 (secure 0 0 0) 0x7f38300cdf80 con 0x7f3840101c10 2024-09-11T22:25:07.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.538+0000 7f3837fff640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f382c0a2bb0 0x7f382c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:07.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.538+0000 7f3837fff640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f382c0a2bb0 0x7f382c0a5070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3840199460 tx=0x7f3828009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:07.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.541+0000 7f383dffb640 1 -- 172.21.15.146:0/3305376985 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3830014030 con 0x7f3840101c10 2024-09-11T22:25:07.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:07.722+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3840062630 con 0x7f382c0a2bb0 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] boot 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:07.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:07.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:07.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:07.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:07.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:07.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:07.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:07.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:08.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:25:08.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:25:08.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:08.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] boot 2024-09-11T22:25:08.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T22:25:08.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:08.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:08.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:08.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:08.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:25:08.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:25:08.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:08.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: osd.6 [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] boot 2024-09-11T22:25:08.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: osdmap e45: 7 total, 7 up, 7 in 2024-09-11T22:25:08.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T22:25:08.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:08.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:08.184 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:08.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:08.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:08.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:08.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:08.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:08.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:08.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:08.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:08.185 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:09.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:08 smithi146 ceph-mon[34996]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:09.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:08 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi040 2024-09-11T22:25:09.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:08 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi040 to 5698M 2024-09-11T22:25:09.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:08 smithi146 ceph-mon[34996]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:09.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:08 smithi040 ceph-mon[30787]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:09.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:08 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi040 2024-09-11T22:25:09.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:08 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi040 to 5698M 2024-09-11T22:25:09.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:08 smithi040 ceph-mon[30787]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:09.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:08 smithi177 ceph-mon[35530]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-09-11T22:25:09.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:08 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi040 2024-09-11T22:25:09.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:08 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi040 to 5698M 2024-09-11T22:25:09.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:08 smithi177 ceph-mon[35530]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:10.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:09 smithi146 ceph-mon[34996]: osdmap e46: 7 total, 7 up, 7 in 2024-09-11T22:25:10.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:09 smithi040 ceph-mon[30787]: osdmap e46: 7 total, 7 up, 7 in 2024-09-11T22:25:10.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:09 smithi177 ceph-mon[35530]: osdmap e46: 7 total, 7 up, 7 in 2024-09-11T22:25:11.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:10 smithi146 ceph-mon[34996]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:11.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:10 smithi146 ceph-mon[34996]: from='client.? 172.21.15.146:0/740070563' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa3c1448-5e50-42c5-8ec9-d4415f3612e5"}]: dispatch 2024-09-11T22:25:11.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:10 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa3c1448-5e50-42c5-8ec9-d4415f3612e5"}]: dispatch 2024-09-11T22:25:11.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:10 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa3c1448-5e50-42c5-8ec9-d4415f3612e5"}]': finished 2024-09-11T22:25:11.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:10 smithi146 ceph-mon[34996]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T22:25:11.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:11.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:10 smithi146 ceph-mon[34996]: from='client.? 172.21.15.146:0/3899422181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:11.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:10 smithi040 ceph-mon[30787]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:11.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:10 smithi040 ceph-mon[30787]: from='client.? 172.21.15.146:0/740070563' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa3c1448-5e50-42c5-8ec9-d4415f3612e5"}]: dispatch 2024-09-11T22:25:11.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:10 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa3c1448-5e50-42c5-8ec9-d4415f3612e5"}]: dispatch 2024-09-11T22:25:11.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:10 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa3c1448-5e50-42c5-8ec9-d4415f3612e5"}]': finished 2024-09-11T22:25:11.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:10 smithi040 ceph-mon[30787]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T22:25:11.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:11.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:10 smithi040 ceph-mon[30787]: from='client.? 172.21.15.146:0/3899422181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:10 smithi177 ceph-mon[35530]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:10 smithi177 ceph-mon[35530]: from='client.? 172.21.15.146:0/740070563' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa3c1448-5e50-42c5-8ec9-d4415f3612e5"}]: dispatch 2024-09-11T22:25:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:10 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa3c1448-5e50-42c5-8ec9-d4415f3612e5"}]: dispatch 2024-09-11T22:25:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:10 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa3c1448-5e50-42c5-8ec9-d4415f3612e5"}]': finished 2024-09-11T22:25:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:10 smithi177 ceph-mon[35530]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T22:25:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:11.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:10 smithi177 ceph-mon[35530]: from='client.? 172.21.15.146:0/3899422181' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:13.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:12 smithi040 ceph-mon[30787]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:13.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:12 smithi177 ceph-mon[35530]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:13.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:12 smithi146 ceph-mon[34996]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:14 smithi040 ceph-mon[30787]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:15.242 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:14 smithi146 ceph-mon[34996]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:15.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:14 smithi177 ceph-mon[35530]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:17.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:16 smithi146 ceph-mon[34996]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:17.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:16 smithi040 ceph-mon[30787]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:17.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:16 smithi177 ceph-mon[35530]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:19.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:18 smithi146 ceph-mon[34996]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:19.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:18 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T22:25:19.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:18 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:19.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:18 smithi040 ceph-mon[30787]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:19.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:18 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T22:25:19.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:18 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:19.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:18 smithi177 ceph-mon[35530]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:19.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:18 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T22:25:19.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:18 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:20.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:19 smithi040 ceph-mon[30787]: Deploying daemon osd.7 on smithi146 2024-09-11T22:25:20.280 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:19 smithi146 ceph-mon[34996]: Deploying daemon osd.7 on smithi146 2024-09-11T22:25:20.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:19 smithi177 ceph-mon[35530]: Deploying daemon osd.7 on smithi146 2024-09-11T22:25:20.910 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:20 smithi146 ceph-mon[34996]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:21.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:20 smithi040 ceph-mon[30787]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:21.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:20 smithi177 ceph-mon[35530]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:23.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:22 smithi040 ceph-mon[30787]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:23.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:22 smithi177 ceph-mon[35530]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:23.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:22 smithi146 ceph-mon[34996]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:25.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:24 smithi146 ceph-mon[34996]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:25.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:24 smithi040 ceph-mon[30787]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:25.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:24 smithi177 ceph-mon[35530]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:26.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:26.136 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:26.136 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:26.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:26.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:26.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:26.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:26.962 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:26 smithi146 ceph-mon[34996]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:27.162 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:26 smithi040 ceph-mon[30787]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:27.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:26 smithi177 ceph-mon[35530]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.882+0000 7f383dffb640 1 -- 172.21.15.146:0/3305376985 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3840062630 con 0x7f382c0a2bb0 2024-09-11T22:25:28.884 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 7 on host 'smithi146' 2024-09-11T22:25:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f382c0a2bb0 msgr2=0x7f382c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f382c0a2bb0 0x7f382c0a5070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3840199460 tx=0x7f3828009110 comp rx=0 tx=0).stop 2024-09-11T22:25:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3840101c10 msgr2=0x7f3840197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3840101c10 0x7f3840197f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f383000c970 tx=0x7f383000cd70 comp rx=0 tx=0).stop 2024-09-11T22:25:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 shutdown_connections 2024-09-11T22:25:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f382c0a2bb0 0x7f382c0a5070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38401037d0 0x7f384019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3840102e10 0x7f3840198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 --2- 172.21.15.146:0/3305376985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3840101c10 0x7f3840197f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 >> 172.21.15.146:0/3305376985 conn(0x7f38400fd3c0 msgr2=0x7f38401061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 shutdown_connections 2024-09-11T22:25:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:25:28.885+0000 7f3846951640 1 -- 172.21.15.146:0/3305376985 wait complete. 2024-09-11T22:25:28.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:28 smithi040 ceph-mon[30787]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:28.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:28.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:28.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:28.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:28.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:29.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:28 smithi146 ceph-mon[34996]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:29.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:29.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:29.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:29.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:29.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:28 smithi177 ceph-mon[35530]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:29.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:29.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:29.687 DEBUG:teuthology.orchestra.run.smithi146:osd.7> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T22:25:29.689 INFO:tasks.cephadm:Deploying osd.8 on smithi177 with /dev/vg_nvme/lv_2... 2024-09-11T22:25:29.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T22:25:29.947 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:25:29.951 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:29.951 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:29.951 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:30.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:30.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:30.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:31.144 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:30 smithi177 ceph-mon[35530]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:31.184 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:30 smithi146 ceph-mon[34996]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:31.185 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:25:30 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7[52988]: 2024-09-11T22:25:30.965+0000 7f6facd04640 -1 osd.7 0 log_to_monitors true 2024-09-11T22:25:31.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:30 smithi040 ceph-mon[30787]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:32.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:31 smithi177 ceph-mon[35530]: from='osd.7 [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:25:32.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:31 smithi177 ceph-mon[35530]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:25:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:31 smithi040 ceph-mon[30787]: from='osd.7 [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:25:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:31 smithi040 ceph-mon[30787]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:25:32.238 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:31 smithi146 ceph-mon[34996]: from='osd.7 [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:25:32.238 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:31 smithi146 ceph-mon[34996]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T22:25:32.589 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:25:32.615 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_2 2024-09-11T22:25:32.873 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:25:33.153 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='osd.7 [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:33.154 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.155 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:33.155 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:33.155 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='osd.7 [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.333 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7[52988]: 2024-09-11T22:25:32.899+0000 7f6fa8c87640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T22:25:33.334 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7[52988]: 2024-09-11T22:25:32.908+0000 7f6fa4aaf640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:25:33.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:33.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T22:25:33.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='osd.7 [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:25:33.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T22:25:33.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:33.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:25:33.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:33.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:33.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:33.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:33.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:33.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:33.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 -- 172.21.15.177:0/3441002576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 msgr2=0x7fe4f810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:33.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3441002576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 0x7fe4f810a050 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009ca0 tx=0x7fe4f002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:25:33.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 -- 172.21.15.177:0/3441002576 shutdown_connections 2024-09-11T22:25:33.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3441002576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 0x7fe4f810a050 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:33.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3441002576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4f8102e00 0x7fe4f8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:33.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3441002576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8101c00 0x7fe4f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 -- 172.21.15.177:0/3441002576 >> 172.21.15.177:0/3441002576 conn(0x7fe4f80fd390 msgr2=0x7fe4f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 -- 172.21.15.177:0/3441002576 shutdown_connections 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 -- 172.21.15.177:0/3441002576 wait complete. 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 Processor -- start 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.342+0000 7fe4ff321640 1 -- start start 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ff321640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4f8101c00 0x7fe4f8197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ff321640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8102e00 0x7fe4f8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ff321640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 0x7fe4f819f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ff321640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f810d860 con 0x7fe4f8102e00 2024-09-11T22:25:33.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ff321640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f810d6e0 con 0x7fe4f8101c00 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ff321640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f810d9e0 con 0x7fe4f81037c0 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd8be640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 0x7fe4f819f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd8be640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 0x7fe4f819f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44098/0 (socket says 172.21.15.177:44098) 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd8be640 1 -- 172.21.15.177:0/3748166741 learned_addr learned my addr 172.21.15.177:0/3748166741 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd0bd640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4f8101c00 0x7fe4f8197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fc8bc640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8102e00 0x7fe4f8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd8be640 1 -- 172.21.15.177:0/3748166741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4f8101c00 msgr2=0x7fe4f8197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd8be640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4f8101c00 0x7fe4f8197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd8be640 1 -- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8102e00 msgr2=0x7fe4f8198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd8be640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8102e00 0x7fe4f8198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:33.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd8be640 1 -- 172.21.15.177:0/3748166741 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f819fa30 con 0x7fe4f81037c0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4fd8be640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 0x7fe4f819f3c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0031ae0 tx=0x7fe4f0031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ee7fc640 1 -- 172.21.15.177:0/3748166741 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0003c30 con 0x7fe4f81037c0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f819fcc0 con 0x7fe4f81037c0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ee7fc640 1 -- 172.21.15.177:0/3748166741 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4f0003dd0 con 0x7fe4f81037c0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.343+0000 7fe4ee7fc640 1 -- 172.21.15.177:0/3748166741 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f002fcb0 con 0x7fe4f81037c0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.344+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f81a01f0 con 0x7fe4f81037c0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.345+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f8108f30 con 0x7fe4f81037c0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.346+0000 7fe4ee7fc640 1 -- 172.21.15.177:0/3748166741 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe4f0004050 con 0x7fe4f81037c0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.346+0000 7fe4ee7fc640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe4e40a2bb0 0x7fe4e40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.347+0000 7fe4ee7fc640 1 -- 172.21.15.177:0/3748166741 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5117+0+0 (secure 0 0 0) 0x7fe4f00ef690 con 0x7fe4f81037c0 2024-09-11T22:25:33.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.347+0000 7fe4fd0bd640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe4e40a2bb0 0x7fe4e40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:33.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.347+0000 7fe4fd0bd640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe4e40a2bb0 0x7fe4e40a5070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8102c60 tx=0x7fe4f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:33.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.351+0000 7fe4ee7fc640 1 -- 172.21.15.177:0/3748166741 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4f00bd370 con 0x7fe4f81037c0 2024-09-11T22:25:33.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:33.530+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe4f8062630 con 0x7fe4e40a2bb0 2024-09-11T22:25:34.202 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:33 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi146 2024-09-11T22:25:34.202 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:33 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi146 to 5696M 2024-09-11T22:25:34.202 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:33 smithi177 ceph-mon[35530]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:25:34.202 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:33 smithi177 ceph-mon[35530]: osdmap e49: 8 total, 7 up, 8 in 2024-09-11T22:25:34.203 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:34.203 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:34.203 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:34.203 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:34.203 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:34.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:33 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi146 2024-09-11T22:25:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:33 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi146 to 5696M 2024-09-11T22:25:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:33 smithi040 ceph-mon[30787]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:25:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:33 smithi040 ceph-mon[30787]: osdmap e49: 8 total, 7 up, 8 in 2024-09-11T22:25:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:34.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:33 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi146 2024-09-11T22:25:34.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:33 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi146 to 5696M 2024-09-11T22:25:34.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:33 smithi146 ceph-mon[34996]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:25:34.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:33 smithi146 ceph-mon[34996]: osdmap e49: 8 total, 7 up, 8 in 2024-09-11T22:25:34.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:34.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:34.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:25:34.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:25:34.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:34.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:34 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:25:34.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:34 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:25:34.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:34 smithi177 ceph-mon[35530]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:34.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:34 smithi177 ceph-mon[35530]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:34.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:34 smithi177 ceph-mon[35530]: osd.7 [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] boot 2024-09-11T22:25:34.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:34 smithi177 ceph-mon[35530]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T22:25:34.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:34 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:34.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:34 smithi177 ceph-mon[35530]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T22:25:35.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:34 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:25:35.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:34 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:25:35.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:34 smithi040 ceph-mon[30787]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:35.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:34 smithi040 ceph-mon[30787]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:35.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:34 smithi040 ceph-mon[30787]: osd.7 [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] boot 2024-09-11T22:25:35.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:34 smithi040 ceph-mon[30787]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T22:25:35.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:34 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:35.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:34 smithi040 ceph-mon[30787]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T22:25:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:34 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:25:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:34 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:25:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:34 smithi146 ceph-mon[34996]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 202 MiB used, 626 GiB / 626 GiB avail 2024-09-11T22:25:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:34 smithi146 ceph-mon[34996]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:25:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:34 smithi146 ceph-mon[34996]: osd.7 [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] boot 2024-09-11T22:25:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:34 smithi146 ceph-mon[34996]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T22:25:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:34 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T22:25:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:34 smithi146 ceph-mon[34996]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T22:25:37.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:36 smithi040 ceph-mon[30787]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:37.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:36 smithi040 ceph-mon[30787]: osdmap e52: 8 total, 8 up, 8 in 2024-09-11T22:25:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:36 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/1463976415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5"}]: dispatch 2024-09-11T22:25:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:36 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5"}]: dispatch 2024-09-11T22:25:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:36 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5"}]': finished 2024-09-11T22:25:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:36 smithi040 ceph-mon[30787]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T22:25:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:36 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/1988537201' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:37.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:36 smithi177 ceph-mon[35530]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:37.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:36 smithi177 ceph-mon[35530]: osdmap e52: 8 total, 8 up, 8 in 2024-09-11T22:25:37.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:36 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/1463976415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5"}]: dispatch 2024-09-11T22:25:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:36 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5"}]: dispatch 2024-09-11T22:25:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:36 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5"}]': finished 2024-09-11T22:25:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:36 smithi177 ceph-mon[35530]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T22:25:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:37.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:36 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/1988537201' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:36 smithi146 ceph-mon[34996]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:36 smithi146 ceph-mon[34996]: osdmap e52: 8 total, 8 up, 8 in 2024-09-11T22:25:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:36 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/1463976415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5"}]: dispatch 2024-09-11T22:25:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:36 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5"}]: dispatch 2024-09-11T22:25:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:36 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5"}]': finished 2024-09-11T22:25:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:36 smithi146 ceph-mon[34996]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T22:25:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:37.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:36 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/1988537201' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:25:38.202 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:37 smithi177 ceph-mon[35530]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:38.202 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:37 smithi177 ceph-mon[35530]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T22:25:38.202 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:38.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:37 smithi040 ceph-mon[30787]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:38.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:37 smithi040 ceph-mon[30787]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T22:25:38.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:38.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:37 smithi146 ceph-mon[34996]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:38.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:37 smithi146 ceph-mon[34996]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T22:25:38.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:37 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:40.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:39 smithi040 ceph-mon[30787]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:40.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:39 smithi177 ceph-mon[35530]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:40.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:39 smithi146 ceph-mon[34996]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:42.221 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:41 smithi177 ceph-mon[35530]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:42.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:41 smithi040 ceph-mon[30787]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:42.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:41 smithi146 ceph-mon[34996]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:44.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:43 smithi040 ceph-mon[30787]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:44.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:43 smithi177 ceph-mon[35530]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:44.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:43 smithi146 ceph-mon[34996]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:44 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T22:25:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:44 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:44 smithi040 ceph-mon[30787]: Deploying daemon osd.8 on smithi177 2024-09-11T22:25:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T22:25:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:44 smithi177 ceph-mon[35530]: Deploying daemon osd.8 on smithi177 2024-09-11T22:25:45.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T22:25:45.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:45.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:44 smithi146 ceph-mon[34996]: Deploying daemon osd.8 on smithi177 2024-09-11T22:25:46.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:45 smithi177 ceph-mon[35530]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:46.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:45 smithi040 ceph-mon[30787]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:46.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:45 smithi146 ceph-mon[34996]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:48.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:47 smithi177 ceph-mon[35530]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:48.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:47 smithi040 ceph-mon[30787]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:48.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:47 smithi146 ceph-mon[34996]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:50.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:49 smithi040 ceph-mon[30787]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:50.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:49 smithi177 ceph-mon[35530]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:50.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:49 smithi146 ceph-mon[34996]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:51.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:51.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:51.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:51.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:51.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:51.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:53.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:52 smithi177 ceph-mon[35530]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:53.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:52 smithi040 ceph-mon[30787]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:53.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:52 smithi146 ceph-mon[34996]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:54.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.840+0000 7fe4ee7fc640 1 -- 172.21.15.177:0/3748166741 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe4f8062630 con 0x7fe4e40a2bb0 2024-09-11T22:25:54.842 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 8 on host 'smithi177' 2024-09-11T22:25:54.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe4e40a2bb0 msgr2=0x7fe4e40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:54.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe4e40a2bb0 0x7fe4e40a5070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8102c60 tx=0x7fe4f4005f90 comp rx=0 tx=0).stop 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 msgr2=0x7fe4f819f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 0x7fe4f819f3c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0031ae0 tx=0x7fe4f0031ee0 comp rx=0 tx=0).stop 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 shutdown_connections 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe4e40a2bb0 0x7fe4e40a5070 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f81037c0 0x7fe4f819f3c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8102e00 0x7fe4f8198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 --2- 172.21.15.177:0/3748166741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4f8101c00 0x7fe4f8197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 >> 172.21.15.177:0/3748166741 conn(0x7fe4f80fd390 msgr2=0x7fe4f8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 shutdown_connections 2024-09-11T22:25:54.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:25:54.843+0000 7fe4ff321640 1 -- 172.21.15.177:0/3748166741 wait complete. 2024-09-11T22:25:54.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:54 smithi040 ceph-mon[30787]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:54.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:54 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:54 smithi177 ceph-mon[35530]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:54 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:54 smithi146 ceph-mon[34996]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:55.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:54 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:55.493 DEBUG:teuthology.orchestra.run.smithi177:osd.8> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.8.service 2024-09-11T22:25:55.496 INFO:tasks.cephadm:Deploying osd.9 on smithi040 with /dev/vg_nvme/lv_1... 2024-09-11T22:25:55.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T22:25:55.882 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:25:55.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:55.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:55.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:56.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:56.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:56.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:56.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:25:56.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:56.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:57.004 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:56 smithi177 ceph-mon[35530]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:57.004 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:56 smithi177 ceph-mon[35530]: from='osd.8 [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:57.004 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:56 smithi177 ceph-mon[35530]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:57.004 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:25:56 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8[53462]: 2024-09-11T22:25:56.665+0000 7f063b111640 -1 osd.8 0 log_to_monitors true 2024-09-11T22:25:57.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:56 smithi040 ceph-mon[30787]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:57.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:56 smithi040 ceph-mon[30787]: from='osd.8 [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:57.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:56 smithi040 ceph-mon[30787]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:57.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:56 smithi146 ceph-mon[34996]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:57.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:56 smithi146 ceph-mon[34996]: from='osd.8 [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:57.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:56 smithi146 ceph-mon[34996]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T22:25:58.032 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:25:57 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8[53462]: 2024-09-11T22:25:57.853+0000 7f0637094640 -1 osd.8 0 waiting for initial osdmap 2024-09-11T22:25:58.032 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:25:57 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8[53462]: 2024-09-11T22:25:57.864+0000 7f0632ebc640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:25:58.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:57 smithi177 ceph-mon[35530]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T22:25:58.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:57 smithi177 ceph-mon[35530]: from='osd.8 [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:25:58.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:57 smithi177 ceph-mon[35530]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T22:25:58.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:58.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:57 smithi177 ceph-mon[35530]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:25:58.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:57 smithi040 ceph-mon[30787]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T22:25:58.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:57 smithi040 ceph-mon[30787]: from='osd.8 [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:25:58.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:57 smithi040 ceph-mon[30787]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T22:25:58.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:58.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:57 smithi040 ceph-mon[30787]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:25:58.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:57 smithi146 ceph-mon[34996]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T22:25:58.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:57 smithi146 ceph-mon[34996]: from='osd.8 [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:25:58.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:57 smithi146 ceph-mon[34996]: osdmap e55: 9 total, 8 up, 9 in 2024-09-11T22:25:58.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:58.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:57 smithi146 ceph-mon[34996]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: osdmap e56: 9 total, 8 up, 9 in 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:59.122 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:59.123 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.123 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:59.123 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:59.123 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:25:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: osdmap e56: 9 total, 8 up, 9 in 2024-09-11T22:25:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:59.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-11T22:25:59.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:25:59.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: osdmap e56: 9 total, 8 up, 9 in 2024-09-11T22:25:59.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:59.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:25:59.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:59.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:59.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:25:59.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:25:59.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:25:59.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:25:59.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:25:59.442 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi040:vg_nvme/lv_1 2024-09-11T22:25:59.824 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:26:00.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:59 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:26:00.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:59 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:26:00.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:59 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi177 2024-09-11T22:26:00.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:59 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi177 to 5695M 2024-09-11T22:26:00.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:59 smithi040 ceph-mon[30787]: osd.8 [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] boot 2024-09-11T22:26:00.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:59 smithi040 ceph-mon[30787]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T22:26:00.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:26:00.137 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:25:59 smithi040 ceph-mon[30787]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T22:26:00.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:59 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:26:00.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:59 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:26:00.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:59 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi177 2024-09-11T22:26:00.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:59 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi177 to 5695M 2024-09-11T22:26:00.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:59 smithi177 ceph-mon[35530]: osd.8 [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] boot 2024-09-11T22:26:00.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:59 smithi177 ceph-mon[35530]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T22:26:00.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:59 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:26:00.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:25:59 smithi177 ceph-mon[35530]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T22:26:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:59 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:26:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:59 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:26:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:59 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi177 2024-09-11T22:26:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:59 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi177 to 5695M 2024-09-11T22:26:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:59 smithi146 ceph-mon[34996]: osd.8 [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] boot 2024-09-11T22:26:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:59 smithi146 ceph-mon[34996]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T22:26:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:59 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T22:26:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:25:59 smithi146 ceph-mon[34996]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T22:26:00.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.426+0000 7fb531e00640 1 -- 172.21.15.40:0/699559074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c103e00 msgr2=0x7fb52c104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:00.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.426+0000 7fb531e00640 1 --2- 172.21.15.40:0/699559074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c103e00 0x7fb52c104200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009900 tx=0x7fb51c02a410 comp rx=0 tx=0).stop 2024-09-11T22:26:00.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.426+0000 7fb531e00640 1 -- 172.21.15.40:0/699559074 shutdown_connections 2024-09-11T22:26:00.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.426+0000 7fb531e00640 1 --2- 172.21.15.40:0/699559074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52c105920 0x7fb52c10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:00.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.426+0000 7fb531e00640 1 --2- 172.21.15.40:0/699559074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52c104f60 0x7fb52c1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:00.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.426+0000 7fb531e00640 1 --2- 172.21.15.40:0/699559074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c103e00 0x7fb52c104200 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:00.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.426+0000 7fb531e00640 1 -- 172.21.15.40:0/699559074 >> 172.21.15.40:0/699559074 conn(0x7fb52c0ff5b0 msgr2=0x7fb52c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:00.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.426+0000 7fb531e00640 1 -- 172.21.15.40:0/699559074 shutdown_connections 2024-09-11T22:26:00.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.426+0000 7fb531e00640 1 -- 172.21.15.40:0/699559074 wait complete. 2024-09-11T22:26:00.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.427+0000 7fb531e00640 1 Processor -- start 2024-09-11T22:26:00.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.427+0000 7fb531e00640 1 -- start start 2024-09-11T22:26:00.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.427+0000 7fb531e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52c103e00 0x7fb52c19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:00.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.427+0000 7fb531e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c104f60 0x7fb52c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:00.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.427+0000 7fb531e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52c105920 0x7fb52c1a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.427+0000 7fb531e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c10fb00 con 0x7fb52c104f60 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.427+0000 7fb531e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c10f980 con 0x7fb52c103e00 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.427+0000 7fb531e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c10fc80 con 0x7fb52c105920 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb523e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c104f60 0x7fb52c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb52aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52c103e00 0x7fb52c19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb523e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c104f60 0x7fb52c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34064/0 (socket says 172.21.15.40:34064) 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb523e00640 1 -- 172.21.15.40:0/2132490884 learned_addr learned my addr 172.21.15.40:0/2132490884 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb52b400640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52c105920 0x7fb52c1a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb52aa00640 1 -- 172.21.15.40:0/2132490884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52c105920 msgr2=0x7fb52c1a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb52aa00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52c105920 0x7fb52c1a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb52aa00640 1 -- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c104f60 msgr2=0x7fb52c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb52aa00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c104f60 0x7fb52c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:00.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb52aa00640 1 -- 172.21.15.40:0/2132490884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c1a1d00 con 0x7fb52c103e00 2024-09-11T22:26:00.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb523e00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c104f60 0x7fb52c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:26:00.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.428+0000 7fb52aa00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52c103e00 0x7fb52c19a0d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb51c02a930 tx=0x7fb51c032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:00.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.429+0000 7fb530a00640 1 -- 172.21.15.40:0/2132490884 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c03f030 con 0x7fb52c103e00 2024-09-11T22:26:00.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.429+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52c1a1f90 con 0x7fb52c103e00 2024-09-11T22:26:00.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.429+0000 7fb530a00640 1 -- 172.21.15.40:0/2132490884 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb51c003ce0 con 0x7fb52c103e00 2024-09-11T22:26:00.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.429+0000 7fb530a00640 1 -- 172.21.15.40:0/2132490884 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c035070 con 0x7fb52c103e00 2024-09-11T22:26:00.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.429+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52c1a23e0 con 0x7fb52c103e00 2024-09-11T22:26:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.430+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52c10b120 con 0x7fb52c103e00 2024-09-11T22:26:00.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.432+0000 7fb530a00640 1 -- 172.21.15.40:0/2132490884 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb51c042030 con 0x7fb52c103e00 2024-09-11T22:26:00.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.433+0000 7fb530a00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5100a2bb0 0x7fb5100a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:00.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.433+0000 7fb530a00640 1 -- 172.21.15.40:0/2132490884 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5858+0+0 (secure 0 0 0) 0x7fb51c0eee90 con 0x7fb52c103e00 2024-09-11T22:26:00.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.434+0000 7fb523e00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5100a2bb0 0x7fb5100a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:00.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.434+0000 7fb523e00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5100a2bb0 0x7fb5100a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb52c19b5f0 tx=0x7fb51400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:00.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.435+0000 7fb530a00640 1 -- 172.21.15.40:0/2132490884 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb51c0bc090 con 0x7fb52c103e00 2024-09-11T22:26:00.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:00.629+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb52c062630 con 0x7fb5100a2bb0 2024-09-11T22:26:01.228 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:00 smithi040 ceph-mon[30787]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:01.229 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:00 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:01.229 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:00 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:01.229 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:00 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:01.229 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:00 smithi040 ceph-mon[30787]: osdmap e59: 9 total, 9 up, 9 in 2024-09-11T22:26:01.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:00 smithi177 ceph-mon[35530]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:01.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:00 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:01.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:00 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:01.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:00 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:01.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:00 smithi177 ceph-mon[35530]: osdmap e59: 9 total, 9 up, 9 in 2024-09-11T22:26:01.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:00 smithi146 ceph-mon[34996]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:01.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:00 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:01.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:00 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:01.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:00 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:01.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:00 smithi146 ceph-mon[34996]: osdmap e59: 9 total, 9 up, 9 in 2024-09-11T22:26:02.140 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:01 smithi040 ceph-mon[30787]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:02.285 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:01 smithi177 ceph-mon[35530]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:02.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:01 smithi146 ceph-mon[34996]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi040:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:03.117 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:02 smithi040 ceph-mon[30787]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:03.118 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:02 smithi040 ceph-mon[30787]: osdmap e60: 9 total, 9 up, 9 in 2024-09-11T22:26:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:02 smithi177 ceph-mon[35530]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:02 smithi177 ceph-mon[35530]: osdmap e60: 9 total, 9 up, 9 in 2024-09-11T22:26:03.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:02 smithi146 ceph-mon[34996]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:03.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:02 smithi146 ceph-mon[34996]: osdmap e60: 9 total, 9 up, 9 in 2024-09-11T22:26:04.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:03 smithi040 ceph-mon[30787]: osdmap e61: 9 total, 9 up, 9 in 2024-09-11T22:26:04.310 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:03 smithi177 ceph-mon[35530]: osdmap e61: 9 total, 9 up, 9 in 2024-09-11T22:26:04.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:03 smithi146 ceph-mon[34996]: osdmap e61: 9 total, 9 up, 9 in 2024-09-11T22:26:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:04 smithi040 ceph-mon[30787]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:04 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/422892254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afd5d9ce-baf0-4331-b5f2-5803295060c4"}]: dispatch 2024-09-11T22:26:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:04 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/422892254' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afd5d9ce-baf0-4331-b5f2-5803295060c4"}]': finished 2024-09-11T22:26:05.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:04 smithi040 ceph-mon[30787]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T22:26:05.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:04 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:05.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:04 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3297256981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:04 smithi177 ceph-mon[35530]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:04 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/422892254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afd5d9ce-baf0-4331-b5f2-5803295060c4"}]: dispatch 2024-09-11T22:26:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:04 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/422892254' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afd5d9ce-baf0-4331-b5f2-5803295060c4"}]': finished 2024-09-11T22:26:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:04 smithi177 ceph-mon[35530]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T22:26:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:04 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:04 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3297256981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:05.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:04 smithi146 ceph-mon[34996]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:05.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:04 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/422892254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afd5d9ce-baf0-4331-b5f2-5803295060c4"}]: dispatch 2024-09-11T22:26:05.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:04 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/422892254' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afd5d9ce-baf0-4331-b5f2-5803295060c4"}]': finished 2024-09-11T22:26:05.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:04 smithi146 ceph-mon[34996]: osdmap e62: 10 total, 9 up, 10 in 2024-09-11T22:26:05.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:04 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:05.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:04 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3297256981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:07.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:06 smithi040 ceph-mon[30787]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-09-11T22:26:07.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:06 smithi177 ceph-mon[35530]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-09-11T22:26:07.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:06 smithi146 ceph-mon[34996]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-09-11T22:26:09.165 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:08 smithi040 ceph-mon[30787]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:26:09.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:08 smithi177 ceph-mon[35530]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:26:09.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:08 smithi146 ceph-mon[34996]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:26:10.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:10 smithi040 ceph-mon[30787]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-11T22:26:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:10 smithi177 ceph-mon[35530]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-11T22:26:11.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:10 smithi146 ceph-mon[34996]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-11T22:26:12.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:12 smithi040 ceph-mon[30787]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T22:26:13.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:12 smithi177 ceph-mon[35530]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T22:26:13.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:12 smithi146 ceph-mon[34996]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-11T22:26:13.962 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:13 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T22:26:13.962 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:13 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:14.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:13 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T22:26:14.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:13 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:14.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:13 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T22:26:14.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:13 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:14 smithi040 ceph-mon[30787]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:26:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:14 smithi040 ceph-mon[30787]: Deploying daemon osd.9 on smithi040 2024-09-11T22:26:15.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:14 smithi177 ceph-mon[35530]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:26:15.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:14 smithi177 ceph-mon[35530]: Deploying daemon osd.9 on smithi040 2024-09-11T22:26:15.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:14 smithi146 ceph-mon[34996]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T22:26:15.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:14 smithi146 ceph-mon[34996]: Deploying daemon osd.9 on smithi040 2024-09-11T22:26:17.104 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:16 smithi040 ceph-mon[30787]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:17.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:16 smithi177 ceph-mon[35530]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:17.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:16 smithi146 ceph-mon[34996]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:17.977 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:17 smithi040 ceph-mon[30787]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:18.235 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:17 smithi146 ceph-mon[34996]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:18.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:17 smithi177 ceph-mon[35530]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:20.146 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:20 smithi040 ceph-mon[30787]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:20.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:20 smithi177 ceph-mon[35530]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:20.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:20 smithi146 ceph-mon[34996]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:21.275 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:21 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:21.275 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:21 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:21.275 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:21 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:21.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:21 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:21.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:21 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:21.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:21 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:21.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:21 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:21.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:21 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:21.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:21 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:22.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:22 smithi040 ceph-mon[30787]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:23.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:22 smithi177 ceph-mon[35530]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:23.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:22 smithi146 ceph-mon[34996]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:24.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:24 smithi040 ceph-mon[30787]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:24.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:24.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:24.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:24.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:24.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:24.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.903+0000 7fb530a00640 1 -- 172.21.15.40:0/2132490884 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb52c062630 con 0x7fb5100a2bb0 2024-09-11T22:26:24.904 INFO:teuthology.orchestra.run.smithi040.stdout:Created osd(s) 9 on host 'smithi040' 2024-09-11T22:26:24.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5100a2bb0 msgr2=0x7fb5100a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:24.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5100a2bb0 0x7fb5100a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb52c19b5f0 tx=0x7fb51400b4a0 comp rx=0 tx=0).stop 2024-09-11T22:26:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52c103e00 msgr2=0x7fb52c19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52c103e00 0x7fb52c19a0d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb51c02a930 tx=0x7fb51c032ce0 comp rx=0 tx=0).stop 2024-09-11T22:26:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 shutdown_connections 2024-09-11T22:26:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5100a2bb0 0x7fb5100a5070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52c105920 0x7fb52c1a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb52c104f60 0x7fb52c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 --2- 172.21.15.40:0/2132490884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52c103e00 0x7fb52c19a0d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 >> 172.21.15.40:0/2132490884 conn(0x7fb52c0ff5b0 msgr2=0x7fb52c1082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 shutdown_connections 2024-09-11T22:26:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:26:24.905+0000 7fb531e00640 1 -- 172.21.15.40:0/2132490884 wait complete. 2024-09-11T22:26:25.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:24 smithi177 ceph-mon[35530]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:25.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:25.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:25.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:25.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:25.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:25.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:24 smithi146 ceph-mon[34996]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:25.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:25.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:25.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:25.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:25.086 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:25.654 DEBUG:teuthology.orchestra.run.smithi040:osd.9> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.9.service 2024-09-11T22:26:25.659 INFO:tasks.cephadm:Deploying osd.10 on smithi146 with /dev/vg_nvme/lv_1... 2024-09-11T22:26:25.659 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T22:26:25.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:25.890 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:25.891 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:25.917 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:26:26.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:26.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:26.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:26.038 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:26.038 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:26.038 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:26.186 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:26:26 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:26:26.048+0000 7f852602d640 -1 osd.9 0 log_to_monitors true 2024-09-11T22:26:27.108 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:26 smithi040 ceph-mon[30787]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:27.108 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:26 smithi040 ceph-mon[30787]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T22:26:27.210 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:26 smithi146 ceph-mon[34996]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:27.211 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:26 smithi146 ceph-mon[34996]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T22:26:27.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:26 smithi177 ceph-mon[35530]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:27.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:26 smithi177 ceph-mon[35530]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T22:26:28.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:27 smithi040 ceph-mon[30787]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T22:26:28.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:27 smithi040 ceph-mon[30787]: osdmap e63: 10 total, 9 up, 10 in 2024-09-11T22:26:28.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:27 smithi040 ceph-mon[30787]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:26:28.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:28.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:27 smithi040 ceph-mon[30787]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:26:28.236 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:26:27 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:26:27.930+0000 7f8520800640 -1 osd.9 0 waiting for initial osdmap 2024-09-11T22:26:28.236 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:26:27 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:26:27.944+0000 7f851b800640 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:26:28.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:27 smithi177 ceph-mon[35530]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T22:26:28.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:27 smithi177 ceph-mon[35530]: osdmap e63: 10 total, 9 up, 10 in 2024-09-11T22:26:28.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:27 smithi177 ceph-mon[35530]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:26:28.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:28.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:27 smithi177 ceph-mon[35530]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:26:28.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:27 smithi146 ceph-mon[34996]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T22:26:28.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:27 smithi146 ceph-mon[34996]: osdmap e63: 10 total, 9 up, 10 in 2024-09-11T22:26:28.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:27 smithi146 ceph-mon[34996]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]: dispatch 2024-09-11T22:26:28.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:28.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:27 smithi146 ceph-mon[34996]: from='osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi040", "root=default"]}]': finished 2024-09-11T22:26:28.655 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-11T22:26:28.683 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi146:vg_nvme/lv_1 2024-09-11T22:26:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:26:29.187 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:28 smithi146 ceph-mon[34996]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:29.187 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:28 smithi146 ceph-mon[34996]: osdmap e64: 10 total, 9 up, 10 in 2024-09-11T22:26:29.187 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:29.188 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:29.188 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:29.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:28 smithi040 ceph-mon[30787]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:28 smithi040 ceph-mon[30787]: osdmap e64: 10 total, 9 up, 10 in 2024-09-11T22:26:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:29.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:28 smithi177 ceph-mon[35530]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:28 smithi177 ceph-mon[35530]: osdmap e64: 10 total, 9 up, 10 in 2024-09-11T22:26:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:29.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 -- 172.21.15.146:0/1950507520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c102690 msgr2=0x7f104c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:29.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 --2- 172.21.15.146:0/1950507520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c102690 0x7f104c108f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1044009ca0 tx=0x7f104402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:26:29.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 -- 172.21.15.146:0/1950507520 shutdown_connections 2024-09-11T22:26:29.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 --2- 172.21.15.146:0/1950507520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c102690 0x7f104c108f20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:29.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 --2- 172.21.15.146:0/1950507520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f104c101cd0 0x7f104c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:29.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 --2- 172.21.15.146:0/1950507520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f104c100ad0 0x7f104c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:29.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 -- 172.21.15.146:0/1950507520 >> 172.21.15.146:0/1950507520 conn(0x7f104c0fc280 msgr2=0x7f104c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:29.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 -- 172.21.15.146:0/1950507520 shutdown_connections 2024-09-11T22:26:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 -- 172.21.15.146:0/1950507520 wait complete. 2024-09-11T22:26:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 Processor -- start 2024-09-11T22:26:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.426+0000 7f1052243640 1 -- start start 2024-09-11T22:26:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f1052243640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f104c100ad0 0x7f104c197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f1052243640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c101cd0 0x7f104c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f1052243640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f104c102690 0x7f104c19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f1052243640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f104c10d8e0 con 0x7f104c102690 2024-09-11T22:26:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f1052243640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f104c10d760 con 0x7f104c101cd0 2024-09-11T22:26:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f1052243640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f104c10da60 con 0x7f104c100ad0 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c101cd0 0x7f104c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c101cd0 0x7f104c1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60330/0 (socket says 172.21.15.146:60330) 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104affd640 1 -- 172.21.15.146:0/1678852621 learned_addr learned my addr 172.21.15.146:0/1678852621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104b7fe640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f104c100ad0 0x7f104c197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104bfff640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f104c102690 0x7f104c19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104affd640 1 -- 172.21.15.146:0/1678852621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f104c100ad0 msgr2=0x7f104c197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104affd640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f104c100ad0 0x7f104c197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104affd640 1 -- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f104c102690 msgr2=0x7f104c19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104affd640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f104c102690 0x7f104c19f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104affd640 1 -- 172.21.15.146:0/1678852621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c19faa0 con 0x7f104c101cd0 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.427+0000 7f104affd640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c101cd0 0x7f104c1983b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f104000e9f0 tx=0x7f104000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.431+0000 7f1048ff9640 1 -- 172.21.15.146:0/1678852621 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104000cd80 con 0x7f104c101cd0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.431+0000 7f1048ff9640 1 -- 172.21.15.146:0/1678852621 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1040005500 con 0x7f104c101cd0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.431+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c19fd90 con 0x7f104c101cd0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.431+0000 7f1048ff9640 1 -- 172.21.15.146:0/1678852621 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040010690 con 0x7f104c101cd0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.431+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c1a0270 con 0x7f104c101cd0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.432+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104c107e00 con 0x7f104c101cd0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.433+0000 7f1048ff9640 1 -- 172.21.15.146:0/1678852621 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f10400046c0 con 0x7f104c101cd0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.434+0000 7f1048ff9640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f10340a2c30 0x7f10340a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.434+0000 7f1048ff9640 1 -- 172.21.15.146:0/1678852621 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6261+0+0 (secure 0 0 0) 0x7f10400cebd0 con 0x7f104c101cd0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.434+0000 7f104b7fe640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f10340a2c30 0x7f10340a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.435+0000 7f104b7fe640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f10340a2c30 0x7f10340a50f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f103c005fd0 tx=0x7f103c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.438+0000 7f1048ff9640 1 -- 172.21.15.146:0/1678852621 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f104009c330 con 0x7f104c101cd0 2024-09-11T22:26:29.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:29.615+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f104c062630 con 0x7f10340a2c30 2024-09-11T22:26:30.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] boot 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: osdmap e65: 10 total, 10 up, 10 in 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi040 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi040 to 4273M 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:30.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:29 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:30.267 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] boot 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: osdmap e65: 10 total, 10 up, 10 in 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi040 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.268 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.269 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.269 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.269 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi040 to 4273M 2024-09-11T22:26:30.269 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.269 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:30.269 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:30.269 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.269 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:30.269 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:30.270 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:30.270 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:29 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:30.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:26:30.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:26:30.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: osd.9 [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] boot 2024-09-11T22:26:30.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: osdmap e65: 10 total, 10 up, 10 in 2024-09-11T22:26:30.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T22:26:30.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-11T22:26:30.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi040 2024-09-11T22:26:30.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.284 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.284 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.284 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.284 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:30.284 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi040 to 4273M 2024-09-11T22:26:30.284 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.285 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:30.285 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:30.285 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:30.285 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi146:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:30.285 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:30.285 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:30.285 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:29 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:31.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:30 smithi146 ceph-mon[34996]: osdmap e66: 10 total, 10 up, 10 in 2024-09-11T22:26:31.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:30 smithi040 ceph-mon[30787]: osdmap e66: 10 total, 10 up, 10 in 2024-09-11T22:26:31.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:30 smithi177 ceph-mon[35530]: osdmap e66: 10 total, 10 up, 10 in 2024-09-11T22:26:32.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:31 smithi146 ceph-mon[34996]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:32.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:31 smithi040 ceph-mon[30787]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:32.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:31 smithi177 ceph-mon[35530]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:33.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:32 smithi146 ceph-mon[34996]: from='client.? 172.21.15.146:0/730985752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7de50dd1-146c-445f-8825-345170538fe1"}]: dispatch 2024-09-11T22:26:33.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:32 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7de50dd1-146c-445f-8825-345170538fe1"}]: dispatch 2024-09-11T22:26:33.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:32 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7de50dd1-146c-445f-8825-345170538fe1"}]': finished 2024-09-11T22:26:33.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:32 smithi146 ceph-mon[34996]: osdmap e67: 11 total, 10 up, 11 in 2024-09-11T22:26:33.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:33.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:32 smithi146 ceph-mon[34996]: from='client.? 172.21.15.146:0/1842708480' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:32 smithi040 ceph-mon[30787]: from='client.? 172.21.15.146:0/730985752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7de50dd1-146c-445f-8825-345170538fe1"}]: dispatch 2024-09-11T22:26:33.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:32 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7de50dd1-146c-445f-8825-345170538fe1"}]: dispatch 2024-09-11T22:26:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:32 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7de50dd1-146c-445f-8825-345170538fe1"}]': finished 2024-09-11T22:26:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:32 smithi040 ceph-mon[30787]: osdmap e67: 11 total, 10 up, 11 in 2024-09-11T22:26:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:32 smithi040 ceph-mon[30787]: from='client.? 172.21.15.146:0/1842708480' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:33.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:32 smithi177 ceph-mon[35530]: from='client.? 172.21.15.146:0/730985752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7de50dd1-146c-445f-8825-345170538fe1"}]: dispatch 2024-09-11T22:26:33.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:32 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7de50dd1-146c-445f-8825-345170538fe1"}]: dispatch 2024-09-11T22:26:33.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:32 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7de50dd1-146c-445f-8825-345170538fe1"}]': finished 2024-09-11T22:26:33.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:32 smithi177 ceph-mon[35530]: osdmap e67: 11 total, 10 up, 11 in 2024-09-11T22:26:33.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:33.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:32 smithi177 ceph-mon[35530]: from='client.? 172.21.15.146:0/1842708480' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:34.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:33 smithi040 ceph-mon[30787]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:34.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:33 smithi177 ceph-mon[35530]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:34.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:33 smithi146 ceph-mon[34996]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:36.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:36 smithi177 ceph-mon[35530]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:36.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:36 smithi146 ceph-mon[34996]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:36.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:36 smithi040 ceph-mon[30787]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:38.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:38 smithi177 ceph-mon[35530]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:38.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:38 smithi146 ceph-mon[34996]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:38 smithi040 ceph-mon[30787]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:40.188 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:40 smithi146 ceph-mon[34996]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:40.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:40 smithi177 ceph-mon[35530]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:40 smithi040 ceph-mon[30787]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:41 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T22:26:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:41 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:41.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T22:26:41.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:41 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T22:26:41.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:41 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:42.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:42 smithi177 ceph-mon[35530]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:42.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:42 smithi177 ceph-mon[35530]: Deploying daemon osd.10 on smithi146 2024-09-11T22:26:42.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:42 smithi146 ceph-mon[34996]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:42.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:42 smithi146 ceph-mon[34996]: Deploying daemon osd.10 on smithi146 2024-09-11T22:26:42.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:42 smithi040 ceph-mon[30787]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:42.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:42 smithi040 ceph-mon[30787]: Deploying daemon osd.10 on smithi146 2024-09-11T22:26:44.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:44 smithi177 ceph-mon[35530]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:44.307 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:44 smithi146 ceph-mon[34996]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:44.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:44 smithi040 ceph-mon[30787]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:46.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:46 smithi146 ceph-mon[34996]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:46.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:46 smithi040 ceph-mon[30787]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:46.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:46 smithi177 ceph-mon[35530]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:47.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:47 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:47.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:47 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:47.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:47 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:47.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:47.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:47.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:47 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:47.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:47.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:47.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:47 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:48.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:48 smithi146 ceph-mon[34996]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:48.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:48 smithi040 ceph-mon[30787]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:48.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:48 smithi177 ceph-mon[35530]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:49.946 INFO:teuthology.orchestra.run.smithi146.stdout:Created osd(s) 10 on host 'smithi146' 2024-09-11T22:26:49.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.945+0000 7f1048ff9640 1 -- 172.21.15.146:0/1678852621 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f104c062630 con 0x7f10340a2c30 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f10340a2c30 msgr2=0x7f10340a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f10340a2c30 0x7f10340a50f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f103c005fd0 tx=0x7f103c00b410 comp rx=0 tx=0).stop 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c101cd0 msgr2=0x7f104c1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c101cd0 0x7f104c1983b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f104000e9f0 tx=0x7f104000edf0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 shutdown_connections 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f10340a2c30 0x7f10340a50f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f104c102690 0x7f104c19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104c101cd0 0x7f104c1983b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 --2- 172.21.15.146:0/1678852621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f104c100ad0 0x7f104c197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:49.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 >> 172.21.15.146:0/1678852621 conn(0x7f104c0fc280 msgr2=0x7f104c104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:49.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 shutdown_connections 2024-09-11T22:26:49.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-11T22:26:49.948+0000 7f1052243640 1 -- 172.21.15.146:0/1678852621 wait complete. 2024-09-11T22:26:50.326 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:50 smithi146 ceph-mon[34996]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:50.326 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:50.326 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:50 smithi040 ceph-mon[30787]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:50 smithi177 ceph-mon[35530]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:50.998 DEBUG:teuthology.orchestra.run.smithi146:osd.10> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.10.service 2024-09-11T22:26:51.001 INFO:tasks.cephadm:Deploying osd.11 on smithi177 with /dev/vg_nvme/lv_1... 2024-09-11T22:26:51.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T22:26:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:26:52.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:52 smithi040 ceph-mon[30787]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:52.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:52 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:52.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:52 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:52.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:52 smithi177 ceph-mon[35530]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:52.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:52 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:52.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:52 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:52.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:52 smithi146 ceph-mon[34996]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:52.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:52 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:52.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:52 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:53.779 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:26:53 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:26:53.332+0000 7fc166522640 -1 osd.10 0 log_to_monitors true 2024-09-11T22:26:54.079 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-11T22:26:54.104 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi177:vg_nvme/lv_1 2024-09-11T22:26:54.356 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:26:54.477 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:54 smithi177 ceph-mon[35530]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:54.477 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:54 smithi177 ceph-mon[35530]: from='osd.10 [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:54.477 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:54 smithi177 ceph-mon[35530]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:54.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:54 smithi040 ceph-mon[30787]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:54.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:54 smithi040 ceph-mon[30787]: from='osd.10 [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:54.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:54 smithi040 ceph-mon[30787]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:54.568 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:54 smithi146 ceph-mon[34996]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:54.568 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:54 smithi146 ceph-mon[34996]: from='osd.10 [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:54.568 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:54 smithi146 ceph-mon[34996]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T22:26:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.862+0000 7faca812c640 1 -- 172.21.15.177:0/55056511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0102690 msgr2=0x7faca0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.862+0000 7faca812c640 1 --2- 172.21.15.177:0/55056511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0102690 0x7faca0108f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009900 tx=0x7fac9c02a410 comp rx=0 tx=0).stop 2024-09-11T22:26:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.862+0000 7faca812c640 1 -- 172.21.15.177:0/55056511 shutdown_connections 2024-09-11T22:26:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.862+0000 7faca812c640 1 --2- 172.21.15.177:0/55056511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0102690 0x7faca0108f20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.862+0000 7faca812c640 1 --2- 172.21.15.177:0/55056511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faca0101cd0 0x7faca0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.862+0000 7faca812c640 1 --2- 172.21.15.177:0/55056511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faca0100ad0 0x7faca0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:54.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.862+0000 7faca812c640 1 -- 172.21.15.177:0/55056511 >> 172.21.15.177:0/55056511 conn(0x7faca00fc280 msgr2=0x7faca00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 -- 172.21.15.177:0/55056511 shutdown_connections 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 -- 172.21.15.177:0/55056511 wait complete. 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 Processor -- start 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 -- start start 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faca0100ad0 0x7faca006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0101cd0 0x7faca019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faca0102690 0x7faca01a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faca010c750 con 0x7faca0100ad0 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faca010c5d0 con 0x7faca0102690 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca812c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faca010c8d0 con 0x7faca0101cd0 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca56c7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0101cd0 0x7faca019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:54.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca56c7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0101cd0 0x7faca019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41782/0 (socket says 172.21.15.177:41782) 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca56c7640 1 -- 172.21.15.177:0/1735771054 learned_addr learned my addr 172.21.15.177:0/1735771054 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.863+0000 7faca66c9640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faca0102690 0x7faca01a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca5ec8640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faca0100ad0 0x7faca006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca56c7640 1 -- 172.21.15.177:0/1735771054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faca0102690 msgr2=0x7faca01a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca56c7640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faca0102690 0x7faca01a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca56c7640 1 -- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faca0100ad0 msgr2=0x7faca006aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca56c7640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faca0100ad0 0x7faca006aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca56c7640 1 -- 172.21.15.177:0/1735771054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca01a1c90 con 0x7faca0101cd0 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca5ec8640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faca0100ad0 0x7faca006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca56c7640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0101cd0 0x7faca019ef50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c920 tx=0x7fac9000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7fac96ffd640 1 -- 172.21.15.177:0/1735771054 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90007c70 con 0x7faca0101cd0 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7fac96ffd640 1 -- 172.21.15.177:0/1735771054 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac90007e10 con 0x7faca0101cd0 2024-09-11T22:26:54.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7fac96ffd640 1 -- 172.21.15.177:0/1735771054 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90018890 con 0x7faca0101cd0 2024-09-11T22:26:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca01a1f20 con 0x7faca0101cd0 2024-09-11T22:26:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.864+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca01a23d0 con 0x7faca0101cd0 2024-09-11T22:26:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.865+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca0107e00 con 0x7faca0101cd0 2024-09-11T22:26:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.866+0000 7fac96ffd640 1 -- 172.21.15.177:0/1735771054 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fac90018a30 con 0x7faca0101cd0 2024-09-11T22:26:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.867+0000 7fac96ffd640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fac8c0a2bb0 0x7fac8c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.867+0000 7fac96ffd640 1 -- 172.21.15.177:0/1735771054 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6398+0+0 (secure 0 0 0) 0x7fac900ce9e0 con 0x7faca0101cd0 2024-09-11T22:26:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.867+0000 7faca5ec8640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fac8c0a2bb0 0x7fac8c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.868+0000 7faca5ec8640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fac8c0a2bb0 0x7fac8c0a5070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faca0101b30 tx=0x7fac98009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:54.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:54.871+0000 7fac96ffd640 1 -- 172.21.15.177:0/1735771054 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac90014030 con 0x7faca0101cd0 2024-09-11T22:26:55.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:26:55.047+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faca0062630 con 0x7fac8c0a2bb0 2024-09-11T22:26:55.453 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T22:26:55.453 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='osd.10 [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:26:55.453 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: osdmap e68: 11 total, 10 up, 11 in 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi146 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi146 to 4272M 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:55.454 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:55.455 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.455 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:55.455 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:55.455 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:55.455 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:55 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:55.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='osd.10 [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: osdmap e68: 11 total, 10 up, 11 in 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi146 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi146 to 4272M 2024-09-11T22:26:55.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:55.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:55.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:55.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:55.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:55.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:55 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:55.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='osd.10 [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: osdmap e68: 11 total, 10 up, 11 in 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]: dispatch 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi146 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi146 to 4272M 2024-09-11T22:26:55.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:55.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:55.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:55.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:26:55.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T22:26:55.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T22:26:55.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:56.237 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:26:55.904+0000 7fc1624a5640 -1 osd.10 0 waiting for initial osdmap 2024-09-11T22:26:56.237 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:26:55 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:26:55.916+0000 7fc15a2c5640 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:26:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:26:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: osdmap e69: 11 total, 10 up, 11 in 2024-09-11T22:26:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: from='osd.10 ' entity='osd.10' 2024-09-11T22:26:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: osd.10 [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] boot 2024-09-11T22:26:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: osdmap e70: 11 total, 11 up, 11 in 2024-09-11T22:26:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: osdmap e69: 11 total, 10 up, 11 in 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: from='osd.10 ' entity='osd.10' 2024-09-11T22:26:56.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: osd.10 [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] boot 2024-09-11T22:26:56.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: osdmap e70: 11 total, 11 up, 11 in 2024-09-11T22:26:56.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi146", "root=default"]}]': finished 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: osdmap e69: 11 total, 10 up, 11 in 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: from='osd.10 ' entity='osd.10' 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: osd.10 [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] boot 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: osdmap e70: 11 total, 11 up, 11 in 2024-09-11T22:26:56.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T22:26:57.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:57 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:26:57.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:57 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:26:57.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:57 smithi177 ceph-mon[35530]: osdmap e71: 11 total, 11 up, 11 in 2024-09-11T22:26:57.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:57 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:26:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:57 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:26:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:57 smithi146 ceph-mon[34996]: osdmap e71: 11 total, 11 up, 11 in 2024-09-11T22:26:57.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:57 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:26:57.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:57 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:26:57.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:57 smithi040 ceph-mon[30787]: osdmap e71: 11 total, 11 up, 11 in 2024-09-11T22:26:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:58 smithi177 ceph-mon[35530]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 435 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:58 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/2828596293' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd819162-017f-4323-b587-1ed164135d62"}]: dispatch 2024-09-11T22:26:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:58 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd819162-017f-4323-b587-1ed164135d62"}]: dispatch 2024-09-11T22:26:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:58 smithi177 ceph-mon[35530]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd819162-017f-4323-b587-1ed164135d62"}]': finished 2024-09-11T22:26:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:58 smithi177 ceph-mon[35530]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T22:26:58.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:58.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:26:58 smithi177 ceph-mon[35530]: from='client.? 172.21.15.177:0/4204955976' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:58.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:58 smithi146 ceph-mon[34996]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 435 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:58 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/2828596293' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd819162-017f-4323-b587-1ed164135d62"}]: dispatch 2024-09-11T22:26:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:58 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd819162-017f-4323-b587-1ed164135d62"}]: dispatch 2024-09-11T22:26:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:58 smithi146 ceph-mon[34996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd819162-017f-4323-b587-1ed164135d62"}]': finished 2024-09-11T22:26:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:58 smithi146 ceph-mon[34996]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T22:26:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:26:58 smithi146 ceph-mon[34996]: from='client.? 172.21.15.177:0/4204955976' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:58 smithi040 ceph-mon[30787]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 435 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:58 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/2828596293' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd819162-017f-4323-b587-1ed164135d62"}]: dispatch 2024-09-11T22:26:58.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:58 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd819162-017f-4323-b587-1ed164135d62"}]: dispatch 2024-09-11T22:26:58.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:58 smithi040 ceph-mon[30787]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd819162-017f-4323-b587-1ed164135d62"}]': finished 2024-09-11T22:26:58.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:58 smithi040 ceph-mon[30787]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T22:26:58.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:26:58.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:26:58 smithi040 ceph-mon[30787]: from='client.? 172.21.15.177:0/4204955976' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T22:27:00.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:00 smithi146 ceph-mon[34996]: pgmap v243: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 435 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T22:27:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:00 smithi146 ceph-mon[34996]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T22:27:00.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:00 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:00.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:00 smithi177 ceph-mon[35530]: pgmap v243: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 435 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T22:27:00.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:00 smithi177 ceph-mon[35530]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T22:27:00.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:00 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:00 smithi040 ceph-mon[30787]: pgmap v243: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 435 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T22:27:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:00 smithi040 ceph-mon[30787]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T22:27:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:00 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:01.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:01 smithi177 ceph-mon[35530]: osdmap e74: 12 total, 11 up, 12 in 2024-09-11T22:27:01.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:01 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:01.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:01 smithi146 ceph-mon[34996]: osdmap e74: 12 total, 11 up, 12 in 2024-09-11T22:27:01.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:01 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:01.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:01 smithi040 ceph-mon[30787]: osdmap e74: 12 total, 11 up, 12 in 2024-09-11T22:27:01.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:01 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:02.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:02 smithi177 ceph-mon[35530]: pgmap v246: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 435 MiB used, 983 GiB / 983 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-09-11T22:27:02.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:02 smithi146 ceph-mon[34996]: pgmap v246: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 435 MiB used, 983 GiB / 983 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-09-11T22:27:02.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:02 smithi040 ceph-mon[30787]: pgmap v246: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 435 MiB used, 983 GiB / 983 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-09-11T22:27:04.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:04 smithi177 ceph-mon[35530]: pgmap v247: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:27:04.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:04 smithi146 ceph-mon[34996]: pgmap v247: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:27:04.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:04 smithi040 ceph-mon[30787]: pgmap v247: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T22:27:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:06 smithi177 ceph-mon[35530]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T22:27:06.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:06 smithi146 ceph-mon[34996]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T22:27:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:06 smithi040 ceph-mon[30787]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T22:27:07.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T22:27:07.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:07 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:07.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:07 smithi177 ceph-mon[35530]: Deploying daemon osd.11 on smithi177 2024-09-11T22:27:07.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T22:27:07.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:07 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:07.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:07 smithi146 ceph-mon[34996]: Deploying daemon osd.11 on smithi177 2024-09-11T22:27:07.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T22:27:07.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:07 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:07.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:07 smithi040 ceph-mon[30787]: Deploying daemon osd.11 on smithi177 2024-09-11T22:27:08.528 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:08 smithi177 ceph-mon[35530]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:08.586 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:08 smithi146 ceph-mon[34996]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:08.848 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:08 smithi040 ceph-mon[30787]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:10.297 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:10 smithi177 ceph-mon[35530]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:10.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:10 smithi146 ceph-mon[34996]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:10.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:10 smithi040 ceph-mon[30787]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:12.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:12 smithi177 ceph-mon[35530]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:12.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:12 smithi146 ceph-mon[34996]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:12.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:12 smithi040 ceph-mon[30787]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:13.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:13 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:13.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:13 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:13.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:13 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:13.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:13 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:13.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:13 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:13.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:13 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:13 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:13 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:13.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:13 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:14.559 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:14 smithi177 ceph-mon[35530]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:14.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:14 smithi040 ceph-mon[30787]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:14.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:14 smithi146 ceph-mon[34996]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:16.103 INFO:teuthology.orchestra.run.smithi177.stdout:Created osd(s) 11 on host 'smithi177' 2024-09-11T22:27:16.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.102+0000 7fac96ffd640 1 -- 172.21.15.177:0/1735771054 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7faca0062630 con 0x7fac8c0a2bb0 2024-09-11T22:27:16.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fac8c0a2bb0 msgr2=0x7fac8c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fac8c0a2bb0 0x7fac8c0a5070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faca0101b30 tx=0x7fac98009500 comp rx=0 tx=0).stop 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0101cd0 msgr2=0x7faca019ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0101cd0 0x7faca019ef50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c920 tx=0x7fac9000cde0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 shutdown_connections 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fac8c0a2bb0 0x7fac8c0a5070 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faca0102690 0x7faca01a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faca0101cd0 0x7faca019ef50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 --2- 172.21.15.177:0/1735771054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faca0100ad0 0x7faca006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 >> 172.21.15.177:0/1735771054 conn(0x7faca00fc280 msgr2=0x7faca0104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 shutdown_connections 2024-09-11T22:27:16.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:16.105+0000 7faca812c640 1 -- 172.21.15.177:0/1735771054 wait complete. 2024-09-11T22:27:16.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:16 smithi040 ceph-mon[30787]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:16.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:16.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:16.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:16.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.765 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:16 smithi177 ceph-mon[35530]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:16.765 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.766 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.766 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:16.766 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:16.766 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.766 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:16.766 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.766 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.792 DEBUG:teuthology.orchestra.run.smithi177:osd.11> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.11.service 2024-09-11T22:27:16.794 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-11T22:27:16.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T22:27:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:16 smithi146 ceph-mon[34996]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:17.181 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.833+0000 7f72b0e00640 1 -- 172.21.15.40:0/1279166319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72ac104e50 msgr2=0x7f72ac1052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:17.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.833+0000 7f72b0e00640 1 --2- 172.21.15.40:0/1279166319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72ac104e50 0x7f72ac1052d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7298009860 tx=0x7f729802a340 comp rx=0 tx=0).stop 2024-09-11T22:27:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.833+0000 7f72b0e00640 1 -- 172.21.15.40:0/1279166319 shutdown_connections 2024-09-11T22:27:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.833+0000 7f72b0e00640 1 --2- 172.21.15.40:0/1279166319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72ac105810 0x7f72ac10c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.833+0000 7f72b0e00640 1 --2- 172.21.15.40:0/1279166319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72ac104e50 0x7f72ac1052d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.833+0000 7f72b0e00640 1 --2- 172.21.15.40:0/1279166319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ac103c50 0x7f72ac104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.833+0000 7f72b0e00640 1 -- 172.21.15.40:0/1279166319 >> 172.21.15.40:0/1279166319 conn(0x7f72ac0ff3e0 msgr2=0x7f72ac101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.833+0000 7f72b0e00640 1 -- 172.21.15.40:0/1279166319 shutdown_connections 2024-09-11T22:27:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.833+0000 7f72b0e00640 1 -- 172.21.15.40:0/1279166319 wait complete. 2024-09-11T22:27:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.835+0000 7f72b0e00640 1 Processor -- start 2024-09-11T22:27:17.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.835+0000 7f72b0e00640 1 -- start start 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.835+0000 7f72b0e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ac103c50 0x7f72ac199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.835+0000 7f72b0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72ac104e50 0x7f72ac19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.835+0000 7f72b0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72ac105810 0x7f72ac1a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.835+0000 7f72b0e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac10f8b0 con 0x7f72ac104e50 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.835+0000 7f72b0e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac10f730 con 0x7f72ac105810 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.835+0000 7f72b0e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac10fa30 con 0x7f72ac103c50 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72ab400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ac103c50 0x7f72ac199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72ab400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ac103c50 0x7f72ac199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:55794/0 (socket says 172.21.15.40:55794) 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72ab400640 1 -- 172.21.15.40:0/2882381955 learned_addr learned my addr 172.21.15.40:0/2882381955 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72aaa00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72ac104e50 0x7f72ac19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72abe00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72ac105810 0x7f72ac1a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72ab400640 1 -- 172.21.15.40:0/2882381955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72ac105810 msgr2=0x7f72ac1a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72ab400640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72ac105810 0x7f72ac1a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72ab400640 1 -- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72ac104e50 msgr2=0x7f72ac19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72ab400640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72ac104e50 0x7f72ac19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.836+0000 7f72ab400640 1 -- 172.21.15.40:0/2882381955 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ac1a1b30 con 0x7f72ac103c50 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.837+0000 7f72ab400640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ac103c50 0x7f72ac199f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e9f0 tx=0x7f729c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.837+0000 7f72a3e00640 1 -- 172.21.15.40:0/2882381955 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c00ccc0 con 0x7f72ac103c50 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.837+0000 7f72a3e00640 1 -- 172.21.15.40:0/2882381955 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f729c0035f0 con 0x7f72ac103c50 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.837+0000 7f72a3e00640 1 -- 172.21.15.40:0/2882381955 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c00ce60 con 0x7f72ac103c50 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.837+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ac1a1e20 con 0x7f72ac103c50 2024-09-11T22:27:17.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.837+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ac1a2280 con 0x7f72ac103c50 2024-09-11T22:27:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.838+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ac10b040 con 0x7f72ac103c50 2024-09-11T22:27:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.840+0000 7f72a3e00640 1 -- 172.21.15.40:0/2882381955 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f729c0037a0 con 0x7f72ac103c50 2024-09-11T22:27:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.841+0000 7f72a3e00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f72900a2c30 0x7f72900a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.841+0000 7f72a3e00640 1 -- 172.21.15.40:0/2882381955 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6809+0+0 (secure 0 0 0) 0x7f729c0cec90 con 0x7f72ac103c50 2024-09-11T22:27:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.841+0000 7f72aaa00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f72900a2c30 0x7f72900a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:17.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.842+0000 7f72aaa00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f72900a2c30 0x7f72900a50f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7298009830 tx=0x7f7298030550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:17.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:17.845+0000 7f72a3e00640 1 -- 172.21.15.40:0/2882381955 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f729c09c130 con 0x7f72ac103c50 2024-09-11T22:27:18.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.030+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f72ac062ef0 con 0x7f72ac103c50 2024-09-11T22:27:18.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.030+0000 7f72a3e00640 1 -- 172.21.15.40:0/2882381955 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f729c09ba30 con 0x7f72ac103c50 2024-09-11T22:27:18.031 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f72900a2c30 msgr2=0x7f72900a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f72900a2c30 0x7f72900a50f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7298009830 tx=0x7f7298030550 comp rx=0 tx=0).stop 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ac103c50 msgr2=0x7f72ac199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ac103c50 0x7f72ac199f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e9f0 tx=0x7f729c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 shutdown_connections 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f72900a2c30 0x7f72900a50f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72ac105810 0x7f72ac1a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72ac104e50 0x7f72ac19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 --2- 172.21.15.40:0/2882381955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ac103c50 0x7f72ac199f00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 >> 172.21.15.40:0/2882381955 conn(0x7f72ac0ff3e0 msgr2=0x7f72ac108210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 shutdown_connections 2024-09-11T22:27:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:18.033+0000 7f72b0e00640 1 -- 172.21.15.40:0/2882381955 wait complete. 2024-09-11T22:27:18.552 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:18 smithi177 ceph-mon[35530]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:18.552 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:18 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2882381955' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:27:18.552 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:27:18 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:27:18.524+0000 7f13e3a38640 -1 osd.11 0 log_to_monitors true 2024-09-11T22:27:18.636 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:18 smithi146 ceph-mon[34996]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:18.636 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:18 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2882381955' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:27:18.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:18 smithi040 ceph-mon[30787]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:18.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:18 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2882381955' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:27:19.104 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726093615,"num_in_osds":12,"osd_in_since":1726093617,"num_remapped_pgs":0} 2024-09-11T22:27:19.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:19 smithi177 ceph-mon[35530]: from='osd.11 [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:27:19.715 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:19 smithi177 ceph-mon[35530]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:27:19.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:19 smithi040 ceph-mon[30787]: from='osd.11 [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:27:19.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:19 smithi040 ceph-mon[30787]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:27:19.837 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:19 smithi146 ceph-mon[34996]: from='osd.11 [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:27:19.837 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:19 smithi146 ceph-mon[34996]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T22:27:20.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T22:27:20.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: osdmap e75: 12 total, 11 up, 12 in 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='osd.11 [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: Detected new or changed devices on smithi177 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi177 to 4271M 2024-09-11T22:27:20.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:20.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:20.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.486 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:20.782 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:27:20.377+0000 7f13df9bb640 -1 osd.11 0 waiting for initial osdmap 2024-09-11T22:27:20.782 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:27:20.392+0000 7f13db7e3640 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:27:20.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: osdmap e75: 12 total, 11 up, 12 in 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='osd.11 [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: Detected new or changed devices on smithi177 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi177 to 4271M 2024-09-11T22:27:20.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:20.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:20.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:20.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T22:27:20.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: osdmap e75: 12 total, 11 up, 12 in 2024-09-11T22:27:20.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='osd.11 [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:27:20.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]: dispatch 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: Detected new or changed devices on smithi177 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi177 to 4271M 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:20.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:21.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.073+0000 7f609c400640 1 -- 172.21.15.40:0/1087113321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094105920 msgr2=0x7f609410c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:21.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.073+0000 7f609c400640 1 --2- 172.21.15.40:0/1087113321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094105920 0x7f609410c240 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f608c009ca0 tx=0x7f608c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.073+0000 7f609c400640 1 -- 172.21.15.40:0/1087113321 shutdown_connections 2024-09-11T22:27:21.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.073+0000 7f609c400640 1 --2- 172.21.15.40:0/1087113321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094105920 0x7f609410c240 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.073+0000 7f609c400640 1 --2- 172.21.15.40:0/1087113321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6094104f60 0x7f60941053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.073+0000 7f609c400640 1 --2- 172.21.15.40:0/1087113321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6094103e00 0x7f6094104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.074+0000 7f609c400640 1 -- 172.21.15.40:0/1087113321 >> 172.21.15.40:0/1087113321 conn(0x7f60940ff5b0 msgr2=0x7f60941019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:21.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.074+0000 7f609c400640 1 -- 172.21.15.40:0/1087113321 shutdown_connections 2024-09-11T22:27:21.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.074+0000 7f609c400640 1 -- 172.21.15.40:0/1087113321 wait complete. 2024-09-11T22:27:21.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.074+0000 7f609c400640 1 Processor -- start 2024-09-11T22:27:21.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609c400640 1 -- start start 2024-09-11T22:27:21.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609c400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094103e00 0x7f609419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:21.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609c400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6094104f60 0x7f609419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:21.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609c400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6094105920 0x7f60941a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:21.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609c400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f609410fb00 con 0x7f6094103e00 2024-09-11T22:27:21.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609c400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f609410f980 con 0x7f6094105920 2024-09-11T22:27:21.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609c400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f609410fc80 con 0x7f6094104f60 2024-09-11T22:27:21.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f6099a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094103e00 0x7f609419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6094105920 0x7f60941a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6094105920 0x7f60941a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:32880/0 (socket says 172.21.15.40:32880) 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f6099a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094103e00 0x7f609419a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58714/0 (socket says 172.21.15.40:58714) 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f609a400640 1 -- 172.21.15.40:0/4053333141 learned_addr learned my addr 172.21.15.40:0/4053333141 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.075+0000 7f6099000640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6094104f60 0x7f609419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.076+0000 7f6099a00640 1 -- 172.21.15.40:0/4053333141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6094104f60 msgr2=0x7f609419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.076+0000 7f6099a00640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6094104f60 0x7f609419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.076+0000 7f6099a00640 1 -- 172.21.15.40:0/4053333141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6094105920 msgr2=0x7f60941a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.076+0000 7f6099a00640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6094105920 0x7f60941a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.076+0000 7f6099a00640 1 -- 172.21.15.40:0/4053333141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60941a1c90 con 0x7f6094103e00 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.076+0000 7f609a400640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6094105920 0x7f60941a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:21.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.076+0000 7f6099a00640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094103e00 0x7f609419a060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f608800e9f0 tx=0x7f608800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:21.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.076+0000 7f6092000640 1 -- 172.21.15.40:0/4053333141 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608800ccc0 con 0x7f6094103e00 2024-09-11T22:27:21.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.076+0000 7f6092000640 1 -- 172.21.15.40:0/4053333141 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6088010910 con 0x7f6094103e00 2024-09-11T22:27:21.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.077+0000 7f6092000640 1 -- 172.21.15.40:0/4053333141 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088018960 con 0x7f6094103e00 2024-09-11T22:27:21.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.077+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60941a1f80 con 0x7f6094103e00 2024-09-11T22:27:21.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.077+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60941a23d0 con 0x7f6094103e00 2024-09-11T22:27:21.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.078+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609410b0c0 con 0x7f6094103e00 2024-09-11T22:27:21.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.080+0000 7f6092000640 1 -- 172.21.15.40:0/4053333141 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6088010ac0 con 0x7f6094103e00 2024-09-11T22:27:21.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.081+0000 7f6092000640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f607c0a2bb0 0x7f607c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:21.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.081+0000 7f6092000640 1 -- 172.21.15.40:0/4053333141 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6847+0+0 (secure 0 0 0) 0x7f60880cf350 con 0x7f6094103e00 2024-09-11T22:27:21.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.081+0000 7f6099000640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f607c0a2bb0 0x7f607c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:21.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.082+0000 7f6099000640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f607c0a2bb0 0x7f607c0a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f609419b580 tx=0x7f6080005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:21.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.084+0000 7f6092000640 1 -- 172.21.15.40:0/4053333141 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f608809c180 con 0x7f6094103e00 2024-09-11T22:27:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.271+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f609402da30 con 0x7f6094103e00 2024-09-11T22:27:21.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.272+0000 7f6092000640 1 -- 172.21.15.40:0/4053333141 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f60880a0480 con 0x7f6094103e00 2024-09-11T22:27:21.272 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f607c0a2bb0 msgr2=0x7f607c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f607c0a2bb0 0x7f607c0a5070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f609419b580 tx=0x7f6080005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094103e00 msgr2=0x7f609419a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094103e00 0x7f609419a060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f608800e9f0 tx=0x7f608800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 shutdown_connections 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f607c0a2bb0 0x7f607c0a5070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6094105920 0x7f60941a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6094104f60 0x7f609419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 --2- 172.21.15.40:0/4053333141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6094103e00 0x7f609419a060 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 >> 172.21.15.40:0/4053333141 conn(0x7f60940ff5b0 msgr2=0x7f6094108290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 shutdown_connections 2024-09-11T22:27:21.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:21.274+0000 7f609c400640 1 -- 172.21.15.40:0/4053333141 wait complete. 2024-09-11T22:27:21.630 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:21 smithi040 ceph-mon[30787]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:27:21.630 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:21 smithi040 ceph-mon[30787]: osdmap e76: 12 total, 11 up, 12 in 2024-09-11T22:27:21.630 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:21 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:21.630 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:21 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:21.631 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:21 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/4053333141' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:27:21.631 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:21 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:21.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:21 smithi177 ceph-mon[35530]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:27:21.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:21 smithi177 ceph-mon[35530]: osdmap e76: 12 total, 11 up, 12 in 2024-09-11T22:27:21.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:21 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:21.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:21 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:21.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:21 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/4053333141' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:27:21.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:21 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:21.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:21 smithi146 ceph-mon[34996]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi177", "root=default"]}]': finished 2024-09-11T22:27:21.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:21 smithi146 ceph-mon[34996]: osdmap e76: 12 total, 11 up, 12 in 2024-09-11T22:27:21.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:21 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:21.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:21 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:21.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:21 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/4053333141' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:27:21.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:21 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:22.198 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1726093615,"num_in_osds":12,"osd_in_since":1726093617,"num_remapped_pgs":0} 2024-09-11T22:27:22.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:22 smithi040 ceph-mon[30787]: purged_snaps scrub starts 2024-09-11T22:27:22.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:22 smithi040 ceph-mon[30787]: purged_snaps scrub ok 2024-09-11T22:27:22.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:22 smithi040 ceph-mon[30787]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:22.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:22 smithi040 ceph-mon[30787]: osd.11 [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] boot 2024-09-11T22:27:22.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:22 smithi040 ceph-mon[30787]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T22:27:22.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:22 smithi177 ceph-mon[35530]: purged_snaps scrub starts 2024-09-11T22:27:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:22 smithi177 ceph-mon[35530]: purged_snaps scrub ok 2024-09-11T22:27:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:22 smithi177 ceph-mon[35530]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:22 smithi177 ceph-mon[35530]: osd.11 [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] boot 2024-09-11T22:27:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:22 smithi177 ceph-mon[35530]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T22:27:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:22.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:22 smithi146 ceph-mon[34996]: purged_snaps scrub starts 2024-09-11T22:27:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:22 smithi146 ceph-mon[34996]: purged_snaps scrub ok 2024-09-11T22:27:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:22 smithi146 ceph-mon[34996]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-09-11T22:27:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:22 smithi146 ceph-mon[34996]: osd.11 [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] boot 2024-09-11T22:27:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:22 smithi146 ceph-mon[34996]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T22:27:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T22:27:23.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T22:27:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:23.725 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:23 smithi040 ceph-mon[30787]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T22:27:23.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:23 smithi177 ceph-mon[35530]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T22:27:23.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:23 smithi146 ceph-mon[34996]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.119+0000 7f61b9600640 1 -- 172.21.15.40:0/4109073641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4101c00 msgr2=0x7f61b4102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.119+0000 7f61b9600640 1 --2- 172.21.15.40:0/4109073641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4101c00 0x7f61b4102000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009900 tx=0x7f61a402a410 comp rx=0 tx=0).stop 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.119+0000 7f61b9600640 1 -- 172.21.15.40:0/4109073641 shutdown_connections 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.119+0000 7f61b9600640 1 --2- 172.21.15.40:0/4109073641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61b41037c0 0x7f61b410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.119+0000 7f61b9600640 1 --2- 172.21.15.40:0/4109073641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61b4102e00 0x7f61b4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.119+0000 7f61b9600640 1 --2- 172.21.15.40:0/4109073641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4101c00 0x7f61b4102000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.119+0000 7f61b9600640 1 -- 172.21.15.40:0/4109073641 >> 172.21.15.40:0/4109073641 conn(0x7f61b40fd390 msgr2=0x7f61b40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.119+0000 7f61b9600640 1 -- 172.21.15.40:0/4109073641 shutdown_connections 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.119+0000 7f61b9600640 1 -- 172.21.15.40:0/4109073641 wait complete. 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.120+0000 7f61b9600640 1 Processor -- start 2024-09-11T22:27:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.120+0000 7f61b9600640 1 -- start start 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b9600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61b4101c00 0x7f61b419a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b9600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4102e00 0x7f61b419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b9600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61b41037c0 0x7f61b41a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b9600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f61b410d860 con 0x7f61b4102e00 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b9600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f61b410d6e0 con 0x7f61b4101c00 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b9600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61b410d9e0 con 0x7f61b41037c0 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4102e00 0x7f61b419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61b4101c00 0x7f61b419a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4102e00 0x7f61b419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49000/0 (socket says 172.21.15.40:49000) 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2000640 1 -- 172.21.15.40:0/2451752110 learned_addr learned my addr 172.21.15.40:0/2451752110 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b3400640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61b41037c0 0x7f61b41a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2a00640 1 -- 172.21.15.40:0/2451752110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61b41037c0 msgr2=0x7f61b41a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2a00640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61b41037c0 0x7f61b41a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2a00640 1 -- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4102e00 msgr2=0x7f61b419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2a00640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4102e00 0x7f61b419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2a00640 1 -- 172.21.15.40:0/2451752110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b41a1d70 con 0x7f61b4101c00 2024-09-11T22:27:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.121+0000 7f61b2000640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4102e00 0x7f61b419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.122+0000 7f61b2a00640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61b4101c00 0x7f61b419a140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009230 tx=0x7f61a4004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.122+0000 7f61ab400640 1 -- 172.21.15.40:0/2451752110 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a403f070 con 0x7f61b4101c00 2024-09-11T22:27:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.122+0000 7f61ab400640 1 -- 172.21.15.40:0/2451752110 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61a4003cd0 con 0x7f61b4101c00 2024-09-11T22:27:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.122+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b41a2000 con 0x7f61b4101c00 2024-09-11T22:27:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.122+0000 7f61ab400640 1 -- 172.21.15.40:0/2451752110 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4035070 con 0x7f61b4101c00 2024-09-11T22:27:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.122+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b41a2500 con 0x7f61b4101c00 2024-09-11T22:27:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.124+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b41a2760 con 0x7f61b4101c00 2024-09-11T22:27:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.125+0000 7f61ab400640 1 -- 172.21.15.40:0/2451752110 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f61a403b460 con 0x7f61b4101c00 2024-09-11T22:27:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.127+0000 7f61ab400640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61980a2c30 0x7f61980a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.127+0000 7f61ab400640 1 -- 172.21.15.40:0/2451752110 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f61a40eef30 con 0x7f61b4101c00 2024-09-11T22:27:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.127+0000 7f61b2000640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61980a2c30 0x7f61980a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.127+0000 7f61b2000640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61980a2c30 0x7f61980a50f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61b419b660 tx=0x7f61a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.131+0000 7f61ab400640 1 -- 172.21.15.40:0/2451752110 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61a40bbcd0 con 0x7f61b4101c00 2024-09-11T22:27:24.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.315+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f61b41a2930 con 0x7f61b4101c00 2024-09-11T22:27:24.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.316+0000 7f61ab400640 1 -- 172.21.15.40:0/2451752110 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) ==== 74+0+133 (secure 0 0 0) 0x7f61a40bffd0 con 0x7f61b4101c00 2024-09-11T22:27:24.317 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.318+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61980a2c30 msgr2=0x7f61980a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.318+0000 7f61b9600640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61980a2c30 0x7f61980a50f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61b419b660 tx=0x7f61a0005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.318+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61b4101c00 msgr2=0x7f61b419a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.318+0000 7f61b9600640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61b4101c00 0x7f61b419a140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009230 tx=0x7f61a4004270 comp rx=0 tx=0).stop 2024-09-11T22:27:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.319+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 shutdown_connections 2024-09-11T22:27:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.319+0000 7f61b9600640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f61980a2c30 0x7f61980a50f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.319+0000 7f61b9600640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61b41037c0 0x7f61b41a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.319+0000 7f61b9600640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61b4102e00 0x7f61b419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.319+0000 7f61b9600640 1 --2- 172.21.15.40:0/2451752110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61b4101c00 0x7f61b419a140 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:24.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.319+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 >> 172.21.15.40:0/2451752110 conn(0x7f61b40fd390 msgr2=0x7f61b41085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:24.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.319+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 shutdown_connections 2024-09-11T22:27:24.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:24.319+0000 7f61b9600640 1 -- 172.21.15.40:0/2451752110 wait complete. 2024-09-11T22:27:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:24 smithi040 ceph-mon[30787]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:24.681 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:24 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2451752110' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:27:24.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:24 smithi177 ceph-mon[35530]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:24.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:24 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2451752110' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:27:24.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:24 smithi146 ceph-mon[34996]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:24 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2451752110' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T22:27:25.268 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1726093641,"num_in_osds":12,"osd_in_since":1726093617,"num_remapped_pgs":0} 2024-09-11T22:27:25.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:27:25.643 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:26.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.244+0000 7f81faa00640 1 -- 172.21.15.40:0/1475070884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81f4103670 msgr2=0x7f81f410bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.244+0000 7f81faa00640 1 --2- 172.21.15.40:0/1475070884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81f4103670 0x7f81f410bb60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009900 tx=0x7f81e002a480 comp rx=0 tx=0).stop 2024-09-11T22:27:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.244+0000 7f81faa00640 1 -- 172.21.15.40:0/1475070884 shutdown_connections 2024-09-11T22:27:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.244+0000 7f81faa00640 1 --2- 172.21.15.40:0/1475070884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81f410c180 0x7f81f410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.244+0000 7f81faa00640 1 --2- 172.21.15.40:0/1475070884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81f4103670 0x7f81f410bb60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.244+0000 7f81faa00640 1 --2- 172.21.15.40:0/1475070884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4102d50 0x7f81f4103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.244+0000 7f81faa00640 1 -- 172.21.15.40:0/1475070884 >> 172.21.15.40:0/1475070884 conn(0x7f81f40fc7d0 msgr2=0x7f81f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.244+0000 7f81faa00640 1 -- 172.21.15.40:0/1475070884 shutdown_connections 2024-09-11T22:27:26.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.244+0000 7f81faa00640 1 -- 172.21.15.40:0/1475070884 wait complete. 2024-09-11T22:27:26.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.245+0000 7f81faa00640 1 Processor -- start 2024-09-11T22:27:26.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.245+0000 7f81faa00640 1 -- start start 2024-09-11T22:27:26.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.245+0000 7f81faa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4102d50 0x7f81f41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:26.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.245+0000 7f81faa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81f4103670 0x7f81f4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:26.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.245+0000 7f81faa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81f410c180 0x7f81f419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:26.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.245+0000 7f81faa00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4111fd0 con 0x7f81f410c180 2024-09-11T22:27:26.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.245+0000 7f81faa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4111e50 con 0x7f81f4102d50 2024-09-11T22:27:26.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.245+0000 7f81faa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4112150 con 0x7f81f4103670 2024-09-11T22:27:26.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4102d50 0x7f81f41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:26.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f8a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81f410c180 0x7f81f419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:26.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4102d50 0x7f81f41984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:58128/0 (socket says 172.21.15.40:58128) 2024-09-11T22:27:26.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f3e00640 1 -- 172.21.15.40:0/592909996 learned_addr learned my addr 172.21.15.40:0/592909996 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:26.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f3400640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81f4103670 0x7f81f4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f3e00640 1 -- 172.21.15.40:0/592909996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81f4103670 msgr2=0x7f81f4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f3e00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81f4103670 0x7f81f4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f3e00640 1 -- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81f410c180 msgr2=0x7f81f419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f3e00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81f410c180 0x7f81f419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f3e00640 1 -- 172.21.15.40:0/592909996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f419d480 con 0x7f81f4102d50 2024-09-11T22:27:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.246+0000 7f81f8a00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81f410c180 0x7f81f419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:26.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.247+0000 7f81f3e00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4102d50 0x7f81f41984d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e9f0 tx=0x7f81e400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.247+0000 7f81f0c00640 1 -- 172.21.15.40:0/592909996 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e400cd80 con 0x7f81f4102d50 2024-09-11T22:27:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.247+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f419d770 con 0x7f81f4102d50 2024-09-11T22:27:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.247+0000 7f81f0c00640 1 -- 172.21.15.40:0/592909996 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e4010910 con 0x7f81f4102d50 2024-09-11T22:27:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.247+0000 7f81f0c00640 1 -- 172.21.15.40:0/592909996 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40188f0 con 0x7f81f4102d50 2024-09-11T22:27:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.247+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f41a5050 con 0x7f81f4102d50 2024-09-11T22:27:26.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.248+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f4103130 con 0x7f81f4102d50 2024-09-11T22:27:26.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.250+0000 7f81f0c00640 1 -- 172.21.15.40:0/592909996 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f81e4010ac0 con 0x7f81f4102d50 2024-09-11T22:27:26.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.251+0000 7f81f0c00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f81d80a2b80 0x7f81d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:26.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.252+0000 7f81f0c00640 1 -- 172.21.15.40:0/592909996 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f81e40cf400 con 0x7f81f4102d50 2024-09-11T22:27:26.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.252+0000 7f81f3400640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f81d80a2b80 0x7f81d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.252+0000 7f81f3400640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f81d80a2b80 0x7f81d80a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f81e0000c00 tx=0x7f81e0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:26.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.253+0000 7f81f0c00640 1 -- 172.21.15.40:0/592909996 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81e409c110 con 0x7f81f4102d50 2024-09-11T22:27:26.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.439+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81f41071f0 con 0x7f81f4102d50 2024-09-11T22:27:26.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.441+0000 7f81f0c00640 1 -- 172.21.15.40:0/592909996 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+18494 (secure 0 0 0) 0x7f81e40a0410 con 0x7f81f4102d50 2024-09-11T22:27:26.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:26.442 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":78,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:27:22.390898+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:27:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f81d80a2b80 msgr2=0x7f81d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f81d80a2b80 0x7f81d80a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f81e0000c00 tx=0x7f81e0005b50 comp rx=0 tx=0).stop 2024-09-11T22:27:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4102d50 msgr2=0x7f81f41984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4102d50 0x7f81f41984d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e9f0 tx=0x7f81e400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 shutdown_connections 2024-09-11T22:27:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f81d80a2b80 0x7f81d80a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81f410c180 0x7f81f419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81f4103670 0x7f81f4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 --2- 172.21.15.40:0/592909996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4102d50 0x7f81f41984d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:26.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.443+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 >> 172.21.15.40:0/592909996 conn(0x7f81f40fc7d0 msgr2=0x7f81f40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:26.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.444+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 shutdown_connections 2024-09-11T22:27:26.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:26.444+0000 7f81faa00640 1 -- 172.21.15.40:0/592909996 wait complete. 2024-09-11T22:27:26.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:26 smithi040 ceph-mon[30787]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:26.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:26 smithi177 ceph-mon[35530]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:26.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:26 smithi146 ceph-mon[34996]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:27.261 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:23:19.500985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T22:27:27.262 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T22:27:27.650 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:27.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:27 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/592909996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:27.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:27 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/592909996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:27.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:27 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/592909996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:27:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.257+0000 7f4ea8600640 1 -- 172.21.15.40:0/3129736003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0109120 msgr2=0x7f4ea0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.257+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3129736003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0109120 0x7f4ea0110ca0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009ca0 tx=0x7f4e9802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.257+0000 7f4ea8600640 1 -- 172.21.15.40:0/3129736003 shutdown_connections 2024-09-11T22:27:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.257+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3129736003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0109120 0x7f4ea0110ca0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.257+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3129736003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea01049a0 0x7f4ea01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.257+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3129736003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ea0103ff0 0x7f4ea01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.257+0000 7f4ea8600640 1 -- 172.21.15.40:0/3129736003 >> 172.21.15.40:0/3129736003 conn(0x7f4ea00ffa90 msgr2=0x7f4ea0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.258+0000 7f4ea8600640 1 -- 172.21.15.40:0/3129736003 shutdown_connections 2024-09-11T22:27:28.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.258+0000 7f4ea8600640 1 -- 172.21.15.40:0/3129736003 wait complete. 2024-09-11T22:27:28.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.259+0000 7f4ea8600640 1 Processor -- start 2024-09-11T22:27:28.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.259+0000 7f4ea8600640 1 -- start start 2024-09-11T22:27:28.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.259+0000 7f4ea8600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0103ff0 0x7f4ea019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.259+0000 7f4ea8600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea01049a0 0x7f4ea019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.259+0000 7f4ea8600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ea0109120 0x7f4ea019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.259+0000 7f4ea8600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea01141a0 con 0x7f4ea0103ff0 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.259+0000 7f4ea8600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea0114020 con 0x7f4ea01049a0 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.259+0000 7f4ea8600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea0114320 con 0x7f4ea0109120 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.259+0000 7f4ea5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0103ff0 0x7f4ea019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea01049a0 0x7f4ea019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0103ff0 0x7f4ea019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49022/0 (socket says 172.21.15.40:49022) 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5c00640 1 -- 172.21.15.40:0/3480108791 learned_addr learned my addr 172.21.15.40:0/3480108791 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea6600640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ea0109120 0x7f4ea019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5c00640 1 -- 172.21.15.40:0/3480108791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ea0109120 msgr2=0x7f4ea019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5c00640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ea0109120 0x7f4ea019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5c00640 1 -- 172.21.15.40:0/3480108791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea01049a0 msgr2=0x7f4ea019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5c00640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea01049a0 0x7f4ea019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5c00640 1 -- 172.21.15.40:0/3480108791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea019f570 con 0x7f4ea0103ff0 2024-09-11T22:27:28.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5200640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea01049a0 0x7f4ea019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:28.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.260+0000 7f4ea5c00640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0103ff0 0x7f4ea019a5c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400d770 tx=0x7f4e9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:28.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.261+0000 7f4e9e000640 1 -- 172.21.15.40:0/3480108791 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94017070 con 0x7f4ea0103ff0 2024-09-11T22:27:28.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.261+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea019f860 con 0x7f4ea0103ff0 2024-09-11T22:27:28.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.261+0000 7f4e9e000640 1 -- 172.21.15.40:0/3480108791 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e94005500 con 0x7f4ea0103ff0 2024-09-11T22:27:28.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.261+0000 7f4e9e000640 1 -- 172.21.15.40:0/3480108791 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94004e00 con 0x7f4ea0103ff0 2024-09-11T22:27:28.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.261+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea01a7140 con 0x7f4ea0103ff0 2024-09-11T22:27:28.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.262+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea01043d0 con 0x7f4ea0103ff0 2024-09-11T22:27:28.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.264+0000 7f4e9e000640 1 -- 172.21.15.40:0/3480108791 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4e94004fa0 con 0x7f4ea0103ff0 2024-09-11T22:27:28.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.265+0000 7f4e9e000640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4e880a2b80 0x7f4e880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.265+0000 7f4e9e000640 1 -- 172.21.15.40:0/3480108791 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f4e940ce610 con 0x7f4ea0103ff0 2024-09-11T22:27:28.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.265+0000 7f4ea5200640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4e880a2b80 0x7f4e880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.266+0000 7f4ea5200640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4e880a2b80 0x7f4e880a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ea010aaf0 tx=0x7f4e8c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:28.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.270+0000 7f4e9e000640 1 -- 172.21.15.40:0/3480108791 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4e9409b320 con 0x7f4ea0103ff0 2024-09-11T22:27:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.452+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4ea01a73d0 con 0x7f4ea0103ff0 2024-09-11T22:27:28.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.453+0000 7f4e9e000640 1 -- 172.21.15.40:0/3480108791 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f4e9409f620 con 0x7f4ea0103ff0 2024-09-11T22:27:28.453 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-11T22:27:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.455+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4e880a2b80 msgr2=0x7f4e880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.455+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4e880a2b80 0x7f4e880a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ea010aaf0 tx=0x7f4e8c00b410 comp rx=0 tx=0).stop 2024-09-11T22:27:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.455+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0103ff0 msgr2=0x7f4ea019a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.455+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0103ff0 0x7f4ea019a5c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400d770 tx=0x7f4e9400dc30 comp rx=0 tx=0).stop 2024-09-11T22:27:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.456+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 shutdown_connections 2024-09-11T22:27:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.456+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f4e880a2b80 0x7f4e880a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.456+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ea0109120 0x7f4ea019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.456+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea01049a0 0x7f4ea019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.456+0000 7f4ea8600640 1 --2- 172.21.15.40:0/3480108791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ea0103ff0 0x7f4ea019a5c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.456+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 >> 172.21.15.40:0/3480108791 conn(0x7f4ea00ffa90 msgr2=0x7f4ea01005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.456+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 shutdown_connections 2024-09-11T22:27:28.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:28.456+0000 7f4ea8600640 1 -- 172.21.15.40:0/3480108791 wait complete. 2024-09-11T22:27:28.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:28 smithi040 ceph-mon[30787]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:28.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:28 smithi177 ceph-mon[35530]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:28.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:28 smithi146 ceph-mon[34996]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.a on smithi040 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.d on smithi040 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.g on smithi040 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.j on smithi040 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.b on smithi146 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.e on smithi146 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.h on smithi146 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.k on smithi146 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.c on smithi177 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.f on smithi177 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.i on smithi177 2024-09-11T22:27:29.353 INFO:tasks.cephadm:Adding mds.l on smithi177 2024-09-11T22:27:29.354 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l' 2024-09-11T22:27:29.615 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:27:29.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:29 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3480108791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:27:29.735 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:29 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3480108791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:27:29.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:29 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3480108791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:27:30.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.112+0000 7fe1e7656640 1 -- 172.21.15.177:0/4166299552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0102690 msgr2=0x7fe1e0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:30.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.112+0000 7fe1e7656640 1 --2- 172.21.15.177:0/4166299552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0102690 0x7fe1e0108f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009ca0 tx=0x7fe1d802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.112+0000 7fe1e7656640 1 -- 172.21.15.177:0/4166299552 shutdown_connections 2024-09-11T22:27:30.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.112+0000 7fe1e7656640 1 --2- 172.21.15.177:0/4166299552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0102690 0x7fe1e0108f20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.112+0000 7fe1e7656640 1 --2- 172.21.15.177:0/4166299552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e0101cd0 0x7fe1e0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.112+0000 7fe1e7656640 1 --2- 172.21.15.177:0/4166299552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1e0100ad0 0x7fe1e0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.112+0000 7fe1e7656640 1 -- 172.21.15.177:0/4166299552 >> 172.21.15.177:0/4166299552 conn(0x7fe1e00fc280 msgr2=0x7fe1e00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.112+0000 7fe1e7656640 1 -- 172.21.15.177:0/4166299552 shutdown_connections 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.112+0000 7fe1e7656640 1 -- 172.21.15.177:0/4166299552 wait complete. 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e7656640 1 Processor -- start 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e7656640 1 -- start start 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e7656640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e0100ad0 0x7fe1e0196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e7656640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0101cd0 0x7fe1e0197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e7656640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1e0102690 0x7fe1e019e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e7656640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e010c800 con 0x7fe1e0102690 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e7656640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e010c680 con 0x7fe1e0100ad0 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e7656640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e010c980 con 0x7fe1e0101cd0 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e4bf1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0101cd0 0x7fe1e0197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e4bf1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0101cd0 0x7fe1e0197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:45740/0 (socket says 172.21.15.177:45740) 2024-09-11T22:27:30.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e4bf1640 1 -- 172.21.15.177:0/703432554 learned_addr learned my addr 172.21.15.177:0/703432554 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e53f2640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e0100ad0 0x7fe1e0196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e4bf1640 1 -- 172.21.15.177:0/703432554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e0100ad0 msgr2=0x7fe1e0196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e4bf1640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e0100ad0 0x7fe1e0196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e4bf1640 1 -- 172.21.15.177:0/703432554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1e0102690 msgr2=0x7fe1e019e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.113+0000 7fe1e4bf1640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1e0102690 0x7fe1e019e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.114+0000 7fe1e4bf1640 1 -- 172.21.15.177:0/703432554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e019ea50 con 0x7fe1e0101cd0 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.114+0000 7fe1e53f2640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e0100ad0 0x7fe1e0196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.114+0000 7fe1e4bf1640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0101cd0 0x7fe1e0197360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009860 tx=0x7fe1dc009d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.114+0000 7fe1d67fc640 1 -- 172.21.15.177:0/703432554 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc005020 con 0x7fe1e0101cd0 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.114+0000 7fe1d67fc640 1 -- 172.21.15.177:0/703432554 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1dc0047a0 con 0x7fe1e0101cd0 2024-09-11T22:27:30.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.114+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e0069fd0 con 0x7fe1e0101cd0 2024-09-11T22:27:30.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.114+0000 7fe1d67fc640 1 -- 172.21.15.177:0/703432554 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc007ba0 con 0x7fe1e0101cd0 2024-09-11T22:27:30.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.114+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e006a590 con 0x7fe1e0101cd0 2024-09-11T22:27:30.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.115+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e01078f0 con 0x7fe1e0101cd0 2024-09-11T22:27:30.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.117+0000 7fe1d67fc640 1 -- 172.21.15.177:0/703432554 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe1dc004950 con 0x7fe1e0101cd0 2024-09-11T22:27:30.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.118+0000 7fe1d67fc640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe1cc0a2c30 0x7fe1cc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:30.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.118+0000 7fe1d67fc640 1 -- 172.21.15.177:0/703432554 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fe1dc0d00e0 con 0x7fe1e0101cd0 2024-09-11T22:27:30.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.118+0000 7fe1e53f2640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe1cc0a2c30 0x7fe1cc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:30.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.119+0000 7fe1e53f2640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe1cc0a2c30 0x7fe1cc0a50f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0006fd0 tx=0x7fe1d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:30.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.122+0000 7fe1d67fc640 1 -- 172.21.15.177:0/703432554 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe1dc09d4e0 con 0x7fe1e0101cd0 2024-09-11T22:27:30.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.305+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}) -- 0x7fe1e006a9b0 con 0x7fe1cc0a2c30 2024-09-11T22:27:30.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.314+0000 7fe1d67fc640 1 -- 172.21.15.177:0/703432554 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fe1e006a9b0 con 0x7fe1cc0a2c30 2024-09-11T22:27:30.314 INFO:teuthology.orchestra.run.smithi177.stdout:Scheduled mds.all update... 2024-09-11T22:27:30.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe1cc0a2c30 msgr2=0x7fe1cc0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:30.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe1cc0a2c30 0x7fe1cc0a50f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0006fd0 tx=0x7fe1d0008040 comp rx=0 tx=0).stop 2024-09-11T22:27:30.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0101cd0 msgr2=0x7fe1e0197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:30.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0101cd0 0x7fe1e0197360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009860 tx=0x7fe1dc009d20 comp rx=0 tx=0).stop 2024-09-11T22:27:30.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 shutdown_connections 2024-09-11T22:27:30.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe1cc0a2c30 0x7fe1cc0a50f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1e0102690 0x7fe1e019e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e0101cd0 0x7fe1e0197360 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 --2- 172.21.15.177:0/703432554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e0100ad0 0x7fe1e0196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:30.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 >> 172.21.15.177:0/703432554 conn(0x7fe1e00fc280 msgr2=0x7fe1e0105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:30.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 shutdown_connections 2024-09-11T22:27:30.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-11T22:27:30.316+0000 7fe1e7656640 1 -- 172.21.15.177:0/703432554 wait complete. 2024-09-11T22:27:30.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:30 smithi040 ceph-mon[30787]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:30.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:30 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:30.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:30 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:30.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:30 smithi177 ceph-mon[35530]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:30.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:30 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:30.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:30 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:30.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:30 smithi146 ceph-mon[34996]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:30.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:30 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:30.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:30 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:27:31.020 DEBUG:teuthology.orchestra.run.smithi040:mds.a> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.a.service 2024-09-11T22:27:31.025 DEBUG:teuthology.orchestra.run.smithi040:mds.d> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.d.service 2024-09-11T22:27:31.070 DEBUG:teuthology.orchestra.run.smithi040:mds.g> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.g.service 2024-09-11T22:27:31.115 DEBUG:teuthology.orchestra.run.smithi040:mds.j> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.j.service 2024-09-11T22:27:31.160 DEBUG:teuthology.orchestra.run.smithi146:mds.b> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.b.service 2024-09-11T22:27:31.163 DEBUG:teuthology.orchestra.run.smithi146:mds.e> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.e.service 2024-09-11T22:27:31.207 DEBUG:teuthology.orchestra.run.smithi146:mds.h> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.h.service 2024-09-11T22:27:31.250 DEBUG:teuthology.orchestra.run.smithi146:mds.k> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.k.service 2024-09-11T22:27:31.293 DEBUG:teuthology.orchestra.run.smithi177:mds.c> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.c.service 2024-09-11T22:27:31.296 DEBUG:teuthology.orchestra.run.smithi177:mds.f> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.f.service 2024-09-11T22:27:31.338 DEBUG:teuthology.orchestra.run.smithi177:mds.i> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.i.service 2024-09-11T22:27:31.382 DEBUG:teuthology.orchestra.run.smithi177:mds.l> sudo journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.l.service 2024-09-11T22:27:31.426 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-11T22:27:31.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:31.443 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:31 smithi177 ceph-mon[35530]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:31.444 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:31 smithi177 ceph-mon[35530]: Saving service mds.all spec with placement smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-09-11T22:27:31.444 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:31 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:31.444 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:31 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:31.444 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:31 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:31.444 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:31 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:31.445 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:31 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:31.445 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:31 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:31.445 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:31 smithi177 ceph-mon[35530]: Deploying daemon mds.l on smithi177 2024-09-11T22:27:31.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:31 smithi146 ceph-mon[34996]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:31.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:31 smithi146 ceph-mon[34996]: Saving service mds.all spec with placement smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-09-11T22:27:31.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:31 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:31.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:31 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:31.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:31 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:31.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:31 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:31.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:31 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:31.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:31 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:31.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:31 smithi146 ceph-mon[34996]: Deploying daemon mds.l on smithi177 2024-09-11T22:27:31.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:31 smithi040 ceph-mon[30787]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:27:31.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:31 smithi040 ceph-mon[30787]: Saving service mds.all spec with placement smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-09-11T22:27:31.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:31 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:31.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:31 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:27:31.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:31 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:31.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:31 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:31.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:31 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:31.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:31 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:31.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:31 smithi040 ceph-mon[30787]: Deploying daemon mds.l on smithi177 2024-09-11T22:27:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:32.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.346+0000 7f8778000640 1 -- 172.21.15.40:0/2235377693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8770109120 msgr2=0x7f8770110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:32.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.346+0000 7f8778000640 1 --2- 172.21.15.40:0/2235377693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8770109120 0x7f8770110ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8768009ca0 tx=0x7f876802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.346+0000 7f8778000640 1 -- 172.21.15.40:0/2235377693 shutdown_connections 2024-09-11T22:27:32.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.346+0000 7f8778000640 1 --2- 172.21.15.40:0/2235377693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8770109120 0x7f8770110ca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.346+0000 7f8778000640 1 --2- 172.21.15.40:0/2235377693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87701049a0 0x7f87701089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.346+0000 7f8778000640 1 --2- 172.21.15.40:0/2235377693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8770103ff0 0x7f87701043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.346+0000 7f8778000640 1 -- 172.21.15.40:0/2235377693 >> 172.21.15.40:0/2235377693 conn(0x7f87700ffa90 msgr2=0x7f8770101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:32.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.346+0000 7f8778000640 1 -- 172.21.15.40:0/2235377693 shutdown_connections 2024-09-11T22:27:32.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.346+0000 7f8778000640 1 -- 172.21.15.40:0/2235377693 wait complete. 2024-09-11T22:27:32.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.347+0000 7f8778000640 1 Processor -- start 2024-09-11T22:27:32.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.347+0000 7f8778000640 1 -- start start 2024-09-11T22:27:32.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8778000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8770103ff0 0x7f877019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:32.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8778000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87701049a0 0x7f877019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:32.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8778000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8770109120 0x7f877019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8778000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8770114180 con 0x7f87701049a0 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8778000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8770114000 con 0x7f8770103ff0 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8778000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8770114300 con 0x7f8770109120 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8774c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87701049a0 0x7f877019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8774c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87701049a0 0x7f877019ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40896/0 (socket says 172.21.15.40:40896) 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8774c00640 1 -- 172.21.15.40:0/887389942 learned_addr learned my addr 172.21.15.40:0/887389942 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8776000640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8770109120 0x7f877019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.348+0000 7f8775600640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8770103ff0 0x7f877019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f8774c00640 1 -- 172.21.15.40:0/887389942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8770109120 msgr2=0x7f877019ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f8774c00640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8770109120 0x7f877019ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f8774c00640 1 -- 172.21.15.40:0/887389942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8770103ff0 msgr2=0x7f877019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f8774c00640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8770103ff0 0x7f877019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f8774c00640 1 -- 172.21.15.40:0/887389942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877019f570 con 0x7f87701049a0 2024-09-11T22:27:32.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f8774c00640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87701049a0 0x7f877019ab00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f875c00d950 tx=0x7f875c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:32.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f876e000640 1 -- 172.21.15.40:0/887389942 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c017070 con 0x7f87701049a0 2024-09-11T22:27:32.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f876e000640 1 -- 172.21.15.40:0/887389942 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f875c009c30 con 0x7f87701049a0 2024-09-11T22:27:32.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877019f860 con 0x7f87701049a0 2024-09-11T22:27:32.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.349+0000 7f876e000640 1 -- 172.21.15.40:0/887389942 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c00f6b0 con 0x7f87701049a0 2024-09-11T22:27:32.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.350+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87701a7140 con 0x7f87701049a0 2024-09-11T22:27:32.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.351+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87701043d0 con 0x7f87701049a0 2024-09-11T22:27:32.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.353+0000 7f876e000640 1 -- 172.21.15.40:0/887389942 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f875c0109d0 con 0x7f87701049a0 2024-09-11T22:27:32.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.355+0000 7f876e000640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f87580a2c00 0x7f87580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:32.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.355+0000 7f876e000640 1 -- 172.21.15.40:0/887389942 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f875c0ce6e0 con 0x7f87701049a0 2024-09-11T22:27:32.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.355+0000 7f8775600640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f87580a2c00 0x7f87580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:32.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.355+0000 7f8775600640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f87580a2c00 0x7f87580a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8764009bd0 tx=0x7f8764005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:32.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.359+0000 7f876e000640 1 -- 172.21.15.40:0/887389942 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f875c009de0 con 0x7f87701049a0 2024-09-11T22:27:32.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.578+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87701a7470 con 0x7f87701049a0 2024-09-11T22:27:32.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.578+0000 7f876e000640 1 -- 172.21.15.40:0/887389942 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f875c09b3f0 con 0x7f87701049a0 2024-09-11T22:27:32.579 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":1,"btime":"2024-09-11T22:20:05:624820+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-11T22:27:32.580 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 1 2024-09-11T22:27:32.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.580+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f87580a2c00 msgr2=0x7f87580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:32.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.580+0000 7f8778000640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f87580a2c00 0x7f87580a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8764009bd0 tx=0x7f8764005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:32.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.580+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87701049a0 msgr2=0x7f877019ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:32.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.580+0000 7f8778000640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87701049a0 0x7f877019ab00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f875c00d950 tx=0x7f875c00de10 comp rx=0 tx=0).stop 2024-09-11T22:27:32.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.581+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 shutdown_connections 2024-09-11T22:27:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.581+0000 7f8778000640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f87580a2c00 0x7f87580a50c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.581+0000 7f8778000640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8770109120 0x7f877019ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.581+0000 7f8778000640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87701049a0 0x7f877019ab00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.581+0000 7f8778000640 1 --2- 172.21.15.40:0/887389942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8770103ff0 0x7f877019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.581+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 >> 172.21.15.40:0/887389942 conn(0x7f87700ffa90 msgr2=0x7f87701004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.581+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 shutdown_connections 2024-09-11T22:27:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:32.581+0000 7f8778000640 1 -- 172.21.15.40:0/887389942 wait complete. 2024-09-11T22:27:32.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:32 smithi177 ceph-mon[35530]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:32.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:32 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/887389942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:32.935 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:32 smithi040 ceph-mon[30787]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:32.935 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:32 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/887389942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:33.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:32 smithi146 ceph-mon[34996]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:33.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:32 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/887389942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:33.532 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 11 22:27:33 smithi177 systemd[1]: Started Ceph mds.l for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:34.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:34.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.177:6832/2871952691,v1:172.21.15.177:6833/2871952691] up:boot 2024-09-11T22:27:34.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: fsmap 1 up:standby 2024-09-11T22:27:34.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:27:34.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:34.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:34.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:34.336 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:34.337 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:34.337 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:34.337 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:34 smithi146 ceph-mon[34996]: Deploying daemon mds.k on smithi146 2024-09-11T22:27:34.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:34.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.177:6832/2871952691,v1:172.21.15.177:6833/2871952691] up:boot 2024-09-11T22:27:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: fsmap 1 up:standby 2024-09-11T22:27:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:27:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:34 smithi040 ceph-mon[30787]: Deploying daemon mds.k on smithi146 2024-09-11T22:27:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.177:6832/2871952691,v1:172.21.15.177:6833/2871952691] up:boot 2024-09-11T22:27:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: fsmap 1 up:standby 2024-09-11T22:27:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T22:27:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:34.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:34.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:34.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:34.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:34.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:34 smithi177 ceph-mon[35530]: Deploying daemon mds.k on smithi146 2024-09-11T22:27:35.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:35.584 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:27:35 smithi146 systemd[1]: Starting Ceph mds.k for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:35.836 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:35.892 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:27:35 smithi146 podman[64400]: 2024-09-11 22:27:35.5027572 +0000 UTC m=+0.016029261 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:35.892 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:27:35 smithi146 podman[64400]: 2024-09-11 22:27:35.647798235 +0000 UTC m=+0.161070323 container create 6e2864040c287fb51ac715eee047173ec421db7ad7f041e4128c83274a6c3492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-k, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:27:35.892 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:27:35 smithi146 podman[64400]: 2024-09-11 22:27:35.892043953 +0000 UTC m=+0.405316000 container init 6e2864040c287fb51ac715eee047173ec421db7ad7f041e4128c83274a6c3492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3) 2024-09-11T22:27:36.192 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:27:35 smithi146 podman[64400]: 2024-09-11 22:27:35.895314156 +0000 UTC m=+0.408586209 container start 6e2864040c287fb51ac715eee047173ec421db7ad7f041e4128c83274a6c3492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-11T22:27:36.192 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:27:35 smithi146 ceph-mds[64419]: -- 172.21.15.146:0/3686764059 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5655204a5860 con 0x565520483000 2024-09-11T22:27:36.192 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:27:35 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-k[64415]: starting mds.k at 2024-09-11T22:27:36.192 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:27:36 smithi146 bash[64400]: 6e2864040c287fb51ac715eee047173ec421db7ad7f041e4128c83274a6c3492 2024-09-11T22:27:36.192 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:27:36 smithi146 systemd[1]: Started Ceph mds.k for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:36.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:36 smithi040 ceph-mon[30787]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:36.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:36.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:36.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:36.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:36 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.371+0000 7f5ef9e00640 1 -- 172.21.15.40:0/49777224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef4109120 msgr2=0x7f5ef4110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.371+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/49777224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef4109120 0x7f5ef4110ca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009ca0 tx=0x7f5eec02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.371+0000 7f5ef9e00640 1 -- 172.21.15.40:0/49777224 shutdown_connections 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.371+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/49777224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef4109120 0x7f5ef4110ca0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.371+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/49777224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef41049a0 0x7f5ef41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.371+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/49777224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef4103ff0 0x7f5ef41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.371+0000 7f5ef9e00640 1 -- 172.21.15.40:0/49777224 >> 172.21.15.40:0/49777224 conn(0x7f5ef40ffa90 msgr2=0x7f5ef4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.371+0000 7f5ef9e00640 1 -- 172.21.15.40:0/49777224 shutdown_connections 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.372+0000 7f5ef9e00640 1 -- 172.21.15.40:0/49777224 wait complete. 2024-09-11T22:27:36.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.372+0000 7f5ef9e00640 1 Processor -- start 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef9e00640 1 -- start start 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef4103ff0 0x7f5ef419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef41049a0 0x7f5ef419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef4109120 0x7f5ef419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef9e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4114130 con 0x7f5ef41049a0 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef9e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4113fb0 con 0x7f5ef4109120 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef9e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef41142b0 con 0x7f5ef4103ff0 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef41049a0 0x7f5ef419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef41049a0 0x7f5ef419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40912/0 (socket says 172.21.15.40:40912) 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef4103ff0 0x7f5ef419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.373+0000 7f5ef2000640 1 -- 172.21.15.40:0/1691621187 learned_addr learned my addr 172.21.15.40:0/1691621187 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:36.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.374+0000 7f5ef3400640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef4109120 0x7f5ef419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.374+0000 7f5ef2000640 1 -- 172.21.15.40:0/1691621187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef4103ff0 msgr2=0x7f5ef419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.374+0000 7f5ef2000640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef4103ff0 0x7f5ef419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.374+0000 7f5ef2000640 1 -- 172.21.15.40:0/1691621187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef4109120 msgr2=0x7f5ef419ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.374+0000 7f5ef2000640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef4109120 0x7f5ef419ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.374+0000 7f5ef2000640 1 -- 172.21.15.40:0/1691621187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef419f540 con 0x7f5ef41049a0 2024-09-11T22:27:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.374+0000 7f5ef2000640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef41049a0 0x7f5ef419aad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000e9f0 tx=0x7f5ee000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.374+0000 7f5ef8a00640 1 -- 172.21.15.40:0/1691621187 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000cd80 con 0x7f5ef41049a0 2024-09-11T22:27:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.374+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef419f830 con 0x7f5ef41049a0 2024-09-11T22:27:36.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.375+0000 7f5ef8a00640 1 -- 172.21.15.40:0/1691621187 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee0010910 con 0x7f5ef41049a0 2024-09-11T22:27:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.375+0000 7f5ef8a00640 1 -- 172.21.15.40:0/1691621187 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee00188f0 con 0x7f5ef41049a0 2024-09-11T22:27:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.375+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef41a7110 con 0x7f5ef41049a0 2024-09-11T22:27:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.376+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef41043d0 con 0x7f5ef41049a0 2024-09-11T22:27:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.379+0000 7f5ef8a00640 1 -- 172.21.15.40:0/1691621187 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5ee0010ac0 con 0x7f5ef41049a0 2024-09-11T22:27:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.381+0000 7f5ef8a00640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ed80a2b80 0x7f5ed80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.381+0000 7f5ef8a00640 1 -- 172.21.15.40:0/1691621187 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f5ee00cf350 con 0x7f5ef41049a0 2024-09-11T22:27:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.381+0000 7f5ef2a00640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ed80a2b80 0x7f5ed80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.382+0000 7f5ef8a00640 1 -- 172.21.15.40:0/1691621187 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ee009c060 con 0x7f5ef41049a0 2024-09-11T22:27:36.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.382+0000 7f5ef2a00640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ed80a2b80 0x7f5ed80a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009bd0 tx=0x7f5ee4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:36 smithi177 ceph-mon[35530]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:36.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:36 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:36.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:36 smithi146 ceph-mon[34996]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:36.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:36.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:36.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:36.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:36.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:36.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:36 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:36.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.614+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ef41a7370 con 0x7f5ef41049a0 2024-09-11T22:27:36.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.614+0000 7f5ef8a00640 1 -- 172.21.15.40:0/1691621187 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f5ee00a0360 con 0x7f5ef41049a0 2024-09-11T22:27:36.615 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:36.615 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"btime":"2024-09-11T22:27:36:190049+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T22:27:36.615 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2024-09-11T22:27:36.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ed80a2b80 msgr2=0x7f5ed80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:36.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ed80a2b80 0x7f5ed80a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009bd0 tx=0x7f5ee4005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:36.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef41049a0 msgr2=0x7f5ef419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:36.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef41049a0 0x7f5ef419aad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000e9f0 tx=0x7f5ee000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 shutdown_connections 2024-09-11T22:27:36.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ed80a2b80 0x7f5ed80a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef4109120 0x7f5ef419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ef41049a0 0x7f5ef419aad0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 --2- 172.21.15.40:0/1691621187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef4103ff0 0x7f5ef419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:36.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 >> 172.21.15.40:0/1691621187 conn(0x7f5ef40ffa90 msgr2=0x7f5ef4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:36.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.617+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 shutdown_connections 2024-09-11T22:27:36.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:36.618+0000 7f5ef9e00640 1 -- 172.21.15.40:0/1691621187 wait complete. 2024-09-11T22:27:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:37 smithi146 ceph-mon[34996]: Deploying daemon mds.j on smithi040 2024-09-11T22:27:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:37 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.146:6832/3511870643,v1:172.21.15.146:6833/3511870643] up:boot 2024-09-11T22:27:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:37 smithi146 ceph-mon[34996]: fsmap 2 up:standby 2024-09-11T22:27:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:37 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:27:37.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:37 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1691621187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:37.433 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:37 smithi040 ceph-mon[30787]: Deploying daemon mds.j on smithi040 2024-09-11T22:27:37.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:37 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.146:6832/3511870643,v1:172.21.15.146:6833/3511870643] up:boot 2024-09-11T22:27:37.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:37 smithi040 ceph-mon[30787]: fsmap 2 up:standby 2024-09-11T22:27:37.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:37 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:27:37.434 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:37 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1691621187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:37.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:37 smithi177 ceph-mon[35530]: Deploying daemon mds.j on smithi040 2024-09-11T22:27:37.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:37 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.146:6832/3511870643,v1:172.21.15.146:6833/3511870643] up:boot 2024-09-11T22:27:37.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:37 smithi177 ceph-mon[35530]: fsmap 2 up:standby 2024-09-11T22:27:37.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:37 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T22:27:37.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:37 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1691621187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:38 smithi040 ceph-mon[30787]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:38.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:38 smithi177 ceph-mon[35530]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:38.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:38 smithi146 ceph-mon[34996]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:39.675 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:27:39 smithi040 systemd[1]: Starting Ceph mds.j for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:39.960 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:27:39 smithi040 podman[67536]: 2024-09-11 22:27:39.578575646 +0000 UTC m=+0.027237156 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:39.961 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:27:39 smithi040 podman[67536]: 2024-09-11 22:27:39.692335984 +0000 UTC m=+0.140997493 container create f94cfae72b8971a76f64e2b210de10888d776f887d6f0162ba1cb05aa4276408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:27:39.961 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:27:39 smithi040 podman[67536]: 2024-09-11 22:27:39.953784818 +0000 UTC m=+0.402446327 container init f94cfae72b8971a76f64e2b210de10888d776f887d6f0162ba1cb05aa4276408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T22:27:40.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:40.221 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:27:39 smithi040 podman[67536]: 2024-09-11 22:27:39.960270808 +0000 UTC m=+0.408932327 container start f94cfae72b8971a76f64e2b210de10888d776f887d6f0162ba1cb05aa4276408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-11T22:27:40.221 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:27:39 smithi040 ceph-mds[67554]: -- 172.21.15.40:0/3838329790 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5567141b3c20 con 0x556714191000 2024-09-11T22:27:40.221 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:27:40 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j[67550]: starting mds.j at 2024-09-11T22:27:40.222 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:27:40 smithi040 bash[67536]: f94cfae72b8971a76f64e2b210de10888d776f887d6f0162ba1cb05aa4276408 2024-09-11T22:27:40.222 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:27:40 smithi040 systemd[1]: Started Ceph mds.j for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:40 smithi040 ceph-mon[30787]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:40.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:40 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:40.526 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:40.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:40 smithi177 ceph-mon[35530]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:40.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:40.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:40.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:40.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:40.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:40.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:40 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:40.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:40 smithi146 ceph-mon[34996]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:40.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:40.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:40.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:40.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:40.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:40.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:40 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:41.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.100+0000 7f66fbe00640 1 -- 172.21.15.40:0/2717094818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc103e30 msgr2=0x7f66fc104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.100+0000 7f66fbe00640 1 --2- 172.21.15.40:0/2717094818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc103e30 0x7f66fc104210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009ca0 tx=0x7f66ec02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.100+0000 7f66fbe00640 1 -- 172.21.15.40:0/2717094818 shutdown_connections 2024-09-11T22:27:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.100+0000 7f66fbe00640 1 --2- 172.21.15.40:0/2717094818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66fc108f60 0x7f66fc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.100+0000 7f66fbe00640 1 --2- 172.21.15.40:0/2717094818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66fc1047e0 0x7f66fc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.100+0000 7f66fbe00640 1 --2- 172.21.15.40:0/2717094818 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc103e30 0x7f66fc104210 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.100+0000 7f66fbe00640 1 -- 172.21.15.40:0/2717094818 >> 172.21.15.40:0/2717094818 conn(0x7f66fc0ff8d0 msgr2=0x7f66fc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.100+0000 7f66fbe00640 1 -- 172.21.15.40:0/2717094818 shutdown_connections 2024-09-11T22:27:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.100+0000 7f66fbe00640 1 -- 172.21.15.40:0/2717094818 wait complete. 2024-09-11T22:27:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.101+0000 7f66fbe00640 1 Processor -- start 2024-09-11T22:27:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.101+0000 7f66fbe00640 1 -- start start 2024-09-11T22:27:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66fbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66fc103e30 0x7f66fc19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66fc1047e0 0x7f66fc19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66fbe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc108f60 0x7f66fc19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66fbe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc114010 con 0x7f66fc108f60 2024-09-11T22:27:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66fbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc113e90 con 0x7f66fc103e30 2024-09-11T22:27:41.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66fbe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc114190 con 0x7f66fc1047e0 2024-09-11T22:27:41.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66f2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66fc1047e0 0x7f66fc19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:41.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66f2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66fc1047e0 0x7f66fc19a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:41042/0 (socket says 172.21.15.40:41042) 2024-09-11T22:27:41.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66f2000640 1 -- 172.21.15.40:0/4254749575 learned_addr learned my addr 172.21.15.40:0/4254749575 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:41.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66fb400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc108f60 0x7f66fc19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:41.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66faa00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66fc103e30 0x7f66fc19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:41.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66f2000640 1 -- 172.21.15.40:0/4254749575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66fc103e30 msgr2=0x7f66fc19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66f2000640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66fc103e30 0x7f66fc19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66f2000640 1 -- 172.21.15.40:0/4254749575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc108f60 msgr2=0x7f66fc19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66f2000640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc108f60 0x7f66fc19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.102+0000 7f66f2000640 1 -- 172.21.15.40:0/4254749575 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc19f400 con 0x7f66fc1047e0 2024-09-11T22:27:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.103+0000 7f66f2000640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66fc1047e0 0x7f66fc19a990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66e400e9f0 tx=0x7f66e400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.103+0000 7f66f3e00640 1 -- 172.21.15.40:0/4254749575 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e400cd80 con 0x7f66fc1047e0 2024-09-11T22:27:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.103+0000 7f66f3e00640 1 -- 172.21.15.40:0/4254749575 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66e4005500 con 0x7f66fc1047e0 2024-09-11T22:27:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.103+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc19f6f0 con 0x7f66fc1047e0 2024-09-11T22:27:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.103+0000 7f66f3e00640 1 -- 172.21.15.40:0/4254749575 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4010690 con 0x7f66fc1047e0 2024-09-11T22:27:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.103+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66fc1a6fd0 con 0x7f66fc1047e0 2024-09-11T22:27:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.104+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66fc104210 con 0x7f66fc1047e0 2024-09-11T22:27:41.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.107+0000 7f66f3e00640 1 -- 172.21.15.40:0/4254749575 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f66e40046c0 con 0x7f66fc1047e0 2024-09-11T22:27:41.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.108+0000 7f66f3e00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66e00a2b80 0x7f66e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:41.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.108+0000 7f66f3e00640 1 -- 172.21.15.40:0/4254749575 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f66e40cefe0 con 0x7f66fc1047e0 2024-09-11T22:27:41.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.109+0000 7f66faa00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66e00a2b80 0x7f66e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:41.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.109+0000 7f66faa00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66e00a2b80 0x7f66e00a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f66ec006010 tx=0x7f66ec009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:41.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.112+0000 7f66f3e00640 1 -- 172.21.15.40:0/4254749575 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66e409c380 con 0x7f66fc1047e0 2024-09-11T22:27:41.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.336+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66fc10bbb0 con 0x7f66fc1047e0 2024-09-11T22:27:41.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:41 smithi040 ceph-mon[30787]: Deploying daemon mds.d on smithi040 2024-09-11T22:27:41.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:41 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.40:6834/756098246,v1:172.21.15.40:6835/756098246] up:boot 2024-09-11T22:27:41.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:41 smithi040 ceph-mon[30787]: fsmap 3 up:standby 2024-09-11T22:27:41.339 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:41 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:27:41.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.337+0000 7f66f3e00640 1 -- 172.21.15.40:0/4254749575 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f66e409bc80 con 0x7f66fc1047e0 2024-09-11T22:27:41.340 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:41.340 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":4,"btime":"2024-09-11T22:27:40:206170+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T22:27:41.340 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 4 2024-09-11T22:27:41.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66e00a2b80 msgr2=0x7f66e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:41.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66e00a2b80 0x7f66e00a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f66ec006010 tx=0x7f66ec009820 comp rx=0 tx=0).stop 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66fc1047e0 msgr2=0x7f66fc19a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66fc1047e0 0x7f66fc19a990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66e400e9f0 tx=0x7f66e400edf0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 shutdown_connections 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66e00a2b80 0x7f66e00a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66fc108f60 0x7f66fc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66fc1047e0 0x7f66fc19a990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 --2- 172.21.15.40:0/4254749575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66fc103e30 0x7f66fc19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.339+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 >> 172.21.15.40:0/4254749575 conn(0x7f66fc0ff8d0 msgr2=0x7f66fc100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.340+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 shutdown_connections 2024-09-11T22:27:41.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:41.340+0000 7f66fbe00640 1 -- 172.21.15.40:0/4254749575 wait complete. 2024-09-11T22:27:41.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:41 smithi177 ceph-mon[35530]: Deploying daemon mds.d on smithi040 2024-09-11T22:27:41.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:41 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.40:6834/756098246,v1:172.21.15.40:6835/756098246] up:boot 2024-09-11T22:27:41.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:41 smithi177 ceph-mon[35530]: fsmap 3 up:standby 2024-09-11T22:27:41.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:41 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:27:41.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:41 smithi146 ceph-mon[34996]: Deploying daemon mds.d on smithi040 2024-09-11T22:27:41.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:41 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.40:6834/756098246,v1:172.21.15.40:6835/756098246] up:boot 2024-09-11T22:27:41.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:41 smithi146 ceph-mon[34996]: fsmap 3 up:standby 2024-09-11T22:27:41.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:41 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T22:27:42.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:42 smithi040 ceph-mon[30787]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:42.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:42 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/4254749575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:42.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:42 smithi177 ceph-mon[35530]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:42.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:42 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/4254749575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:42.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:42 smithi146 ceph-mon[34996]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:42.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:42 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/4254749575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:43.985 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:27:43 smithi040 systemd[1]: Starting Ceph mds.d for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:44.280 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:44 smithi040 ceph-mon[30787]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:44.280 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:27:43 smithi040 podman[67949]: 2024-09-11 22:27:43.895884162 +0000 UTC m=+0.027502769 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:44.280 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:27:44 smithi040 podman[67949]: 2024-09-11 22:27:44.026816192 +0000 UTC m=+0.158434803 container create 836bb32fe9f8d1d60a65a9202ec8ebad7bc734307d69b9f892b01096a3fd5fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T22:27:44.280 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:27:44 smithi040 podman[67949]: 2024-09-11 22:27:44.279935333 +0000 UTC m=+0.411553950 container init 836bb32fe9f8d1d60a65a9202ec8ebad7bc734307d69b9f892b01096a3fd5fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T22:27:44.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:44 smithi177 ceph-mon[35530]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:44.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:44 smithi146 ceph-mon[34996]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:44.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:44.734 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:27:44 smithi040 podman[67949]: 2024-09-11 22:27:44.28660171 +0000 UTC m=+0.418220323 container start 836bb32fe9f8d1d60a65a9202ec8ebad7bc734307d69b9f892b01096a3fd5fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-11T22:27:44.734 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:27:44 smithi040 ceph-mds[67968]: -- 172.21.15.40:0/848436686 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559dc62cd860 con 0x559dc62ab400 2024-09-11T22:27:44.734 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:27:44 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d[67964]: starting mds.d at 2024-09-11T22:27:44.735 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:27:44 smithi040 bash[67949]: 836bb32fe9f8d1d60a65a9202ec8ebad7bc734307d69b9f892b01096a3fd5fb8 2024-09-11T22:27:44.735 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:27:44 smithi040 systemd[1]: Started Ceph mds.d for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:45.070 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:45.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.664+0000 7f5f80a00640 1 -- 172.21.15.40:0/50225644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c103e30 msgr2=0x7f5f7c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.664+0000 7f5f80a00640 1 --2- 172.21.15.40:0/50225644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c103e30 0x7f5f7c104210 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009ca0 tx=0x7f5f6c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.664+0000 7f5f80a00640 1 -- 172.21.15.40:0/50225644 shutdown_connections 2024-09-11T22:27:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.664+0000 7f5f80a00640 1 --2- 172.21.15.40:0/50225644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f7c108f60 0x7f5f7c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.664+0000 7f5f80a00640 1 --2- 172.21.15.40:0/50225644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f7c1047e0 0x7f5f7c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.664+0000 7f5f80a00640 1 --2- 172.21.15.40:0/50225644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c103e30 0x7f5f7c104210 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.664+0000 7f5f80a00640 1 -- 172.21.15.40:0/50225644 >> 172.21.15.40:0/50225644 conn(0x7f5f7c0ff8d0 msgr2=0x7f5f7c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.664+0000 7f5f80a00640 1 -- 172.21.15.40:0/50225644 shutdown_connections 2024-09-11T22:27:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.664+0000 7f5f80a00640 1 -- 172.21.15.40:0/50225644 wait complete. 2024-09-11T22:27:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.665+0000 7f5f80a00640 1 Processor -- start 2024-09-11T22:27:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.665+0000 7f5f80a00640 1 -- start start 2024-09-11T22:27:45.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.665+0000 7f5f80a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f7c103e30 0x7f5f7c076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.665+0000 7f5f80a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f7c1047e0 0x7f5f7c076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f80a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c108f60 0x7f5f7c077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f80a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c114010 con 0x7f5f7c108f60 2024-09-11T22:27:45.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f80a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c113e90 con 0x7f5f7c103e30 2024-09-11T22:27:45.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f80a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c114190 con 0x7f5f7c1047e0 2024-09-11T22:27:45.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f7b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f7c103e30 0x7f5f7c076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f7b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f7c103e30 0x7f5f7c076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:43980/0 (socket says 172.21.15.40:43980) 2024-09-11T22:27:45.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f7b400640 1 -- 172.21.15.40:0/250450582 learned_addr learned my addr 172.21.15.40:0/250450582 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f72a00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f7c1047e0 0x7f5f7c076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f7be00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c108f60 0x7f5f7c077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f7b400640 1 -- 172.21.15.40:0/250450582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f7c1047e0 msgr2=0x7f5f7c076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f7b400640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f7c1047e0 0x7f5f7c076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f7b400640 1 -- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c108f60 msgr2=0x7f5f7c077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f7b400640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c108f60 0x7f5f7c077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.666+0000 7f5f7b400640 1 -- 172.21.15.40:0/250450582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c1aab10 con 0x7f5f7c103e30 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.667+0000 7f5f7b400640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f7c103e30 0x7f5f7c076700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0097b0 tx=0x7f5f6c003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.667+0000 7f5f78c00640 1 -- 172.21.15.40:0/250450582 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0316d0 con 0x7f5f7c103e30 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.667+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7c1aada0 con 0x7f5f7c103e30 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.667+0000 7f5f78c00640 1 -- 172.21.15.40:0/250450582 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f6c031870 con 0x7f5f7c103e30 2024-09-11T22:27:45.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.667+0000 7f5f78c00640 1 -- 172.21.15.40:0/250450582 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c02fb90 con 0x7f5f7c103e30 2024-09-11T22:27:45.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.667+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7c1ab250 con 0x7f5f7c103e30 2024-09-11T22:27:45.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.668+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7c105310 con 0x7f5f7c103e30 2024-09-11T22:27:45.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.670+0000 7f5f78c00640 1 -- 172.21.15.40:0/250450582 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5f6c004670 con 0x7f5f7c103e30 2024-09-11T22:27:45.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.671+0000 7f5f78c00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5f600a2b80 0x7f5f600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.671+0000 7f5f78c00640 1 -- 172.21.15.40:0/250450582 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f5f6c0f02a0 con 0x7f5f7c103e30 2024-09-11T22:27:45.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.671+0000 7f5f72a00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5f600a2b80 0x7f5f600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.672+0000 7f5f72a00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5f600a2b80 0x7f5f600a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c077ec0 tx=0x7f5f64005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:45.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.673+0000 7f5f78c00640 1 -- 172.21.15.40:0/250450582 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f6c0bd690 con 0x7f5f7c103e30 2024-09-11T22:27:45.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:45.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:45.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:45.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:45.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:45.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:45.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: Deploying daemon mds.e on smithi146 2024-09-11T22:27:45.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.40:6836/2129624525,v1:172.21.15.40:6837/2129624525] up:boot 2024-09-11T22:27:45.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: fsmap 4 up:standby 2024-09-11T22:27:45.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:27:45.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:45.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:45.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:45.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:45.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:45.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:45.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: Deploying daemon mds.e on smithi146 2024-09-11T22:27:45.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.40:6836/2129624525,v1:172.21.15.40:6837/2129624525] up:boot 2024-09-11T22:27:45.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: fsmap 4 up:standby 2024-09-11T22:27:45.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:45 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: Deploying daemon mds.e on smithi146 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.40:6836/2129624525,v1:172.21.15.40:6837/2129624525] up:boot 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: fsmap 4 up:standby 2024-09-11T22:27:45.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:45 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T22:27:45.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.896+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f7c104210 con 0x7f5f7c103e30 2024-09-11T22:27:45.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.897+0000 7f5f78c00640 1 -- 172.21.15.40:0/250450582 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f5f6c0bcf90 con 0x7f5f7c103e30 2024-09-11T22:27:45.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:45.899 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"btime":"2024-09-11T22:27:45:235179+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T22:27:45.899 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 5 2024-09-11T22:27:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5f600a2b80 msgr2=0x7f5f600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5f600a2b80 0x7f5f600a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c077ec0 tx=0x7f5f64005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f7c103e30 msgr2=0x7f5f7c076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f7c103e30 0x7f5f7c076700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0097b0 tx=0x7f5f6c003f90 comp rx=0 tx=0).stop 2024-09-11T22:27:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 shutdown_connections 2024-09-11T22:27:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5f600a2b80 0x7f5f600a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f7c108f60 0x7f5f7c077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f7c1047e0 0x7f5f7c076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 --2- 172.21.15.40:0/250450582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f7c103e30 0x7f5f7c076700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.899+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 >> 172.21.15.40:0/250450582 conn(0x7f5f7c0ff8d0 msgr2=0x7f5f7c100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.900+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 shutdown_connections 2024-09-11T22:27:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:45.900+0000 7f5f80a00640 1 -- 172.21.15.40:0/250450582 wait complete. 2024-09-11T22:27:46.647 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:46 smithi040 ceph-mon[30787]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:46.648 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:46 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/250450582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:46.735 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:46 smithi146 ceph-mon[34996]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:46.736 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:46 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/250450582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:46.736 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:27:46 smithi146 systemd[1]: Starting Ceph mds.e for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:46.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:46 smithi177 ceph-mon[35530]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:46.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:46 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/250450582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:46.997 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:27:46 smithi146 podman[64712]: 2024-09-11 22:27:46.637788072 +0000 UTC m=+0.015772772 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:46.998 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:27:46 smithi146 podman[64712]: 2024-09-11 22:27:46.753157296 +0000 UTC m=+0.131141986 container create e47700b248b4d3265aead56bdcaa3eb88105aa8aa68af3f9ffa6877548f4a187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:27:46.998 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:27:46 smithi146 podman[64712]: 2024-09-11 22:27:46.997415008 +0000 UTC m=+0.375399705 container init e47700b248b4d3265aead56bdcaa3eb88105aa8aa68af3f9ffa6877548f4a187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T22:27:47.334 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:27:47 smithi146 podman[64712]: 2024-09-11 22:27:47.00044455 +0000 UTC m=+0.378429260 container start e47700b248b4d3265aead56bdcaa3eb88105aa8aa68af3f9ffa6877548f4a187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T22:27:47.334 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:27:47 smithi146 ceph-mds[64731]: -- 172.21.15.146:0/2529081350 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b2b8be9860 con 0x55b2b8bc7400 2024-09-11T22:27:47.334 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:27:47 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e[64727]: starting mds.e at 2024-09-11T22:27:47.334 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:27:47 smithi146 bash[64712]: e47700b248b4d3265aead56bdcaa3eb88105aa8aa68af3f9ffa6877548f4a187 2024-09-11T22:27:47.334 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:27:47 smithi146 systemd[1]: Started Ceph mds.e for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:48.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:48.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:48.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:48.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:48.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:48.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:48.357 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:48.358 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: Deploying daemon mds.f on smithi177 2024-09-11T22:27:48.358 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.146:6834/2793379680,v1:172.21.15.146:6835/2793379680] up:boot 2024-09-11T22:27:48.358 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: fsmap 5 up:standby 2024-09-11T22:27:48.358 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:48 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:27:48.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: Deploying daemon mds.f on smithi177 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.146:6834/2793379680,v1:172.21.15.146:6835/2793379680] up:boot 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: fsmap 5 up:standby 2024-09-11T22:27:48.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:48 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:27:48.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:48.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:48.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:48.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:48.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:48.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:48.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:48.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: Deploying daemon mds.f on smithi177 2024-09-11T22:27:48.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.146:6834/2793379680,v1:172.21.15.146:6835/2793379680] up:boot 2024-09-11T22:27:48.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: fsmap 5 up:standby 2024-09-11T22:27:48.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:48 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:27:48.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:49.085 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:49.474 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:27:49 smithi177 systemd[1]: Starting Ceph mds.f for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:49.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.603+0000 7ff6bec00640 1 -- 172.21.15.40:0/2081731944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8077040 msgr2=0x7ff6b8112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.603+0000 7ff6bec00640 1 --2- 172.21.15.40:0/2081731944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8077040 0x7ff6b8112510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009900 tx=0x7ff6a002a410 comp rx=0 tx=0).stop 2024-09-11T22:27:49.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.603+0000 7ff6bec00640 1 -- 172.21.15.40:0/2081731944 shutdown_connections 2024-09-11T22:27:49.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.603+0000 7ff6bec00640 1 --2- 172.21.15.40:0/2081731944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b8112a50 0x7ff6b8114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.603+0000 7ff6bec00640 1 --2- 172.21.15.40:0/2081731944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8077040 0x7ff6b8112510 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.603+0000 7ff6bec00640 1 --2- 172.21.15.40:0/2081731944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8076720 0x7ff6b8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.603+0000 7ff6bec00640 1 -- 172.21.15.40:0/2081731944 >> 172.21.15.40:0/2081731944 conn(0x7ff6b80ffa50 msgr2=0x7ff6b8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:49.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.603+0000 7ff6bec00640 1 -- 172.21.15.40:0/2081731944 shutdown_connections 2024-09-11T22:27:49.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.603+0000 7ff6bec00640 1 -- 172.21.15.40:0/2081731944 wait complete. 2024-09-11T22:27:49.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.604+0000 7ff6bec00640 1 Processor -- start 2024-09-11T22:27:49.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.604+0000 7ff6bec00640 1 -- start start 2024-09-11T22:27:49.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.604+0000 7ff6bec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8076720 0x7ff6b81a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:49.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.604+0000 7ff6bec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8077040 0x7ff6b81a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:49.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.604+0000 7ff6bec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b8112a50 0x7ff6b819ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:49.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.604+0000 7ff6bec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8118630 con 0x7ff6b8076720 2024-09-11T22:27:49.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.604+0000 7ff6bec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b81184b0 con 0x7ff6b8112a50 2024-09-11T22:27:49.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.604+0000 7ff6bec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b81187b0 con 0x7ff6b8077040 2024-09-11T22:27:49.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8076720 0x7ff6b81a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:49.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8076720 0x7ff6b81a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36080/0 (socket says 172.21.15.40:36080) 2024-09-11T22:27:49.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b7e00640 1 -- 172.21.15.40:0/4253253754 learned_addr learned my addr 172.21.15.40:0/4253253754 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:49.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6af400640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8077040 0x7ff6b81a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:49.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6bcc00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b8112a50 0x7ff6b819ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:49.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b7e00640 1 -- 172.21.15.40:0/4253253754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8077040 msgr2=0x7ff6b81a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b7e00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8077040 0x7ff6b81a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b7e00640 1 -- 172.21.15.40:0/4253253754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b8112a50 msgr2=0x7ff6b819ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b7e00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b8112a50 0x7ff6b819ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b7e00640 1 -- 172.21.15.40:0/4253253754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b819f150 con 0x7ff6b8076720 2024-09-11T22:27:49.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6bcc00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b8112a50 0x7ff6b819ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:49.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6af400640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8077040 0x7ff6b81a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:49.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b7e00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8076720 0x7ff6b81a4860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800e9f0 tx=0x7ff6a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:49.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.605+0000 7ff6b5600640 1 -- 172.21.15.40:0/4253253754 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800cd80 con 0x7ff6b8076720 2024-09-11T22:27:49.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.606+0000 7ff6b5600640 1 -- 172.21.15.40:0/4253253754 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a8005500 con 0x7ff6b8076720 2024-09-11T22:27:49.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.606+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b819f440 con 0x7ff6b8076720 2024-09-11T22:27:49.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.606+0000 7ff6b5600640 1 -- 172.21.15.40:0/4253253754 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8010690 con 0x7ff6b8076720 2024-09-11T22:27:49.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.606+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b81ab730 con 0x7ff6b8076720 2024-09-11T22:27:49.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.607+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b8076b00 con 0x7ff6b8076720 2024-09-11T22:27:49.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.609+0000 7ff6b5600640 1 -- 172.21.15.40:0/4253253754 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff6a80046c0 con 0x7ff6b8076720 2024-09-11T22:27:49.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.610+0000 7ff6b5600640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff69c0a2c00 0x7ff69c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:49.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.610+0000 7ff6b5600640 1 -- 172.21.15.40:0/4253253754 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7ff6a80cf110 con 0x7ff6b8076720 2024-09-11T22:27:49.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.610+0000 7ff6af400640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff69c0a2c00 0x7ff69c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:49.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.611+0000 7ff6af400640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff69c0a2c00 0x7ff69c0a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0000c00 tx=0x7ff6a0005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:49.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.614+0000 7ff6b5600640 1 -- 172.21.15.40:0/4253253754 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6a809c470 con 0x7ff6b8076720 2024-09-11T22:27:49.759 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:27:49 smithi177 podman[64755]: 2024-09-11 22:27:49.376468323 +0000 UTC m=+0.015667068 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:49.759 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:27:49 smithi177 podman[64755]: 2024-09-11 22:27:49.490016722 +0000 UTC m=+0.129215509 container create 3b1966b007ed83dae580cb064d60d8eb0540126eb3cc20084c485aed625359d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T22:27:49.760 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:27:49 smithi177 podman[64755]: 2024-09-11 22:27:49.759522387 +0000 UTC m=+0.398721131 container init 3b1966b007ed83dae580cb064d60d8eb0540126eb3cc20084c485aed625359d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T22:27:49.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.837+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6b819ff50 con 0x7ff6b8076720 2024-09-11T22:27:49.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.838+0000 7ff6b5600640 1 -- 172.21.15.40:0/4253253754 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7ff6a809bd70 con 0x7ff6b8076720 2024-09-11T22:27:49.840 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:49.840 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"btime":"2024-09-11T22:27:47:488301+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-11T22:27:49.841 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2024-09-11T22:27:49.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff69c0a2c00 msgr2=0x7ff69c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff69c0a2c00 0x7ff69c0a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0000c00 tx=0x7ff6a0005a40 comp rx=0 tx=0).stop 2024-09-11T22:27:49.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8076720 msgr2=0x7ff6b81a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:49.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8076720 0x7ff6b81a4860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800e9f0 tx=0x7ff6a800edf0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 shutdown_connections 2024-09-11T22:27:49.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff69c0a2c00 0x7ff69c0a50c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b8112a50 0x7ff6b819ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b8077040 0x7ff6b81a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 --2- 172.21.15.40:0/4253253754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6b8076720 0x7ff6b81a4860 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:49.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 >> 172.21.15.40:0/4253253754 conn(0x7ff6b80ffa50 msgr2=0x7ff6b8101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:49.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 shutdown_connections 2024-09-11T22:27:49.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:49.841+0000 7ff6bec00640 1 -- 172.21.15.40:0/4253253754 wait complete. 2024-09-11T22:27:50.032 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:27:49 smithi177 podman[64755]: 2024-09-11 22:27:49.762455377 +0000 UTC m=+0.401654132 container start 3b1966b007ed83dae580cb064d60d8eb0540126eb3cc20084c485aed625359d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T22:27:50.032 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:27:49 smithi177 ceph-mds[64774]: -- 172.21.15.177:0/2470093901 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560669c53c20 con 0x560669c31000 2024-09-11T22:27:50.033 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:27:49 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f[64770]: starting mds.f at 2024-09-11T22:27:50.033 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:27:49 smithi177 bash[64755]: 3b1966b007ed83dae580cb064d60d8eb0540126eb3cc20084c485aed625359d3 2024-09-11T22:27:50.033 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:27:49 smithi177 systemd[1]: Started Ceph mds.f for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:50.483 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:50 smithi177 ceph-mon[35530]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:50.484 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:50 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/4253253754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:50.484 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:50.484 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:50.484 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:50.484 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:50.484 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:50.484 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:50 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:50.484 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:50 smithi177 ceph-mon[35530]: Deploying daemon mds.c on smithi177 2024-09-11T22:27:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:50 smithi040 ceph-mon[30787]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:50 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/4253253754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:50 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:50 smithi040 ceph-mon[30787]: Deploying daemon mds.c on smithi177 2024-09-11T22:27:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:50 smithi146 ceph-mon[34996]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:50 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/4253253754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:50.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:50 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:50.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:50 smithi146 ceph-mon[34996]: Deploying daemon mds.c on smithi177 2024-09-11T22:27:51.477 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:51 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.177:6834/2874658115,v1:172.21.15.177:6835/2874658115] up:boot 2024-09-11T22:27:51.478 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:51 smithi177 ceph-mon[35530]: fsmap 6 up:standby 2024-09-11T22:27:51.478 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:51 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:27:51.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:51 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.177:6834/2874658115,v1:172.21.15.177:6835/2874658115] up:boot 2024-09-11T22:27:51.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:51 smithi040 ceph-mon[30787]: fsmap 6 up:standby 2024-09-11T22:27:51.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:51 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:27:51.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:51 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.177:6834/2874658115,v1:172.21.15.177:6835/2874658115] up:boot 2024-09-11T22:27:51.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:51 smithi146 ceph-mon[34996]: fsmap 6 up:standby 2024-09-11T22:27:51.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:51 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:27:52.032 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:27:51 smithi177 systemd[1]: Starting Ceph mds.c for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:52.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:52 smithi040 ceph-mon[30787]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:52.525 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:52 smithi177 ceph-mon[35530]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:52.525 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:27:52 smithi177 podman[65055]: 2024-09-11 22:27:52.087535582 +0000 UTC m=+0.015638722 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:52.525 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:27:52 smithi177 podman[65055]: 2024-09-11 22:27:52.233596548 +0000 UTC m=+0.161699677 container create 3a8cf4e394555f7be117105533b0d4d763ac7a541810bf803cbd8711fc82f3a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T22:27:52.525 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:27:52 smithi177 podman[65055]: 2024-09-11 22:27:52.525349034 +0000 UTC m=+0.453452167 container init 3a8cf4e394555f7be117105533b0d4d763ac7a541810bf803cbd8711fc82f3a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T22:27:52.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:52 smithi146 ceph-mon[34996]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:52.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:52.782 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:27:52 smithi177 podman[65055]: 2024-09-11 22:27:52.52818469 +0000 UTC m=+0.456287825 container start 3a8cf4e394555f7be117105533b0d4d763ac7a541810bf803cbd8711fc82f3a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-11T22:27:52.782 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:27:52 smithi177 ceph-mds[65074]: -- 172.21.15.177:0/3714016971 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55557705f860 con 0x55557703c800 2024-09-11T22:27:52.782 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:27:52 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c[65070]: starting mds.c at 2024-09-11T22:27:52.782 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:27:52 smithi177 bash[65055]: 3a8cf4e394555f7be117105533b0d4d763ac7a541810bf803cbd8711fc82f3a9 2024-09-11T22:27:52.782 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:27:52 smithi177 systemd[1]: Started Ceph mds.c for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:53.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.539+0000 7f9b65a00640 1 -- 172.21.15.40:0/597132252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b601019c0 msgr2=0x7f9b60101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.539+0000 7f9b65a00640 1 --2- 172.21.15.40:0/597132252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b601019c0 0x7f9b60101e20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c009930 tx=0x7f9b4c02a440 comp rx=0 tx=0).stop 2024-09-11T22:27:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.539+0000 7f9b65a00640 1 -- 172.21.15.40:0/597132252 shutdown_connections 2024-09-11T22:27:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.539+0000 7f9b65a00640 1 --2- 172.21.15.40:0/597132252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b60102360 0x7f9b6010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.539+0000 7f9b65a00640 1 --2- 172.21.15.40:0/597132252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b601019c0 0x7f9b60101e20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.539+0000 7f9b65a00640 1 --2- 172.21.15.40:0/597132252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b601079c0 0x7f9b60107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.539+0000 7f9b65a00640 1 -- 172.21.15.40:0/597132252 >> 172.21.15.40:0/597132252 conn(0x7f9b600fd740 msgr2=0x7f9b600ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.539+0000 7f9b65a00640 1 -- 172.21.15.40:0/597132252 shutdown_connections 2024-09-11T22:27:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.539+0000 7f9b65a00640 1 -- 172.21.15.40:0/597132252 wait complete. 2024-09-11T22:27:53.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.540+0000 7f9b65a00640 1 Processor -- start 2024-09-11T22:27:53.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.540+0000 7f9b65a00640 1 -- start start 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b65a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b601019c0 0x7f9b600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b65a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b60102360 0x7f9b60074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b65a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b601079c0 0x7f9b60074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b65a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9b60111dd0 con 0x7f9b601079c0 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b65a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b60111c50 con 0x7f9b601019c0 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b65a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b60111f50 con 0x7f9b60102360 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b601019c0 0x7f9b600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b5fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b601019c0 0x7f9b600744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:46042/0 (socket says 172.21.15.40:46042) 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b5fe00640 1 -- 172.21.15.40:0/3303638588 learned_addr learned my addr 172.21.15.40:0/3303638588 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:53.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b5f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b60102360 0x7f9b60074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.541+0000 7f9b65000640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b601079c0 0x7f9b60074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b5f400640 1 -- 172.21.15.40:0/3303638588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b601019c0 msgr2=0x7f9b600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b5f400640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b601019c0 0x7f9b600744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b5f400640 1 -- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b601079c0 msgr2=0x7f9b60074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b5f400640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b601079c0 0x7f9b60074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b5f400640 1 -- 172.21.15.40:0/3303638588 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b601a6790 con 0x7f9b60102360 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b5f400640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b60102360 0x7f9b60074a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c02a960 tx=0x7f9b4c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b5cc00640 1 -- 172.21.15.40:0/3303638588 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c03f070 con 0x7f9b60102360 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b5cc00640 1 -- 172.21.15.40:0/3303638588 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b4c031c90 con 0x7f9b60102360 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b60198030 con 0x7f9b60102360 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.542+0000 7f9b5cc00640 1 -- 172.21.15.40:0/3303638588 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c035030 con 0x7f9b60102360 2024-09-11T22:27:53.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.543+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b60198510 con 0x7f9b60102360 2024-09-11T22:27:53.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.544+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b60101e20 con 0x7f9b60102360 2024-09-11T22:27:53.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.546+0000 7f9b5cc00640 1 -- 172.21.15.40:0/3303638588 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9b4c042070 con 0x7f9b60102360 2024-09-11T22:27:53.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.547+0000 7f9b5cc00640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b440a2b80 0x7f9b440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.547+0000 7f9b5cc00640 1 -- 172.21.15.40:0/3303638588 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f9b4c0ef760 con 0x7f9b60102360 2024-09-11T22:27:53.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.548+0000 7f9b5fe00640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b440a2b80 0x7f9b440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:53.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.548+0000 7f9b5fe00640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b440a2b80 0x7f9b440a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009c10 tx=0x7f9b50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:53.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.549+0000 7f9b5cc00640 1 -- 172.21.15.40:0/3303638588 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b4c0bc470 con 0x7f9b60102360 2024-09-11T22:27:53.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.775+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b60109f50 con 0x7f9b60102360 2024-09-11T22:27:53.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.776+0000 7f9b5cc00640 1 -- 172.21.15.40:0/3303638588 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7f9b4c0c0770 con 0x7f9b60102360 2024-09-11T22:27:53.777 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:53.778 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-11T22:27:53:170276+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T22:27:53.778 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-11T22:27:53.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b440a2b80 msgr2=0x7f9b440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b440a2b80 0x7f9b440a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009c10 tx=0x7f9b50005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:53.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b60102360 msgr2=0x7f9b60074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b60102360 0x7f9b60074a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c02a960 tx=0x7f9b4c003b90 comp rx=0 tx=0).stop 2024-09-11T22:27:53.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 shutdown_connections 2024-09-11T22:27:53.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b440a2b80 0x7f9b440a5040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b601079c0 0x7f9b60074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b60102360 0x7f9b60074a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 --2- 172.21.15.40:0/3303638588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b601019c0 0x7f9b600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 >> 172.21.15.40:0/3303638588 conn(0x7f9b600fd740 msgr2=0x7f9b600fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:53.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 shutdown_connections 2024-09-11T22:27:53.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:53.778+0000 7f9b65a00640 1 -- 172.21.15.40:0/3303638588 wait complete. 2024-09-11T22:27:53.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:53.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:53.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:53.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: Deploying daemon mds.h on smithi146 2024-09-11T22:27:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] up:boot 2024-09-11T22:27:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: fsmap 7 up:standby 2024-09-11T22:27:53.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:53 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:27:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:54.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:54.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:54.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:54.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:54.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: Deploying daemon mds.h on smithi146 2024-09-11T22:27:54.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] up:boot 2024-09-11T22:27:54.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: fsmap 7 up:standby 2024-09-11T22:27:54.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:53 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:27:54.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:54.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:54.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:54.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:54.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:54.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:54.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: Deploying daemon mds.h on smithi146 2024-09-11T22:27:54.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] up:boot 2024-09-11T22:27:54.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: fsmap 7 up:standby 2024-09-11T22:27:54.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:53 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:27:54.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:54 smithi040 ceph-mon[30787]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:54.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:54 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3303638588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:54.997 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:54 smithi146 ceph-mon[34996]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:54.997 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:54 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3303638588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:54.997 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:27:54 smithi146 systemd[1]: Starting Ceph mds.h for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:54 smithi177 ceph-mon[35530]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:54 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3303638588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:55.262 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:27:54 smithi146 podman[65024]: 2024-09-11 22:27:54.899442216 +0000 UTC m=+0.016140993 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:55.262 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:27:55 smithi146 podman[65024]: 2024-09-11 22:27:55.017653447 +0000 UTC m=+0.134352277 container create d022d5eb845ad0859bc02a522619969a48f5e2dd10db642dc8d33a181dc6e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:27:55.262 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:27:55 smithi146 podman[65024]: 2024-09-11 22:27:55.262227339 +0000 UTC m=+0.378926109 container init d022d5eb845ad0859bc02a522619969a48f5e2dd10db642dc8d33a181dc6e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-11T22:27:55.583 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:27:55 smithi146 podman[65024]: 2024-09-11 22:27:55.265047756 +0000 UTC m=+0.381746524 container start d022d5eb845ad0859bc02a522619969a48f5e2dd10db642dc8d33a181dc6e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:27:55.584 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:27:55 smithi146 ceph-mds[65043]: -- 172.21.15.146:0/4290987718 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56228b277860 con 0x56228b255400 2024-09-11T22:27:55.584 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:27:55 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h[65039]: starting mds.h at 2024-09-11T22:27:55.584 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:27:55 smithi146 bash[65024]: d022d5eb845ad0859bc02a522619969a48f5e2dd10db642dc8d33a181dc6e34f 2024-09-11T22:27:55.584 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:27:55 smithi146 systemd[1]: Started Ceph mds.h for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: Deploying daemon mds.i on smithi177 2024-09-11T22:27:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.146:6836/321001142,v1:172.21.15.146:6837/321001142] up:boot 2024-09-11T22:27:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: fsmap 8 up:standby 2024-09-11T22:27:56.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:56 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:27:56.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:27:56.702 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: Deploying daemon mds.i on smithi177 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.146:6836/321001142,v1:172.21.15.146:6837/321001142] up:boot 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: fsmap 8 up:standby 2024-09-11T22:27:56.703 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:56 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: Deploying daemon mds.i on smithi177 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.146:6836/321001142,v1:172.21.15.146:6837/321001142] up:boot 2024-09-11T22:27:56.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: fsmap 8 up:standby 2024-09-11T22:27:56.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:56 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:27:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.639+0000 7f0c0fe00640 1 -- 172.21.15.40:0/1340323489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c101047e0 msgr2=0x7f0c10108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.639+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/1340323489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c101047e0 0x7f0c10108830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009900 tx=0x7f0bf802a410 comp rx=0 tx=0).stop 2024-09-11T22:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.639+0000 7f0c0fe00640 1 -- 172.21.15.40:0/1340323489 shutdown_connections 2024-09-11T22:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.639+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/1340323489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c10108f60 0x7f0c10110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.639+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/1340323489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c101047e0 0x7f0c10108830 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.639+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/1340323489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10103e30 0x7f0c10104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.639+0000 7f0c0fe00640 1 -- 172.21.15.40:0/1340323489 >> 172.21.15.40:0/1340323489 conn(0x7f0c100ff8d0 msgr2=0x7f0c10101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.639+0000 7f0c0fe00640 1 -- 172.21.15.40:0/1340323489 shutdown_connections 2024-09-11T22:27:57.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.639+0000 7f0c0fe00640 1 -- 172.21.15.40:0/1340323489 wait complete. 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.640+0000 7f0c0fe00640 1 Processor -- start 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.640+0000 7f0c0fe00640 1 -- start start 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.640+0000 7f0c0fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c10103e30 0x7f0c1019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.640+0000 7f0c0fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c101047e0 0x7f0c1019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.640+0000 7f0c0fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10108f60 0x7f0c1019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.640+0000 7f0c0fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10114010 con 0x7f0c10103e30 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.640+0000 7f0c0fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10113e90 con 0x7f0c10108f60 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.640+0000 7f0c0fe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10114190 con 0x7f0c101047e0 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c0ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c10103e30 0x7f0c1019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c0ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c10103e30 0x7f0c1019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60178/0 (socket says 172.21.15.40:60178) 2024-09-11T22:27:57.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c0ea00640 1 -- 172.21.15.40:0/419538531 learned_addr learned my addr 172.21.15.40:0/419538531 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:27:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c06000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c101047e0 0x7f0c1019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c0f400640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10108f60 0x7f0c1019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c06000640 1 -- 172.21.15.40:0/419538531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10108f60 msgr2=0x7f0c1019ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c06000640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10108f60 0x7f0c1019ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c06000640 1 -- 172.21.15.40:0/419538531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c10103e30 msgr2=0x7f0c1019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c06000640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c10103e30 0x7f0c1019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c06000640 1 -- 172.21.15.40:0/419538531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1019f420 con 0x7f0c101047e0 2024-09-11T22:27:57.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.641+0000 7f0c06000640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c101047e0 0x7f0c1019a9b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0bf802a930 tx=0x7f0bf8003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.642+0000 7f0c07e00640 1 -- 172.21.15.40:0/419538531 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf803f070 con 0x7f0c101047e0 2024-09-11T22:27:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.642+0000 7f0c07e00640 1 -- 172.21.15.40:0/419538531 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bf8031c90 con 0x7f0c101047e0 2024-09-11T22:27:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.642+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1019f6b0 con 0x7f0c101047e0 2024-09-11T22:27:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.642+0000 7f0c07e00640 1 -- 172.21.15.40:0/419538531 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8035030 con 0x7f0c101047e0 2024-09-11T22:27:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.642+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c101a6ff0 con 0x7f0c101047e0 2024-09-11T22:27:57.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.643+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c10105310 con 0x7f0c101047e0 2024-09-11T22:27:57.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.645+0000 7f0c07e00640 1 -- 172.21.15.40:0/419538531 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0bf8042070 con 0x7f0c101047e0 2024-09-11T22:27:57.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.646+0000 7f0c07e00640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0bf40a2c00 0x7f0bf40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:57.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.646+0000 7f0c07e00640 1 -- 172.21.15.40:0/419538531 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f0bf80eef10 con 0x7f0c101047e0 2024-09-11T22:27:57.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.647+0000 7f0c0ea00640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0bf40a2c00 0x7f0bf40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:57.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.647+0000 7f0c0ea00640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0bf40a2c00 0x7f0bf40a50c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0c00009c90 tx=0x7f0c00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:57.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.651+0000 7f0c07e00640 1 -- 172.21.15.40:0/419538531 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0bf80bc270 con 0x7f0c101047e0 2024-09-11T22:27:57.697 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:27:57 smithi177 systemd[1]: Starting Ceph mds.i for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:27:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.871+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c1019b7d0 con 0x7f0c101047e0 2024-09-11T22:27:57.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.872+0000 7f0c07e00640 1 -- 172.21.15.40:0/419538531 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7f0bf80bbb70 con 0x7f0c101047e0 2024-09-11T22:27:57.873 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:27:57.874 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"btime":"2024-09-11T22:27:55:717397+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T22:27:57.874 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-09-11T22:27:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0bf40a2c00 msgr2=0x7f0bf40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0bf40a2c00 0x7f0bf40a50c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0c00009c90 tx=0x7f0c00005f90 comp rx=0 tx=0).stop 2024-09-11T22:27:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c101047e0 msgr2=0x7f0c1019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c101047e0 0x7f0c1019a9b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0bf802a930 tx=0x7f0bf8003b90 comp rx=0 tx=0).stop 2024-09-11T22:27:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 shutdown_connections 2024-09-11T22:27:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0bf40a2c00 0x7f0bf40a50c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10108f60 0x7f0c1019ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c101047e0 0x7f0c1019a9b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 --2- 172.21.15.40:0/419538531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c10103e30 0x7f0c1019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:57.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.874+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 >> 172.21.15.40:0/419538531 conn(0x7f0c100ff8d0 msgr2=0x7f0c10100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:57.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.875+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 shutdown_connections 2024-09-11T22:27:57.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:27:57.875+0000 7f0c0fe00640 1 -- 172.21.15.40:0/419538531 wait complete. 2024-09-11T22:27:57.982 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:27:57 smithi177 podman[65357]: 2024-09-11 22:27:57.5997222 +0000 UTC m=+0.016044138 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:27:57.982 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:27:57 smithi177 podman[65357]: 2024-09-11 22:27:57.718012442 +0000 UTC m=+0.134334361 container create 30220e6a438cdbbb151b833ff9e64c028aaafd14f69f75fb2cc605e545320e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-11T22:27:57.983 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:27:57 smithi177 podman[65357]: 2024-09-11 22:27:57.98252065 +0000 UTC m=+0.398842583 container init 30220e6a438cdbbb151b833ff9e64c028aaafd14f69f75fb2cc605e545320e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T22:27:58.282 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:27:57 smithi177 podman[65357]: 2024-09-11 22:27:57.985560679 +0000 UTC m=+0.401882603 container start 30220e6a438cdbbb151b833ff9e64c028aaafd14f69f75fb2cc605e545320e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-11T22:27:58.282 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-mds[65376]: -- 172.21.15.177:0/540850908 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565162709860 con 0x5651626e7400 2024-09-11T22:27:58.282 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i[65372]: starting mds.i at 2024-09-11T22:27:58.282 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:27:58 smithi177 bash[65357]: 30220e6a438cdbbb151b833ff9e64c028aaafd14f69f75fb2cc605e545320e56 2024-09-11T22:27:58.282 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:27:58 smithi177 systemd[1]: Started Ceph mds.i for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:27:58.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:58 smithi040 ceph-mon[30787]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:58.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:58 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/419538531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:58.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:58.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:58.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:58.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:58.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:58.626 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:58.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-mon[35530]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:58.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/419538531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:58.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:58.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:58.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:58.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:58 smithi146 ceph-mon[34996]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:27:58.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:58 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/419538531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:27:58.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:58.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:58.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:27:58.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:27:58.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:27:58.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:27:59.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:59 smithi040 ceph-mon[30787]: Deploying daemon mds.g on smithi040 2024-09-11T22:27:59.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:59 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] up:boot 2024-09-11T22:27:59.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:59 smithi040 ceph-mon[30787]: fsmap 9 up:standby 2024-09-11T22:27:59.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:27:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:27:59.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:59 smithi177 ceph-mon[35530]: Deploying daemon mds.g on smithi040 2024-09-11T22:27:59.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:59 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] up:boot 2024-09-11T22:27:59.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:59 smithi177 ceph-mon[35530]: fsmap 9 up:standby 2024-09-11T22:27:59.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:27:59 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:27:59.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:59 smithi146 ceph-mon[34996]: Deploying daemon mds.g on smithi040 2024-09-11T22:27:59.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:59 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] up:boot 2024-09-11T22:27:59.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:59 smithi146 ceph-mon[34996]: fsmap 9 up:standby 2024-09-11T22:27:59.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:27:59 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:28:00.667 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:00.719 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:00 smithi040 ceph-mon[30787]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:00.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:00 smithi177 ceph-mon[35530]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:00.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:00 smithi146 ceph-mon[34996]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:01.381 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:28:01 smithi040 podman[68732]: 2024-09-11 22:28:01.094815776 +0000 UTC m=+0.161538818 container create 939eed7898349f6390fc654680a82912e056d639ab9ca33bb760db5bba31b32c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T22:28:01.382 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:28:01 smithi040 podman[68732]: 2024-09-11 22:28:01.381394482 +0000 UTC m=+0.448117555 container init 939eed7898349f6390fc654680a82912e056d639ab9ca33bb760db5bba31b32c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:28:01.566 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:01.710 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:28:01 smithi040 podman[68732]: 2024-09-11 22:28:01.388145774 +0000 UTC m=+0.454868817 container start 939eed7898349f6390fc654680a82912e056d639ab9ca33bb760db5bba31b32c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-11T22:28:01.710 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:28:01 smithi040 ceph-mds[68775]: -- 172.21.15.40:0/2661725327 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e1c81b860 con 0x561e1c7f9400 2024-09-11T22:28:01.710 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:28:01 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g[68771]: starting mds.g at 2024-09-11T22:28:01.710 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:28:01 smithi040 bash[68732]: 939eed7898349f6390fc654680a82912e056d639ab9ca33bb760db5bba31b32c 2024-09-11T22:28:01.710 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:28:01 smithi040 systemd[1]: Started Ceph mds.g for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:28:02.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.129+0000 7f700d800640 1 -- 172.21.15.40:0/2492529297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7008076720 msgr2=0x7f7008076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.129+0000 7f700d800640 1 --2- 172.21.15.40:0/2492529297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7008076720 0x7f7008076b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009860 tx=0x7f6ff802a340 comp rx=0 tx=0).stop 2024-09-11T22:28:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.129+0000 7f700d800640 1 -- 172.21.15.40:0/2492529297 shutdown_connections 2024-09-11T22:28:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.129+0000 7f700d800640 1 --2- 172.21.15.40:0/2492529297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7008112a50 0x7f7008114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.129+0000 7f700d800640 1 --2- 172.21.15.40:0/2492529297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008077040 0x7f7008112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.129+0000 7f700d800640 1 --2- 172.21.15.40:0/2492529297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7008076720 0x7f7008076b00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.129+0000 7f700d800640 1 -- 172.21.15.40:0/2492529297 >> 172.21.15.40:0/2492529297 conn(0x7f70080ffa50 msgr2=0x7f7008101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.129+0000 7f700d800640 1 -- 172.21.15.40:0/2492529297 shutdown_connections 2024-09-11T22:28:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.129+0000 7f700d800640 1 -- 172.21.15.40:0/2492529297 wait complete. 2024-09-11T22:28:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.130+0000 7f700d800640 1 Processor -- start 2024-09-11T22:28:02.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.130+0000 7f700d800640 1 -- start start 2024-09-11T22:28:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f700d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008076720 0x7f70081a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f700d800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7008077040 0x7f70081a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f700d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7008112a50 0x7f700819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f700d800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f70081185e0 con 0x7f7008076720 2024-09-11T22:28:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f700d800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7008118460 con 0x7f7008112a50 2024-09-11T22:28:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f700d800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7008118760 con 0x7f7008077040 2024-09-11T22:28:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f7006a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008076720 0x7f70081a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f7006a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008076720 0x7f70081a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59768/0 (socket says 172.21.15.40:59768) 2024-09-11T22:28:02.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f7006a00640 1 -- 172.21.15.40:0/587183671 learned_addr learned my addr 172.21.15.40:0/587183671 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f6fffe00640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7008077040 0x7f70081a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f7007400640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7008112a50 0x7f700819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f7006a00640 1 -- 172.21.15.40:0/587183671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7008077040 msgr2=0x7f70081a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f7006a00640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7008077040 0x7f70081a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f7006a00640 1 -- 172.21.15.40:0/587183671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7008112a50 msgr2=0x7f700819e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f7006a00640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7008112a50 0x7f700819e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.131+0000 7f7006a00640 1 -- 172.21.15.40:0/587183671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700819f040 con 0x7f7008076720 2024-09-11T22:28:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.132+0000 7f7006a00640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008076720 0x7f70081a4750 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8035040 tx=0x7f6ff8033b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:02.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.132+0000 7f6fff400640 1 -- 172.21.15.40:0/587183671 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8037040 con 0x7f7008076720 2024-09-11T22:28:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.132+0000 7f6fff400640 1 -- 172.21.15.40:0/587183671 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff8040070 con 0x7f7008076720 2024-09-11T22:28:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.132+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700819f2d0 con 0x7f7008076720 2024-09-11T22:28:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.132+0000 7f6fff400640 1 -- 172.21.15.40:0/587183671 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80039b0 con 0x7f7008076720 2024-09-11T22:28:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.132+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70081ab620 con 0x7f7008076720 2024-09-11T22:28:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.133+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7008076b00 con 0x7f7008076720 2024-09-11T22:28:02.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.135+0000 7f6fff400640 1 -- 172.21.15.40:0/587183671 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6ff80305e0 con 0x7f7008076720 2024-09-11T22:28:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.136+0000 7f6fff400640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6fec0a2b80 0x7f6fec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.137+0000 7f6fff400640 1 -- 172.21.15.40:0/587183671 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f6ff80eec10 con 0x7f7008076720 2024-09-11T22:28:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.137+0000 7f6fffe00640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6fec0a2b80 0x7f6fec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.137+0000 7f6fffe00640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6fec0a2b80 0x7f6fec0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7008079290 tx=0x7f6ff0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:02.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.141+0000 7f6fff400640 1 -- 172.21.15.40:0/587183671 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ff80bbf70 con 0x7f7008076720 2024-09-11T22:28:02.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.379+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70081ab7f0 con 0x7f7008076720 2024-09-11T22:28:02.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.380+0000 7f6fff400640 1 -- 172.21.15.40:0/587183671 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7f6ff80bb870 con 0x7f7008076720 2024-09-11T22:28:02.381 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:02.381 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":11,"btime":"2024-09-11T22:28:01:485102+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T22:28:02.381 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 11 2024-09-11T22:28:02.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6fec0a2b80 msgr2=0x7f6fec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6fec0a2b80 0x7f6fec0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7008079290 tx=0x7f6ff0009260 comp rx=0 tx=0).stop 2024-09-11T22:28:02.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008076720 msgr2=0x7f70081a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008076720 0x7f70081a4750 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8035040 tx=0x7f6ff8033b60 comp rx=0 tx=0).stop 2024-09-11T22:28:02.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 shutdown_connections 2024-09-11T22:28:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6fec0a2b80 0x7f6fec0a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7008112a50 0x7f700819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7008077040 0x7f70081a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 --2- 172.21.15.40:0/587183671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7008076720 0x7f70081a4750 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 >> 172.21.15.40:0/587183671 conn(0x7f70080ffa50 msgr2=0x7f7008101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 shutdown_connections 2024-09-11T22:28:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:02.383+0000 7f700d800640 1 -- 172.21.15.40:0/587183671 wait complete. 2024-09-11T22:28:02.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.40:6838/3846797192,v1:172.21.15.40:6839/3846797192] up:boot 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: fsmap 10 up:standby 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: Deploying daemon mds.a on smithi040 2024-09-11T22:28:02.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:02 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/587183671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:02.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:02.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.40:6838/3846797192,v1:172.21.15.40:6839/3846797192] up:boot 2024-09-11T22:28:02.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: fsmap 10 up:standby 2024-09-11T22:28:02.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:28:02.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:02.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:02.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:02.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:28:02.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:28:02.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:02.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: Deploying daemon mds.a on smithi040 2024-09-11T22:28:02.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:02 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/587183671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:02.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.40:6838/3846797192,v1:172.21.15.40:6839/3846797192] up:boot 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: fsmap 10 up:standby 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: Deploying daemon mds.a on smithi040 2024-09-11T22:28:02.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:02 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/587183671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:04.605 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:04 smithi040 ceph-mon[30787]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:04.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:04 smithi177 ceph-mon[35530]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:04.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:04 smithi146 ceph-mon[34996]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:04.920 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:28:04 smithi040 systemd[1]: Starting Ceph mds.a for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:28:05.180 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:28:04 smithi040 podman[69126]: 2024-09-11 22:28:04.824395435 +0000 UTC m=+0.028457104 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:28:05.180 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:28:04 smithi040 podman[69126]: 2024-09-11 22:28:04.926828427 +0000 UTC m=+0.130890095 container create 89711e74356ddaea170b842bb3d32a3ee2cb0f9b89ab09f427ef138d4fe78d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-11T22:28:05.180 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:28:05 smithi040 podman[69126]: 2024-09-11 22:28:05.180180643 +0000 UTC m=+0.384242312 container init 89711e74356ddaea170b842bb3d32a3ee2cb0f9b89ab09f427ef138d4fe78d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-11T22:28:05.485 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:28:05 smithi040 podman[69126]: 2024-09-11 22:28:05.186860715 +0000 UTC m=+0.390922384 container start 89711e74356ddaea170b842bb3d32a3ee2cb0f9b89ab09f427ef138d4fe78d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T22:28:05.485 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:28:05 smithi040 ceph-mds[69145]: -- 172.21.15.40:0/2190245335 <== mon.0 v2:172.21.15.40:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619f61b1860 con 0x5619f618f400 2024-09-11T22:28:05.485 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:28:05 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a[69141]: starting mds.a at 2024-09-11T22:28:05.485 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:28:05 smithi040 bash[69126]: 89711e74356ddaea170b842bb3d32a3ee2cb0f9b89ab09f427ef138d4fe78d84 2024-09-11T22:28:05.485 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:28:05 smithi040 systemd[1]: Started Ceph mds.a for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:28:06.322 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:06.730 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:06.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: Deploying daemon mds.b on smithi146 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.40:6840/3832269180,v1:172.21.15.40:6841/3832269180] up:boot 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: fsmap 11 up:standby 2024-09-11T22:28:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:06 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:28:06.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:06.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:06.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:06.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:06.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:28:06.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:28:06.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:06.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: Deploying daemon mds.b on smithi146 2024-09-11T22:28:06.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.40:6840/3832269180,v1:172.21.15.40:6841/3832269180] up:boot 2024-09-11T22:28:06.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: fsmap 11 up:standby 2024-09-11T22:28:06.784 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:06 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:28:06.785 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:06.785 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:06.785 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:06.785 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:06.785 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T22:28:06.786 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T22:28:06.786 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:06.786 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: Deploying daemon mds.b on smithi146 2024-09-11T22:28:06.786 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.40:6840/3832269180,v1:172.21.15.40:6841/3832269180] up:boot 2024-09-11T22:28:06.786 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: fsmap 11 up:standby 2024-09-11T22:28:06.786 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:06 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T22:28:07.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.322+0000 7fe7e8600640 1 -- 172.21.15.40:0/656226476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 msgr2=0x7fe7e0074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.322+0000 7fe7e8600640 1 --2- 172.21.15.40:0/656226476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 0x7fe7e0074970 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009900 tx=0x7fe7d402a480 comp rx=0 tx=0).stop 2024-09-11T22:28:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.322+0000 7fe7e8600640 1 -- 172.21.15.40:0/656226476 shutdown_connections 2024-09-11T22:28:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.322+0000 7fe7e8600640 1 --2- 172.21.15.40:0/656226476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e0112b90 0x7fe7e0114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.322+0000 7fe7e8600640 1 --2- 172.21.15.40:0/656226476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e0074eb0 0x7fe7e0112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.322+0000 7fe7e8600640 1 --2- 172.21.15.40:0/656226476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 0x7fe7e0074970 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.322+0000 7fe7e8600640 1 -- 172.21.15.40:0/656226476 >> 172.21.15.40:0/656226476 conn(0x7fe7e00fd8c0 msgr2=0x7fe7e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.322+0000 7fe7e8600640 1 -- 172.21.15.40:0/656226476 shutdown_connections 2024-09-11T22:28:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.322+0000 7fe7e8600640 1 -- 172.21.15.40:0/656226476 wait complete. 2024-09-11T22:28:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.324+0000 7fe7e8600640 1 Processor -- start 2024-09-11T22:28:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.324+0000 7fe7e8600640 1 -- start start 2024-09-11T22:28:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.324+0000 7fe7e8600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 0x7fe7e01a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.324+0000 7fe7e8600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e0074eb0 0x7fe7e01a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.324+0000 7fe7e8600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e0112b90 0x7fe7e019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.324+0000 7fe7e8600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e01185a0 con 0x7fe7e0074590 2024-09-11T22:28:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.324+0000 7fe7e8600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e0118420 con 0x7fe7e0074eb0 2024-09-11T22:28:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.324+0000 7fe7e8600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e0118720 con 0x7fe7e0112b90 2024-09-11T22:28:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 0x7fe7e01a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e5c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 0x7fe7e01a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59792/0 (socket says 172.21.15.40:59792) 2024-09-11T22:28:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e5c00640 1 -- 172.21.15.40:0/590210158 learned_addr learned my addr 172.21.15.40:0/590210158 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e5200640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e0074eb0 0x7fe7e01a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e6600640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e0112b90 0x7fe7e019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e5c00640 1 -- 172.21.15.40:0/590210158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e0112b90 msgr2=0x7fe7e019e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e5c00640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e0112b90 0x7fe7e019e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e5c00640 1 -- 172.21.15.40:0/590210158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e0074eb0 msgr2=0x7fe7e01a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e5c00640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e0074eb0 0x7fe7e01a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.325+0000 7fe7e5c00640 1 -- 172.21.15.40:0/590210158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e019efe0 con 0x7fe7e0074590 2024-09-11T22:28:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.326+0000 7fe7e5c00640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 0x7fe7e01a46f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4004770 tx=0x7fe7d4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.326+0000 7fe7de000640 1 -- 172.21.15.40:0/590210158 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d403f070 con 0x7fe7e0074590 2024-09-11T22:28:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.326+0000 7fe7de000640 1 -- 172.21.15.40:0/590210158 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7d4031ca0 con 0x7fe7e0074590 2024-09-11T22:28:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.326+0000 7fe7de000640 1 -- 172.21.15.40:0/590210158 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4035030 con 0x7fe7e0074590 2024-09-11T22:28:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.326+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e019f270 con 0x7fe7e0074590 2024-09-11T22:28:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.326+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e01ab5c0 con 0x7fe7e0074590 2024-09-11T22:28:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.327+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e0075cd0 con 0x7fe7e0074590 2024-09-11T22:28:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.329+0000 7fe7de000640 1 -- 172.21.15.40:0/590210158 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe7d4042070 con 0x7fe7e0074590 2024-09-11T22:28:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.331+0000 7fe7de000640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe7c80a2b80 0x7fe7c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.332+0000 7fe7de000640 1 -- 172.21.15.40:0/590210158 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fe7d40ef200 con 0x7fe7e0074590 2024-09-11T22:28:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.332+0000 7fe7e5200640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe7c80a2b80 0x7fe7c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.332+0000 7fe7e5200640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe7c80a2b80 0x7fe7c80a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00ffec0 tx=0x7fe7cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:07.333 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:07 smithi146 systemd[1]: Starting Ceph mds.b for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:28:07.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.336+0000 7fe7de000640 1 -- 172.21.15.40:0/590210158 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7d40bbfd0 con 0x7fe7e0074590 2024-09-11T22:28:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.557+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7e01ab790 con 0x7fe7e0074590 2024-09-11T22:28:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.558+0000 7fe7de000640 1 -- 172.21.15.40:0/590210158 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7fe7d40c02d0 con 0x7fe7e0074590 2024-09-11T22:28:07.559 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:07.559 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":12,"btime":"2024-09-11T22:28:05:494316+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T22:28:07.559 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 12 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe7c80a2b80 msgr2=0x7fe7c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe7c80a2b80 0x7fe7c80a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00ffec0 tx=0x7fe7cc005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 msgr2=0x7fe7e01a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 0x7fe7e01a46f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4004770 tx=0x7fe7d4003c10 comp rx=0 tx=0).stop 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 shutdown_connections 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe7c80a2b80 0x7fe7c80a5040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7e0112b90 0x7fe7e019e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e0074eb0 0x7fe7e01a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 --2- 172.21.15.40:0/590210158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7e0074590 0x7fe7e01a46f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:07.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.560+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 >> 172.21.15.40:0/590210158 conn(0x7fe7e00fd8c0 msgr2=0x7fe7e00fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:07.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.561+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 shutdown_connections 2024-09-11T22:28:07.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:07.561+0000 7fe7e8600640 1 -- 172.21.15.40:0/590210158 wait complete. 2024-09-11T22:28:07.749 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:07 smithi146 podman[65328]: 2024-09-11 22:28:07.383937944 +0000 UTC m=+0.015825018 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:28:07.749 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:07 smithi146 podman[65328]: 2024-09-11 22:28:07.495962601 +0000 UTC m=+0.127849668 container create 6535afd867851ad362a6ca90005f0dc367e671a5cc5020794e0348fcc7097029 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:28:07.749 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:07 smithi146 podman[65328]: 2024-09-11 22:28:07.748848692 +0000 UTC m=+0.380735753 container init 6535afd867851ad362a6ca90005f0dc367e671a5cc5020794e0348fcc7097029 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-11T22:28:08.083 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:07 smithi146 podman[65328]: 2024-09-11 22:28:07.751741879 +0000 UTC m=+0.383628950 container start 6535afd867851ad362a6ca90005f0dc367e671a5cc5020794e0348fcc7097029 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:28:08.084 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:07 smithi146 ceph-mds[65347]: -- 172.21.15.146:0/1580018863 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c64d9bdc20 con 0x55c64d99a800 2024-09-11T22:28:08.084 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:07 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b[65343]: starting mds.b at 2024-09-11T22:28:08.084 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:07 smithi146 bash[65328]: 6535afd867851ad362a6ca90005f0dc367e671a5cc5020794e0348fcc7097029 2024-09-11T22:28:08.084 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:07 smithi146 systemd[1]: Started Ceph mds.b for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:28:08.696 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:08 smithi177 ceph-mon[35530]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:08.696 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:08 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/590210158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:08.696 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:08 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.696 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:08 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.696 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:08 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.696 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:08 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.697 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:08 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.697 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:08 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:28:08.697 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:08 smithi146 ceph-mon[34996]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:08.697 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:08 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/590210158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:08.697 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:08 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.697 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:08 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.697 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:08 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.697 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:08 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.697 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:08 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.698 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:08 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:28:08.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:08 smithi040 ceph-mon[30787]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:08.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:08 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/590210158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:08.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:08 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:08 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:08 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:08 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:08 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:08.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:08 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:28:09.422 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:09 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] up:boot 2024-09-11T22:28:09.422 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:09 smithi146 ceph-mon[34996]: fsmap 12 up:standby 2024-09-11T22:28:09.422 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:09 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:28:09.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:09 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] up:boot 2024-09-11T22:28:09.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:09 smithi040 ceph-mon[30787]: fsmap 12 up:standby 2024-09-11T22:28:09.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:09 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:28:09.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:09 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] up:boot 2024-09-11T22:28:09.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:09 smithi177 ceph-mon[35530]: fsmap 12 up:standby 2024-09-11T22:28:09.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:09 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:28:10.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:10.708 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:10.814 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:10 smithi040 ceph-mon[30787]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:10.814 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.815 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.815 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.815 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.815 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.815 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:10 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:10 smithi146 ceph-mon[34996]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:10.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.850 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:10 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:10 smithi177 ceph-mon[35530]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:10.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.964 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:10.965 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:10 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:11.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.327+0000 7f71cc400640 1 -- 172.21.15.40:0/1393944534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 msgr2=0x7f71c4076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:11.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.327+0000 7f71cc400640 1 --2- 172.21.15.40:0/1393944534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 0x7f71c4076b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009900 tx=0x7f71b802a410 comp rx=0 tx=0).stop 2024-09-11T22:28:11.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.327+0000 7f71cc400640 1 -- 172.21.15.40:0/1393944534 shutdown_connections 2024-09-11T22:28:11.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.327+0000 7f71cc400640 1 --2- 172.21.15.40:0/1393944534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c4112a30 0x7f71c4114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.327+0000 7f71cc400640 1 --2- 172.21.15.40:0/1393944534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71c4077040 0x7f71c41124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.327+0000 7f71cc400640 1 --2- 172.21.15.40:0/1393944534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 0x7f71c4076b00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.327+0000 7f71cc400640 1 -- 172.21.15.40:0/1393944534 >> 172.21.15.40:0/1393944534 conn(0x7f71c40ffa90 msgr2=0x7f71c4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:11.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.327+0000 7f71cc400640 1 -- 172.21.15.40:0/1393944534 shutdown_connections 2024-09-11T22:28:11.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.327+0000 7f71cc400640 1 -- 172.21.15.40:0/1393944534 wait complete. 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.329+0000 7f71cc400640 1 Processor -- start 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.329+0000 7f71cc400640 1 -- start start 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.329+0000 7f71cc400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 0x7f71c41a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.329+0000 7f71cc400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c4077040 0x7f71c41a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.329+0000 7f71cc400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71c4112a30 0x7f71c419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.329+0000 7f71cc400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f71c41185c0 con 0x7f71c4077040 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.329+0000 7f71cc400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f71c4118440 con 0x7f71c4076720 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.329+0000 7f71cc400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f71c4118740 con 0x7f71c4112a30 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 0x7f71c41a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c4077040 0x7f71c41a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c4077040 0x7f71c41a4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59808/0 (socket says 172.21.15.40:59808) 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 0x7f71c41a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:54558/0 (socket says 172.21.15.40:54558) 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9000640 1 -- 172.21.15.40:0/909280894 learned_addr learned my addr 172.21.15.40:0/909280894 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71ca400640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71c4112a30 0x7f71c419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9000640 1 -- 172.21.15.40:0/909280894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71c4112a30 msgr2=0x7f71c419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9000640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71c4112a30 0x7f71c419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9000640 1 -- 172.21.15.40:0/909280894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 msgr2=0x7f71c41a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9000640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 0x7f71c41a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9000640 1 -- 172.21.15.40:0/909280894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c419efe0 con 0x7f71c4077040 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.330+0000 7f71c9a00640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 0x7f71c41a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.331+0000 7f71c9000640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c4077040 0x7f71c41a4c30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71b000e9f0 tx=0x7f71b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.331+0000 7f71c2000640 1 -- 172.21.15.40:0/909280894 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b000cd80 con 0x7f71c4077040 2024-09-11T22:28:11.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.331+0000 7f71c2000640 1 -- 172.21.15.40:0/909280894 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b0005500 con 0x7f71c4077040 2024-09-11T22:28:11.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.331+0000 7f71c2000640 1 -- 172.21.15.40:0/909280894 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0010690 con 0x7f71c4077040 2024-09-11T22:28:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.331+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c419f2d0 con 0x7f71c4077040 2024-09-11T22:28:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.332+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c41ab5c0 con 0x7f71c4077040 2024-09-11T22:28:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.333+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c4076b00 con 0x7f71c4077040 2024-09-11T22:28:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.335+0000 7f71c2000640 1 -- 172.21.15.40:0/909280894 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f71b00046c0 con 0x7f71c4077040 2024-09-11T22:28:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.337+0000 7f71c2000640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f71ac0a2c00 0x7f71ac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:11.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.337+0000 7f71c2000640 1 -- 172.21.15.40:0/909280894 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f71b00cefc0 con 0x7f71c4077040 2024-09-11T22:28:11.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.337+0000 7f71c9a00640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f71ac0a2c00 0x7f71ac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:11.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.338+0000 7f71c9a00640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f71ac0a2c00 0x7f71ac0a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f71c419f9f0 tx=0x7f71b80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:11.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.341+0000 7f71c2000640 1 -- 172.21.15.40:0/909280894 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71b009c320 con 0x7f71c4077040 2024-09-11T22:28:11.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.588+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71c402d7c0 con 0x7f71c4077040 2024-09-11T22:28:11.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.589+0000 7f71c2000640 1 -- 172.21.15.40:0/909280894 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7f71b0086070 con 0x7f71c4077040 2024-09-11T22:28:11.589 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 13 2024-09-11T22:28:11.590 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"btime":"2024-09-11T22:28:08:364752+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24527,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-11T22:28:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.591+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f71ac0a2c00 msgr2=0x7f71ac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.591+0000 7f71cc400640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f71ac0a2c00 0x7f71ac0a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f71c419f9f0 tx=0x7f71b80058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.591+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c4077040 msgr2=0x7f71c41a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:11.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.591+0000 7f71cc400640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c4077040 0x7f71c41a4c30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71b000e9f0 tx=0x7f71b000edf0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.592+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 shutdown_connections 2024-09-11T22:28:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.592+0000 7f71cc400640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f71ac0a2c00 0x7f71ac0a50c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.592+0000 7f71cc400640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71c4112a30 0x7f71c419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.592+0000 7f71cc400640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c4077040 0x7f71c41a4c30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.592+0000 7f71cc400640 1 --2- 172.21.15.40:0/909280894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c4076720 0x7f71c41a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.592+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 >> 172.21.15.40:0/909280894 conn(0x7f71c40ffa90 msgr2=0x7f71c4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.592+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 shutdown_connections 2024-09-11T22:28:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:11.592+0000 7f71cc400640 1 -- 172.21.15.40:0/909280894 wait complete. 2024-09-11T22:28:11.832 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:11.832 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:28:11.832 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:11.832 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:11 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:28:11.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:11.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:28:11.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:11.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:11 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:28:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:28:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:11.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:11 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:28:12.825 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:12 smithi040 ceph-mon[30787]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:12.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:12 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/909280894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:12.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:12 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:12.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:12 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:12.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:12 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:12.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:12 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:12.826 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:12 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:12.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:12 smithi146 ceph-mon[34996]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:12.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:12 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/909280894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:12.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:12 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:12.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:12 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:12 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:12 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:12.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:12 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:13.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:12 smithi177 ceph-mon[35530]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:13.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:12 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/909280894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:13.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:12 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:13.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:12 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:13.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:12 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:13.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:12 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:13.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:12 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:13.322 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T22:28:13.723 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:14.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.309+0000 7fc435000640 1 -- 172.21.15.40:0/3563615318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4300ffcf0 msgr2=0x7fc4301000d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.309+0000 7fc435000640 1 --2- 172.21.15.40:0/3563615318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4300ffcf0 0x7fc4301000d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc420009930 tx=0x7fc42002a4d0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.309+0000 7fc435000640 1 -- 172.21.15.40:0/3563615318 shutdown_connections 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.309+0000 7fc435000640 1 --2- 172.21.15.40:0/3563615318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc43010a1c0 0x7fc430110b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.309+0000 7fc435000640 1 --2- 172.21.15.40:0/3563615318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc430100610 0x7fc430109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.309+0000 7fc435000640 1 --2- 172.21.15.40:0/3563615318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4300ffcf0 0x7fc4301000d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.309+0000 7fc435000640 1 -- 172.21.15.40:0/3563615318 >> 172.21.15.40:0/3563615318 conn(0x7fc4300fb920 msgr2=0x7fc4300fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.309+0000 7fc435000640 1 -- 172.21.15.40:0/3563615318 shutdown_connections 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.309+0000 7fc435000640 1 -- 172.21.15.40:0/3563615318 wait complete. 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.310+0000 7fc435000640 1 Processor -- start 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.310+0000 7fc435000640 1 -- start start 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc435000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4300ffcf0 0x7fc43019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc435000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc430100610 0x7fc43019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:14.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc435000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43010a1c0 0x7fc43019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc435000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc430113ff0 con 0x7fc43010a1c0 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc435000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc430113e70 con 0x7fc4300ffcf0 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc435000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc430114170 con 0x7fc430100610 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc42fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43010a1c0 0x7fc43019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc42fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43010a1c0 0x7fc43019ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37526/0 (socket says 172.21.15.40:37526) 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc42fe00640 1 -- 172.21.15.40:0/3251557621 learned_addr learned my addr 172.21.15.40:0/3251557621 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc427e00640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc430100610 0x7fc43019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc42f400640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4300ffcf0 0x7fc43019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc42fe00640 1 -- 172.21.15.40:0/3251557621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc430100610 msgr2=0x7fc43019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc42fe00640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc430100610 0x7fc43019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc42fe00640 1 -- 172.21.15.40:0/3251557621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4300ffcf0 msgr2=0x7fc43019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc42fe00640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4300ffcf0 0x7fc43019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.311+0000 7fc42fe00640 1 -- 172.21.15.40:0/3251557621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43019f420 con 0x7fc43010a1c0 2024-09-11T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.312+0000 7fc42fe00640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43010a1c0 0x7fc43019ed40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc42800eb10 tx=0x7fc42800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.312+0000 7fc42cc00640 1 -- 172.21.15.40:0/3251557621 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428004b20 con 0x7fc43010a1c0 2024-09-11T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.312+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43019f710 con 0x7fc43010a1c0 2024-09-11T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.312+0000 7fc42cc00640 1 -- 172.21.15.40:0/3251557621 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc428004cc0 con 0x7fc43010a1c0 2024-09-11T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.312+0000 7fc42cc00640 1 -- 172.21.15.40:0/3251557621 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428010760 con 0x7fc43010a1c0 2024-09-11T22:28:14.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.312+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4301a6ff0 con 0x7fc43010a1c0 2024-09-11T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.313+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4301000d0 con 0x7fc43010a1c0 2024-09-11T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.315+0000 7fc42cc00640 1 -- 172.21.15.40:0/3251557621 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc428005020 con 0x7fc43010a1c0 2024-09-11T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.316+0000 7fc42cc00640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc4140a2c00 0x7fc4140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.317+0000 7fc42cc00640 1 -- 172.21.15.40:0/3251557621 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fc4280cf210 con 0x7fc43010a1c0 2024-09-11T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.317+0000 7fc42f400640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc4140a2c00 0x7fc4140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:14.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.317+0000 7fc42f400640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc4140a2c00 0x7fc4140a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc420009900 tx=0x7fc4200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:14.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.320+0000 7fc42cc00640 1 -- 172.21.15.40:0/3251557621 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc42809c570 con 0x7fc43010a1c0 2024-09-11T22:28:14.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.547+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc43010bc40 con 0x7fc43010a1c0 2024-09-11T22:28:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.548+0000 7fc42cc00640 1 -- 172.21.15.40:0/3251557621 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) ==== 84+0+65 (secure 0 0 0) 0x7fc42809be70 con 0x7fc43010a1c0 2024-09-11T22:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-09-11T22:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-09-11T22:28:14.548 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-09-11T22:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:28:14.549 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-09-11T22:28:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc4140a2c00 msgr2=0x7fc4140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc4140a2c00 0x7fc4140a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc420009900 tx=0x7fc4200058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43010a1c0 msgr2=0x7fc43019ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43010a1c0 0x7fc43019ed40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc42800eb10 tx=0x7fc42800c2d0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 shutdown_connections 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc4140a2c00 0x7fc4140a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc43010a1c0 0x7fc43019ed40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc430100610 0x7fc43019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 --2- 172.21.15.40:0/3251557621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4300ffcf0 0x7fc43019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 >> 172.21.15.40:0/3251557621 conn(0x7fc4300fb920 msgr2=0x7fc430107c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 shutdown_connections 2024-09-11T22:28:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:14.550+0000 7fc435000640 1 -- 172.21.15.40:0/3251557621 wait complete. 2024-09-11T22:28:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:14 smithi146 ceph-mon[34996]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:14 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:14 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:14.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:14 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:14.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:14 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:28:14.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:14 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:14.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:14 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3251557621' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T22:28:14.942 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:14 smithi040 ceph-mon[30787]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:14.943 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:14 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:14.943 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:14 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:14.943 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:14 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:14.943 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:14 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:28:14.943 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:14 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:14.943 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:14 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3251557621' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T22:28:15.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:14 smithi177 ceph-mon[35530]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:15.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:14 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:15.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:14 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:15.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:14 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:28:15.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:14 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:28:15.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:14 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:28:15.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:14 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3251557621' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T22:28:15.408 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:28:15.408 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:28:15.786 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:16.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.373+0000 7f834b200640 1 -- 172.21.15.40:0/4119203336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c103e30 msgr2=0x7f834c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:16.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.373+0000 7f834b200640 1 --2- 172.21.15.40:0/4119203336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c103e30 0x7f834c104210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f833c009900 tx=0x7f833c02a410 comp rx=0 tx=0).stop 2024-09-11T22:28:16.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.373+0000 7f834b200640 1 -- 172.21.15.40:0/4119203336 shutdown_connections 2024-09-11T22:28:16.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.373+0000 7f834b200640 1 --2- 172.21.15.40:0/4119203336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f834c108f60 0x7f834c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:16.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.373+0000 7f834b200640 1 --2- 172.21.15.40:0/4119203336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f834c1047e0 0x7f834c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:16.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.373+0000 7f834b200640 1 --2- 172.21.15.40:0/4119203336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c103e30 0x7f834c104210 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:16.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.373+0000 7f834b200640 1 -- 172.21.15.40:0/4119203336 >> 172.21.15.40:0/4119203336 conn(0x7f834c0ff8d0 msgr2=0x7f834c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:16.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.374+0000 7f834b200640 1 -- 172.21.15.40:0/4119203336 shutdown_connections 2024-09-11T22:28:16.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.374+0000 7f834b200640 1 -- 172.21.15.40:0/4119203336 wait complete. 2024-09-11T22:28:16.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.375+0000 7f834b200640 1 Processor -- start 2024-09-11T22:28:16.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.375+0000 7f834b200640 1 -- start start 2024-09-11T22:28:16.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f834b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f834c103e30 0x7f834c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f834b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f834c1047e0 0x7f834c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f834b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c108f60 0x7f834c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f834b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f834c114010 con 0x7f834c108f60 2024-09-11T22:28:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f834b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f834c113e90 con 0x7f834c103e30 2024-09-11T22:28:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f834b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f834c114190 con 0x7f834c1047e0 2024-09-11T22:28:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f834c103e30 0x7f834c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f834c103e30 0x7f834c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:43188/0 (socket says 172.21.15.40:43188) 2024-09-11T22:28:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349e00640 1 -- 172.21.15.40:0/1231532854 learned_addr learned my addr 172.21.15.40:0/1231532854 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349400640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f834c1047e0 0x7f834c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f834a800640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c108f60 0x7f834c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349e00640 1 -- 172.21.15.40:0/1231532854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f834c1047e0 msgr2=0x7f834c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349e00640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f834c1047e0 0x7f834c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349e00640 1 -- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c108f60 msgr2=0x7f834c19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349e00640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c108f60 0x7f834c19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349e00640 1 -- 172.21.15.40:0/1231532854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c19f470 con 0x7f834c103e30 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f834a800640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c108f60 0x7f834c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.376+0000 7f8349400640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f834c1047e0 0x7f834c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.377+0000 7f8349e00640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f834c103e30 0x7f834c19a4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f833c004770 tx=0x7f833c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.377+0000 7f8342a00640 1 -- 172.21.15.40:0/1231532854 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c03f070 con 0x7f834c103e30 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.377+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834c19f700 con 0x7f834c103e30 2024-09-11T22:28:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.377+0000 7f8342a00640 1 -- 172.21.15.40:0/1231532854 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f833c031ca0 con 0x7f834c103e30 2024-09-11T22:28:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.377+0000 7f8342a00640 1 -- 172.21.15.40:0/1231532854 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c035030 con 0x7f834c103e30 2024-09-11T22:28:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.377+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834c1a7040 con 0x7f834c103e30 2024-09-11T22:28:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.378+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f834c105310 con 0x7f834c103e30 2024-09-11T22:28:16.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.380+0000 7f8342a00640 1 -- 172.21.15.40:0/1231532854 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f833c042070 con 0x7f834c103e30 2024-09-11T22:28:16.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.382+0000 7f8342a00640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f83300a2b80 0x7f83300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:16.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.382+0000 7f8342a00640 1 -- 172.21.15.40:0/1231532854 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f833c0ef930 con 0x7f834c103e30 2024-09-11T22:28:16.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.382+0000 7f8349400640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f83300a2b80 0x7f83300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:16.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.382+0000 7f8349400640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f83300a2b80 0x7f83300a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f834c0ffd60 tx=0x7f8338005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.383+0000 7f8342a00640 1 -- 172.21.15.40:0/1231532854 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f833c0bcc90 con 0x7f834c103e30 2024-09-11T22:28:16.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:16.571+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f834c104210 con 0x7f834c103e30 2024-09-11T22:28:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:16 smithi146 ceph-mon[34996]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:16 smithi040 ceph-mon[30787]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:17.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:16 smithi177 ceph-mon[35530]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:17.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.573+0000 7f8342a00640 1 -- 172.21.15.40:0/1231532854 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) ==== 138+0+0 (secure 0 0 0) 0x7f834c104210 con 0x7f834c103e30 2024-09-11T22:28:17.574 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-09-11T22:28:17.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f83300a2b80 msgr2=0x7f83300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f83300a2b80 0x7f83300a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f834c0ffd60 tx=0x7f8338005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:17.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f834c103e30 msgr2=0x7f834c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:17.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f834c103e30 0x7f834c19a4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f833c004770 tx=0x7f833c003c10 comp rx=0 tx=0).stop 2024-09-11T22:28:17.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 shutdown_connections 2024-09-11T22:28:17.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f83300a2b80 0x7f83300a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c108f60 0x7f834c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f834c1047e0 0x7f834c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 --2- 172.21.15.40:0/1231532854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f834c103e30 0x7f834c19a4c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:17.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.578+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 >> 172.21.15.40:0/1231532854 conn(0x7f834c0ff8d0 msgr2=0x7f834c100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:17.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.579+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 shutdown_connections 2024-09-11T22:28:17.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:17.579+0000 7f834b200640 1 -- 172.21.15.40:0/1231532854 wait complete. 2024-09-11T22:28:17.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:17 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1231532854' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:28:17.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:17 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:28:17.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:17 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1231532854' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:28:17.927 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:17 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:28:18.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:17 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1231532854' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:28:18.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:17 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T22:28:18.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-11T22:28:18.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:18 smithi040 ceph-mon[30787]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:18.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:18 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T22:28:18.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:18 smithi040 ceph-mon[30787]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T22:28:18.786 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:18.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:18 smithi146 ceph-mon[34996]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:18.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:18 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T22:28:18.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:18 smithi146 ceph-mon[34996]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T22:28:19.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:18 smithi177 ceph-mon[35530]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:19.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:18 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T22:28:19.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:18 smithi177 ceph-mon[35530]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T22:28:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.359+0000 7f2b5ac00640 1 -- 172.21.15.40:0/4292891024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b541019c0 msgr2=0x7f2b54101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.359+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/4292891024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b541019c0 0x7f2b54101e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009930 tx=0x7f2b4002a420 comp rx=0 tx=0).stop 2024-09-11T22:28:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.359+0000 7f2b5ac00640 1 -- 172.21.15.40:0/4292891024 shutdown_connections 2024-09-11T22:28:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.359+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/4292891024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b54102360 0x7f2b5410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.359+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/4292891024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b541019c0 0x7f2b54101e20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.359+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/4292891024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b541079c0 0x7f2b54107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.359+0000 7f2b5ac00640 1 -- 172.21.15.40:0/4292891024 >> 172.21.15.40:0/4292891024 conn(0x7f2b540fd740 msgr2=0x7f2b540ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.359+0000 7f2b5ac00640 1 -- 172.21.15.40:0/4292891024 shutdown_connections 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.359+0000 7f2b5ac00640 1 -- 172.21.15.40:0/4292891024 wait complete. 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.360+0000 7f2b5ac00640 1 Processor -- start 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.360+0000 7f2b5ac00640 1 -- start start 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b5ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b541019c0 0x7f2b5419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b5ac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b54102360 0x7f2b5419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b5ac00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b541079c0 0x7f2b5419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b5ac00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2b54111dc0 con 0x7f2b541079c0 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b5ac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b54111c40 con 0x7f2b541019c0 2024-09-11T22:28:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b5ac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b54111f40 con 0x7f2b54102360 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b5a200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b541079c0 0x7f2b5419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b59800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b541019c0 0x7f2b5419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b58e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b54102360 0x7f2b5419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b59800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b541019c0 0x7f2b5419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:43204/0 (socket says 172.21.15.40:43204) 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b59800640 1 -- 172.21.15.40:0/640670440 learned_addr learned my addr 172.21.15.40:0/640670440 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b59800640 1 -- 172.21.15.40:0/640670440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b54102360 msgr2=0x7f2b5419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b59800640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b54102360 0x7f2b5419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b59800640 1 -- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b541079c0 msgr2=0x7f2b5419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b59800640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b541079c0 0x7f2b5419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b59800640 1 -- 172.21.15.40:0/640670440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5419f460 con 0x7f2b541019c0 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.361+0000 7f2b5a200640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b541079c0 0x7f2b5419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.362+0000 7f2b59800640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b541019c0 0x7f2b5419a4b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800e9f0 tx=0x7f2b4800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.362+0000 7f2b52000640 1 -- 172.21.15.40:0/640670440 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800cd80 con 0x7f2b541019c0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.362+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5419f750 con 0x7f2b541019c0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.362+0000 7f2b52000640 1 -- 172.21.15.40:0/640670440 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b48010910 con 0x7f2b541019c0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.362+0000 7f2b52000640 1 -- 172.21.15.40:0/640670440 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b480188f0 con 0x7f2b541019c0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.362+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b541a7030 con 0x7f2b541019c0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.363+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b54101e20 con 0x7f2b541019c0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.365+0000 7f2b52000640 1 -- 172.21.15.40:0/640670440 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2b48010ac0 con 0x7f2b541019c0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.366+0000 7f2b52000640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2b3c0a2c00 0x7f2b3c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.367+0000 7f2b52000640 1 -- 172.21.15.40:0/640670440 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7497+0+0 (secure 0 0 0) 0x7f2b480cf420 con 0x7f2b541019c0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.367+0000 7f2b58e00640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2b3c0a2c00 0x7f2b3c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.367+0000 7f2b58e00640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2b3c0a2c00 0x7f2b3c0a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009900 tx=0x7f2b400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.369+0000 7f2b52000640 1 -- 172.21.15.40:0/640670440 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b4809bfc0 con 0x7f2b541019c0 2024-09-11T22:28:19.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:19.553+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f2b541a7230 con 0x7f2b541019c0 2024-09-11T22:28:20.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.101+0000 7f2b52000640 1 -- 172.21.15.40:0/640670440 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v81) ==== 171+0+0 (secure 0 0 0) 0x7f2b480a02c0 con 0x7f2b541019c0 2024-09-11T22:28:20.102 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2b3c0a2c00 msgr2=0x7f2b3c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2b3c0a2c00 0x7f2b3c0a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009900 tx=0x7f2b400058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b541019c0 msgr2=0x7f2b5419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b541019c0 0x7f2b5419a4b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800e9f0 tx=0x7f2b4800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 shutdown_connections 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2b3c0a2c00 0x7f2b3c0a50c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b541079c0 0x7f2b5419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b54102360 0x7f2b5419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 --2- 172.21.15.40:0/640670440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b541019c0 0x7f2b5419a4b0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800e9f0 tx=0x7f2b4800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:20.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.107+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 >> 172.21.15.40:0/640670440 conn(0x7f2b540fd740 msgr2=0x7f2b5410cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.109+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 shutdown_connections 2024-09-11T22:28:20.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:20.109+0000 7f2b5ac00640 1 -- 172.21.15.40:0/640670440 wait complete. 2024-09-11T22:28:20.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:20 smithi040 ceph-mon[30787]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T22:28:20.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:20 smithi177 ceph-mon[35530]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T22:28:20.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:20 smithi146 ceph-mon[34996]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T22:28:21.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:28:21.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:21 smithi040 ceph-mon[30787]: pgmap v291: 33 pgs: 10 active+clean, 6 creating+peering, 17 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:21.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:21 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/640670440' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T22:28:21.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:21 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T22:28:21.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:21 smithi040 ceph-mon[30787]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:28:21.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:21 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T22:28:21.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:21 smithi040 ceph-mon[30787]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T22:28:21.409 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:21.450 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:21 smithi177 ceph-mon[35530]: pgmap v291: 33 pgs: 10 active+clean, 6 creating+peering, 17 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:21.450 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:21 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/640670440' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T22:28:21.450 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:21 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T22:28:21.451 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:21 smithi177 ceph-mon[35530]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:28:21.451 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:21 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T22:28:21.451 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:21 smithi177 ceph-mon[35530]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T22:28:21.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:21 smithi146 ceph-mon[34996]: pgmap v291: 33 pgs: 10 active+clean, 6 creating+peering, 17 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:21.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:21 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/640670440' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T22:28:21.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:21 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-11T22:28:21.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:21 smithi146 ceph-mon[34996]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:28:21.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:21 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T22:28:21.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:21 smithi146 ceph-mon[34996]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T22:28:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.017+0000 7fdf0f200640 1 -- 172.21.15.40:0/1643911178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08103ff0 msgr2=0x7fdf081043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.017+0000 7fdf0f200640 1 --2- 172.21.15.40:0/1643911178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08103ff0 0x7fdf081043d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009ca0 tx=0x7fdef802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.017+0000 7fdf0f200640 1 -- 172.21.15.40:0/1643911178 shutdown_connections 2024-09-11T22:28:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.017+0000 7fdf0f200640 1 --2- 172.21.15.40:0/1643911178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf08109120 0x7fdf08110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.017+0000 7fdf0f200640 1 --2- 172.21.15.40:0/1643911178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf081049a0 0x7fdf081089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.017+0000 7fdf0f200640 1 --2- 172.21.15.40:0/1643911178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08103ff0 0x7fdf081043d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.017+0000 7fdf0f200640 1 -- 172.21.15.40:0/1643911178 >> 172.21.15.40:0/1643911178 conn(0x7fdf080ffa90 msgr2=0x7fdf08101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.017+0000 7fdf0f200640 1 -- 172.21.15.40:0/1643911178 shutdown_connections 2024-09-11T22:28:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.017+0000 7fdf0f200640 1 -- 172.21.15.40:0/1643911178 wait complete. 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.018+0000 7fdf0f200640 1 Processor -- start 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.018+0000 7fdf0f200640 1 -- start start 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.018+0000 7fdf0f200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08103ff0 0x7fdf0819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.018+0000 7fdf0f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf081049a0 0x7fdf0819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.018+0000 7fdf0f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08109120 0x7fdf0819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.018+0000 7fdf0f200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf08114120 con 0x7fdf08103ff0 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.018+0000 7fdf0f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf08113fa0 con 0x7fdf081049a0 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.018+0000 7fdf0f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf081142a0 con 0x7fdf08109120 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.018+0000 7fdf07e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08103ff0 0x7fdf0819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf07e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08103ff0 0x7fdf0819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49352/0 (socket says 172.21.15.40:49352) 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf07e00640 1 -- 172.21.15.40:0/3724235098 learned_addr learned my addr 172.21.15.40:0/3724235098 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf0d200640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08109120 0x7fdf0819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdeff400640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf081049a0 0x7fdf0819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf07e00640 1 -- 172.21.15.40:0/3724235098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08109120 msgr2=0x7fdf0819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf07e00640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08109120 0x7fdf0819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf07e00640 1 -- 172.21.15.40:0/3724235098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf081049a0 msgr2=0x7fdf0819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf07e00640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf081049a0 0x7fdf0819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf07e00640 1 -- 172.21.15.40:0/3724235098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0819f590 con 0x7fdf08103ff0 2024-09-11T22:28:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf0d200640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08109120 0x7fdf0819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:22.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.019+0000 7fdf07e00640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08103ff0 0x7fdf0819a5e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdef802ade0 tx=0x7fdef80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.020+0000 7fdf05600640 1 -- 172.21.15.40:0/3724235098 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef802fa20 con 0x7fdf08103ff0 2024-09-11T22:28:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.020+0000 7fdf05600640 1 -- 172.21.15.40:0/3724235098 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef802fbc0 con 0x7fdf08103ff0 2024-09-11T22:28:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.020+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0819f820 con 0x7fdf08103ff0 2024-09-11T22:28:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.020+0000 7fdf05600640 1 -- 172.21.15.40:0/3724235098 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef80466e0 con 0x7fdf08103ff0 2024-09-11T22:28:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.020+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf081a7160 con 0x7fdf08103ff0 2024-09-11T22:28:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.021+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf081043d0 con 0x7fdf08103ff0 2024-09-11T22:28:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.023+0000 7fdf05600640 1 -- 172.21.15.40:0/3724235098 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdef802fd70 con 0x7fdf08103ff0 2024-09-11T22:28:22.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.026+0000 7fdf05600640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdeec0a2b80 0x7fdeec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:22.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.026+0000 7fdf05600640 1 -- 172.21.15.40:0/3724235098 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7879+0+0 (secure 0 0 0) 0x7fdef80f0490 con 0x7fdf08103ff0 2024-09-11T22:28:22.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.026+0000 7fdeff400640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdeec0a2b80 0x7fdeec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:22.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.026+0000 7fdeff400640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdeec0a2b80 0x7fdeec0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf080ffeb0 tx=0x7fdef0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:22.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.028+0000 7fdf05600640 1 -- 172.21.15.40:0/3724235098 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdef80bd500 con 0x7fdf08103ff0 2024-09-11T22:28:22.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:22 smithi040 ceph-mon[30787]: pgmap v293: 97 pgs: 15 active+clean, 6 creating+peering, 76 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:22.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:22 smithi040 ceph-mon[30787]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T22:28:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:22.254+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fdf0810c300 con 0x7fdf08103ff0 2024-09-11T22:28:22.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:22 smithi177 ceph-mon[35530]: pgmap v293: 97 pgs: 15 active+clean, 6 creating+peering, 76 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:22.284 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:22 smithi177 ceph-mon[35530]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T22:28:22.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:22 smithi146 ceph-mon[34996]: pgmap v293: 97 pgs: 15 active+clean, 6 creating+peering, 76 unknown; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:22.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:22 smithi146 ceph-mon[34996]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T22:28:23.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.120+0000 7fdf05600640 1 -- 172.21.15.40:0/3724235098 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fdef80bce00 con 0x7fdf08103ff0 2024-09-11T22:28:23.121 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdeec0a2b80 msgr2=0x7fdeec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdeec0a2b80 0x7fdeec0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf080ffeb0 tx=0x7fdef0005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08103ff0 msgr2=0x7fdf0819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08103ff0 0x7fdf0819a5e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdef802ade0 tx=0x7fdef80319f0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 shutdown_connections 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdeec0a2b80 0x7fdeec0a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08109120 0x7fdf0819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf081049a0 0x7fdf0819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 --2- 172.21.15.40:0/3724235098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf08103ff0 0x7fdf0819a5e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 >> 172.21.15.40:0/3724235098 conn(0x7fdf080ffa90 msgr2=0x7fdf08100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:23.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 shutdown_connections 2024-09-11T22:28:23.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:23.124+0000 7fdf0f200640 1 -- 172.21.15.40:0/3724235098 wait complete. 2024-09-11T22:28:23.389 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:23 smithi040 ceph-mon[30787]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T22:28:23.389 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:23 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3724235098' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T22:28:23.389 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:23 smithi040 ceph-mon[30787]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T22:28:23.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:23 smithi177 ceph-mon[35530]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T22:28:23.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:23 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3724235098' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T22:28:23.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:23 smithi177 ceph-mon[35530]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T22:28:23.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:23 smithi146 ceph-mon[34996]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T22:28:23.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:23 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3724235098' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T22:28:23.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:23 smithi146 ceph-mon[34996]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T22:28:23.893 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-11T22:28:23.893 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-11T22:28:24.279 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:24.418 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:24 smithi040 ceph-mon[30787]: pgmap v296: 97 pgs: 67 active+clean, 8 creating+peering, 22 unknown; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:24.418 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:24 smithi040 ceph-mon[30787]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T22:28:24.418 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:24 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3724235098' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T22:28:24.418 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:24 smithi040 ceph-mon[30787]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T22:28:24.419 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:24 smithi040 ceph-mon[30787]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T22:28:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:24 smithi177 ceph-mon[35530]: pgmap v296: 97 pgs: 67 active+clean, 8 creating+peering, 22 unknown; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:24 smithi177 ceph-mon[35530]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T22:28:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:24 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3724235098' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T22:28:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:24 smithi177 ceph-mon[35530]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T22:28:24.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:24 smithi177 ceph-mon[35530]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T22:28:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:24 smithi146 ceph-mon[34996]: pgmap v296: 97 pgs: 67 active+clean, 8 creating+peering, 22 unknown; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:24 smithi146 ceph-mon[34996]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T22:28:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:24 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3724235098' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T22:28:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:24 smithi146 ceph-mon[34996]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T22:28:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:24 smithi146 ceph-mon[34996]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T22:28:24.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.829+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3222330429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f81049c0 msgr2=0x7fa4f8108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:24.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.829+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3222330429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f81049c0 0x7fa4f8108a10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009900 tx=0x7fa4e002a410 comp rx=0 tx=0).stop 2024-09-11T22:28:24.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.829+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3222330429 shutdown_connections 2024-09-11T22:28:24.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.829+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3222330429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f8109140 0x7fa4f8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:24.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.829+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3222330429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f81049c0 0x7fa4f8108a10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:24.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.829+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3222330429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f8104010 0x7fa4f81043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:24.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.829+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3222330429 >> 172.21.15.40:0/3222330429 conn(0x7fa4f80ffa50 msgr2=0x7fa4f8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:24.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.829+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3222330429 shutdown_connections 2024-09-11T22:28:24.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.829+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3222330429 wait complete. 2024-09-11T22:28:24.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.830+0000 7fa4fcc00640 1 Processor -- start 2024-09-11T22:28:24.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.830+0000 7fa4fcc00640 1 -- start start 2024-09-11T22:28:24.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4fcc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f8104010 0x7fa4f819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:24.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4fcc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f81049c0 0x7fa4f819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:24.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4fcc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f8109140 0x7fa4f819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:24.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4fcc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8114190 con 0x7fa4f8109140 2024-09-11T22:28:24.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4fcc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8114010 con 0x7fa4f81049c0 2024-09-11T22:28:24.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4fcc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8114310 con 0x7fa4f8104010 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4f6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f8109140 0x7fa4f819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4efe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f81049c0 0x7fa4f819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4f6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f8109140 0x7fa4f819ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49360/0 (socket says 172.21.15.40:49360) 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4f6800640 1 -- 172.21.15.40:0/3772245455 learned_addr learned my addr 172.21.15.40:0/3772245455 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.831+0000 7fa4f5e00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f8104010 0x7fa4f819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4efe00640 1 -- 172.21.15.40:0/3772245455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f8104010 msgr2=0x7fa4f819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4efe00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f8104010 0x7fa4f819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4efe00640 1 -- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f8109140 msgr2=0x7fa4f819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4efe00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f8109140 0x7fa4f819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:24.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4efe00640 1 -- 172.21.15.40:0/3772245455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f819f600 con 0x7fa4f81049c0 2024-09-11T22:28:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4f6800640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f8109140 0x7fa4f819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4efe00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f81049c0 0x7fa4f819ab90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa4e002a930 tx=0x7fa4e0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4eea00640 1 -- 172.21.15.40:0/3772245455 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e003f070 con 0x7fa4f81049c0 2024-09-11T22:28:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f819f890 con 0x7fa4f81049c0 2024-09-11T22:28:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4eea00640 1 -- 172.21.15.40:0/3772245455 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4e0031c90 con 0x7fa4f81049c0 2024-09-11T22:28:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4eea00640 1 -- 172.21.15.40:0/3772245455 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0035030 con 0x7fa4f81049c0 2024-09-11T22:28:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.832+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f81a71d0 con 0x7fa4f81049c0 2024-09-11T22:28:24.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.833+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f81043f0 con 0x7fa4f81049c0 2024-09-11T22:28:24.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.836+0000 7fa4eea00640 1 -- 172.21.15.40:0/3772245455 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa4e0042070 con 0x7fa4f81049c0 2024-09-11T22:28:24.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.837+0000 7fa4eea00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4dc0a2c00 0x7fa4dc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:24.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.837+0000 7fa4eea00640 1 -- 172.21.15.40:0/3772245455 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7fa4e00efaf0 con 0x7fa4f81049c0 2024-09-11T22:28:24.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.837+0000 7fa4f5e00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4dc0a2c00 0x7fa4dc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:24.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.838+0000 7fa4f5e00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4dc0a2c00 0x7fa4dc0a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800bbe0 tx=0x7fa4e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:24.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:24.839+0000 7fa4eea00640 1 -- 172.21.15.40:0/3772245455 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4e00bc4b0 con 0x7fa4f81049c0 2024-09-11T22:28:25.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.034+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fa4f819b9b0 con 0x7fa4f81049c0 2024-09-11T22:28:25.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.145+0000 7fa4eea00640 1 -- 172.21.15.40:0/3772245455 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7fa4f819b9b0 con 0x7fa4f81049c0 2024-09-11T22:28:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4dc0a2c00 msgr2=0x7fa4dc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4dc0a2c00 0x7fa4dc0a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800bbe0 tx=0x7fa4e800b390 comp rx=0 tx=0).stop 2024-09-11T22:28:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f81049c0 msgr2=0x7fa4f819ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f81049c0 0x7fa4f819ab90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa4e002a930 tx=0x7fa4e0003b90 comp rx=0 tx=0).stop 2024-09-11T22:28:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 shutdown_connections 2024-09-11T22:28:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4dc0a2c00 0x7fa4dc0a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:25.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4f8109140 0x7fa4f819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:25.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f81049c0 0x7fa4f819ab90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:25.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 --2- 172.21.15.40:0/3772245455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4f8104010 0x7fa4f819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:25.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.147+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 >> 172.21.15.40:0/3772245455 conn(0x7fa4f80ffa50 msgr2=0x7fa4f8100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:25.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.148+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 shutdown_connections 2024-09-11T22:28:25.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:25.148+0000 7fa4fcc00640 1 -- 172.21.15.40:0/3772245455 wait complete. 2024-09-11T22:28:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:25 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] up:active 2024-09-11T22:28:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:25 smithi040 ceph-mon[30787]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:28:25.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:25 smithi040 ceph-mon[30787]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:28:25.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:25 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3772245455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T22:28:25.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:25 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T22:28:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:25 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] up:active 2024-09-11T22:28:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:25 smithi177 ceph-mon[35530]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:28:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:25 smithi177 ceph-mon[35530]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:28:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:25 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3772245455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T22:28:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:25 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T22:28:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:25 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] up:active 2024-09-11T22:28:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:25 smithi146 ceph-mon[34996]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:28:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:25 smithi146 ceph-mon[34996]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:28:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:25 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3772245455' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T22:28:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:25 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-11T22:28:25.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:28:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:26 smithi040 ceph-mon[30787]: pgmap v298: 97 pgs: 89 active+clean, 8 creating+peering; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 419 B/s wr, 4 op/s 2024-09-11T22:28:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:26 smithi040 ceph-mon[30787]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T22:28:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:26 smithi040 ceph-mon[30787]: Cluster is now healthy 2024-09-11T22:28:26.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:26 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T22:28:26.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:26 smithi040 ceph-mon[30787]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T22:28:26.377 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:26.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:26 smithi177 ceph-mon[35530]: pgmap v298: 97 pgs: 89 active+clean, 8 creating+peering; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 419 B/s wr, 4 op/s 2024-09-11T22:28:26.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:26 smithi177 ceph-mon[35530]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T22:28:26.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:26 smithi177 ceph-mon[35530]: Cluster is now healthy 2024-09-11T22:28:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:26 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T22:28:26.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:26 smithi177 ceph-mon[35530]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T22:28:26.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:26 smithi146 ceph-mon[34996]: pgmap v298: 97 pgs: 89 active+clean, 8 creating+peering; 577 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 419 B/s wr, 4 op/s 2024-09-11T22:28:26.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:26 smithi146 ceph-mon[34996]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T22:28:26.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:26 smithi146 ceph-mon[34996]: Cluster is now healthy 2024-09-11T22:28:26.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:26 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T22:28:26.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:26 smithi146 ceph-mon[34996]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T22:28:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.940+0000 7fa320600640 1 -- 172.21.15.40:0/47179143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 msgr2=0x7fa3181089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.940+0000 7fa320600640 1 --2- 172.21.15.40:0/47179143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 0x7fa3181089f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa304009900 tx=0x7fa30402a410 comp rx=0 tx=0).stop 2024-09-11T22:28:26.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.940+0000 7fa320600640 1 -- 172.21.15.40:0/47179143 shutdown_connections 2024-09-11T22:28:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.940+0000 7fa320600640 1 --2- 172.21.15.40:0/47179143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa318109120 0x7fa318110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.940+0000 7fa320600640 1 --2- 172.21.15.40:0/47179143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 0x7fa3181089f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.940+0000 7fa320600640 1 --2- 172.21.15.40:0/47179143 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa318103ff0 0x7fa3181043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.940+0000 7fa320600640 1 -- 172.21.15.40:0/47179143 >> 172.21.15.40:0/47179143 conn(0x7fa3180ffa90 msgr2=0x7fa318101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.940+0000 7fa320600640 1 -- 172.21.15.40:0/47179143 shutdown_connections 2024-09-11T22:28:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.940+0000 7fa320600640 1 -- 172.21.15.40:0/47179143 wait complete. 2024-09-11T22:28:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.941+0000 7fa320600640 1 Processor -- start 2024-09-11T22:28:26.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa320600640 1 -- start start 2024-09-11T22:28:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa320600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa318103ff0 0x7fa31819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa320600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 0x7fa31819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa320600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa318109120 0x7fa31819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa320600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa318114190 con 0x7fa3181049a0 2024-09-11T22:28:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa320600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa318114010 con 0x7fa318109120 2024-09-11T22:28:26.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa320600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa318114310 con 0x7fa318103ff0 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa31d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 0x7fa31819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa31d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 0x7fa31819ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49384/0 (socket says 172.21.15.40:49384) 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa31d200640 1 -- 172.21.15.40:0/4228236480 learned_addr learned my addr 172.21.15.40:0/4228236480 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa31dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa318103ff0 0x7fa31819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.942+0000 7fa31e600640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa318109120 0x7fa31819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa31dc00640 1 -- 172.21.15.40:0/4228236480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa318109120 msgr2=0x7fa31819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa31dc00640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa318109120 0x7fa31819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa31dc00640 1 -- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 msgr2=0x7fa31819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa31dc00640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 0x7fa31819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa31dc00640 1 -- 172.21.15.40:0/4228236480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31819f5e0 con 0x7fa318103ff0 2024-09-11T22:28:26.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa31e600640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa318109120 0x7fa31819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:26.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa31d200640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 0x7fa31819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:26.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa31dc00640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa318103ff0 0x7fa31819a630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00e9f0 tx=0x7fa30c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa316000640 1 -- 172.21.15.40:0/4228236480 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00ccc0 con 0x7fa318103ff0 2024-09-11T22:28:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31819f8d0 con 0x7fa318103ff0 2024-09-11T22:28:26.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa316000640 1 -- 172.21.15.40:0/4228236480 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa30c005020 con 0x7fa318103ff0 2024-09-11T22:28:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa316000640 1 -- 172.21.15.40:0/4228236480 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0049e0 con 0x7fa318103ff0 2024-09-11T22:28:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.943+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3181a71b0 con 0x7fa318103ff0 2024-09-11T22:28:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.944+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3181043d0 con 0x7fa318103ff0 2024-09-11T22:28:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.946+0000 7fa316000640 1 -- 172.21.15.40:0/4228236480 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa30c005560 con 0x7fa318103ff0 2024-09-11T22:28:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.948+0000 7fa316000640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3000a2b80 0x7fa3000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.948+0000 7fa316000640 1 -- 172.21.15.40:0/4228236480 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7fa30c0cf180 con 0x7fa318103ff0 2024-09-11T22:28:26.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.948+0000 7fa31d200640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3000a2b80 0x7fa3000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:26.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.949+0000 7fa31d200640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3000a2b80 0x7fa3000a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa3040096c0 tx=0x7fa3040046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:26.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:26.950+0000 7fa316000640 1 -- 172.21.15.40:0/4228236480 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa30c0051d0 con 0x7fa318103ff0 2024-09-11T22:28:27.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:27.134+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa31819b990 con 0x7fa318103ff0 2024-09-11T22:28:28.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:28 smithi040 ceph-mon[30787]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 5 op/s 2024-09-11T22:28:28.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:28 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/4228236480' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:28:28.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:28 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:28:28.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:28 smithi177 ceph-mon[35530]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 5 op/s 2024-09-11T22:28:28.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:28 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/4228236480' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:28:28.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:28 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:28:28.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:28 smithi146 ceph-mon[34996]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 5 op/s 2024-09-11T22:28:28.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:28 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/4228236480' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:28:28.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:28 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T22:28:28.584 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:28:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b[65343]: 2024-09-11T22:28:28.373+0000 7f6ab2ea1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:28:29.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.155+0000 7fa316000640 1 -- 172.21.15.40:0/4228236480 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7fa31819b990 con 0x7fa318103ff0 2024-09-11T22:28:29.157 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' created 2024-09-11T22:28:29.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.162+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3000a2b80 msgr2=0x7fa3000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:29.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.162+0000 7fa320600640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3000a2b80 0x7fa3000a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa3040096c0 tx=0x7fa3040046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.163+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa318103ff0 msgr2=0x7fa31819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:29.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.163+0000 7fa320600640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa318103ff0 0x7fa31819a630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00e9f0 tx=0x7fa30c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.163+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 shutdown_connections 2024-09-11T22:28:29.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.163+0000 7fa320600640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3000a2b80 0x7fa3000a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.163+0000 7fa320600640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa318109120 0x7fa31819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.163+0000 7fa320600640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3181049a0 0x7fa31819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.163+0000 7fa320600640 1 --2- 172.21.15.40:0/4228236480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa318103ff0 0x7fa31819a630 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:29.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.163+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 >> 172.21.15.40:0/4228236480 conn(0x7fa3180ffa90 msgr2=0x7fa318100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:29.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.164+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 shutdown_connections 2024-09-11T22:28:29.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:29.164+0000 7fa320600640 1 -- 172.21.15.40:0/4228236480 wait complete. 2024-09-11T22:28:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:29 smithi040 ceph-mon[30787]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T22:28:29.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:29 smithi177 ceph-mon[35530]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T22:28:29.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:29 smithi146 ceph-mon[34996]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T22:28:30.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-11T22:28:30.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:30 smithi040 ceph-mon[30787]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-11T22:28:30.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:30 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T22:28:30.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:30 smithi040 ceph-mon[30787]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T22:28:30.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:30 smithi177 ceph-mon[35530]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-11T22:28:30.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:30 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T22:28:30.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:30 smithi177 ceph-mon[35530]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T22:28:30.567 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:30.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:30 smithi146 ceph-mon[34996]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-11T22:28:30.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:30 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T22:28:30.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:30 smithi146 ceph-mon[34996]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.136+0000 7f317b200640 1 -- 172.21.15.40:0/3917566692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174109120 msgr2=0x7f3174110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.136+0000 7f317b200640 1 --2- 172.21.15.40:0/3917566692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174109120 0x7f3174110ca0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f316c009ca0 tx=0x7f316c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.136+0000 7f317b200640 1 -- 172.21.15.40:0/3917566692 shutdown_connections 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.136+0000 7f317b200640 1 --2- 172.21.15.40:0/3917566692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174109120 0x7f3174110ca0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.136+0000 7f317b200640 1 --2- 172.21.15.40:0/3917566692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31741049a0 0x7f31741089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.136+0000 7f317b200640 1 --2- 172.21.15.40:0/3917566692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3174103ff0 0x7f31741043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.136+0000 7f317b200640 1 -- 172.21.15.40:0/3917566692 >> 172.21.15.40:0/3917566692 conn(0x7f31740ffa90 msgr2=0x7f3174101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.136+0000 7f317b200640 1 -- 172.21.15.40:0/3917566692 shutdown_connections 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.136+0000 7f317b200640 1 -- 172.21.15.40:0/3917566692 wait complete. 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.137+0000 7f317b200640 1 Processor -- start 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.137+0000 7f317b200640 1 -- start start 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.137+0000 7f317b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174103ff0 0x7f317419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.137+0000 7f317b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31741049a0 0x7f317419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f317b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3174109120 0x7f317419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f317b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3174114130 con 0x7f3174103ff0 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f317b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113fb0 con 0x7f3174109120 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f317b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31741142b0 con 0x7f31741049a0 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f3173e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174103ff0 0x7f317419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f3173e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174103ff0 0x7f317419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49410/0 (socket says 172.21.15.40:49410) 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f3173e00640 1 -- 172.21.15.40:0/3235762248 learned_addr learned my addr 172.21.15.40:0/3235762248 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f3179200640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3174109120 0x7f317419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f316b400640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31741049a0 0x7f317419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f3173e00640 1 -- 172.21.15.40:0/3235762248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31741049a0 msgr2=0x7f317419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f3173e00640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31741049a0 0x7f317419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f3173e00640 1 -- 172.21.15.40:0/3235762248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3174109120 msgr2=0x7f317419ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f3173e00640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3174109120 0x7f317419ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.138+0000 7f3173e00640 1 -- 172.21.15.40:0/3235762248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317419f540 con 0x7f3174103ff0 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.139+0000 7f3173e00640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174103ff0 0x7f317419a590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f316400ea60 tx=0x7f316400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.139+0000 7f3171600640 1 -- 172.21.15.40:0/3235762248 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316400cde0 con 0x7f3174103ff0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.139+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317419f830 con 0x7f3174103ff0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.139+0000 7f3171600640 1 -- 172.21.15.40:0/3235762248 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31640035f0 con 0x7f3174103ff0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.139+0000 7f3171600640 1 -- 172.21.15.40:0/3235762248 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164010670 con 0x7f3174103ff0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.139+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741a7110 con 0x7f3174103ff0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.140+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31741043d0 con 0x7f3174103ff0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.142+0000 7f3171600640 1 -- 172.21.15.40:0/3235762248 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f31640037a0 con 0x7f3174103ff0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.143+0000 7f3171600640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f31580a2b80 0x7f31580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.143+0000 7f3171600640 1 -- 172.21.15.40:0/3235762248 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7f31640cf630 con 0x7f3174103ff0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.144+0000 7f316b400640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f31580a2b80 0x7f31580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.144+0000 7f316b400640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f31580a2b80 0x7f31580a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f317410aa90 tx=0x7f315c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.146+0000 7f3171600640 1 -- 172.21.15.40:0/3235762248 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f316409c3a0 con 0x7f3174103ff0 2024-09-11T22:28:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:31.334+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f317419b8f0 con 0x7f3174103ff0 2024-09-11T22:28:31.335 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:31 smithi040 ceph-mon[30787]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T22:28:31.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:31 smithi177 ceph-mon[35530]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T22:28:31.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:31 smithi146 ceph-mon[34996]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T22:28:32.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.172+0000 7f3171600640 1 -- 172.21.15.40:0/3235762248 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v90) ==== 169+0+0 (secure 0 0 0) 0x7f316409bca0 con 0x7f3174103ff0 2024-09-11T22:28:32.174 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 4 allow_ec_overwrites to true 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f31580a2b80 msgr2=0x7f31580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f31580a2b80 0x7f31580a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f317410aa90 tx=0x7f315c005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174103ff0 msgr2=0x7f317419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174103ff0 0x7f317419a590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f316400ea60 tx=0x7f316400ef20 comp rx=0 tx=0).stop 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 shutdown_connections 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f31580a2b80 0x7f31580a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3174109120 0x7f317419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31741049a0 0x7f317419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 --2- 172.21.15.40:0/3235762248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3174103ff0 0x7f317419a590 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 >> 172.21.15.40:0/3235762248 conn(0x7f31740ffa90 msgr2=0x7f3174101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 shutdown_connections 2024-09-11T22:28:32.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:32.176+0000 7f317b200640 1 -- 172.21.15.40:0/3235762248 wait complete. 2024-09-11T22:28:32.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:32 smithi040 ceph-mon[30787]: pgmap v305: 129 pgs: 6 creating+peering, 26 unknown, 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-09-11T22:28:32.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:32 smithi040 ceph-mon[30787]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:28:32.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:32 smithi040 ceph-mon[30787]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T22:28:32.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:32 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3235762248' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T22:28:32.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:32 smithi177 ceph-mon[35530]: pgmap v305: 129 pgs: 6 creating+peering, 26 unknown, 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-09-11T22:28:32.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:32 smithi177 ceph-mon[35530]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:28:32.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:32 smithi177 ceph-mon[35530]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T22:28:32.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:32 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3235762248' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T22:28:32.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:32 smithi146 ceph-mon[34996]: pgmap v305: 129 pgs: 6 creating+peering, 26 unknown, 97 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 3 op/s 2024-09-11T22:28:32.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:32 smithi146 ceph-mon[34996]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T22:28:32.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:32 smithi146 ceph-mon[34996]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T22:28:32.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:32 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3235762248' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-11T22:28:33.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-11T22:28:33.447 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:33.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:33 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3235762248' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T22:28:33.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:33 smithi040 ceph-mon[30787]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T22:28:33.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:33 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3235762248' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T22:28:33.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:33 smithi177 ceph-mon[35530]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T22:28:33.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:33 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3235762248' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T22:28:33.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:33 smithi146 ceph-mon[34996]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.986+0000 7f5d30a00640 1 -- 172.21.15.40:0/1935459733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d2c108f60 msgr2=0x7f5d2c110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.986+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1935459733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d2c108f60 0x7f5d2c110ae0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009ca0 tx=0x7f5d2402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.986+0000 7f5d30a00640 1 -- 172.21.15.40:0/1935459733 shutdown_connections 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.986+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1935459733 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d2c108f60 0x7f5d2c110ae0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.986+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1935459733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d2c1047e0 0x7f5d2c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.986+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1935459733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c103e30 0x7f5d2c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.986+0000 7f5d30a00640 1 -- 172.21.15.40:0/1935459733 >> 172.21.15.40:0/1935459733 conn(0x7f5d2c0ff8d0 msgr2=0x7f5d2c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.986+0000 7f5d30a00640 1 -- 172.21.15.40:0/1935459733 shutdown_connections 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.986+0000 7f5d30a00640 1 -- 172.21.15.40:0/1935459733 wait complete. 2024-09-11T22:28:34.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.987+0000 7f5d30a00640 1 Processor -- start 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.987+0000 7f5d30a00640 1 -- start start 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.987+0000 7f5d30a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c103e30 0x7f5d2c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.987+0000 7f5d30a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d2c1047e0 0x7f5d2c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.987+0000 7f5d30a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d2c108f60 0x7f5d2c19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d30a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c113fc0 con 0x7f5d2c1047e0 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d30a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c113e40 con 0x7f5d2c103e30 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d30a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c114140 con 0x7f5d2c108f60 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d2b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c103e30 0x7f5d2c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d23e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d2c1047e0 0x7f5d2c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d2be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d2c108f60 0x7f5d2c19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d2b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c103e30 0x7f5d2c19a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:45690/0 (socket says 172.21.15.40:45690) 2024-09-11T22:28:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d2b400640 1 -- 172.21.15.40:0/1894428508 learned_addr learned my addr 172.21.15.40:0/1894428508 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:34.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d2b400640 1 -- 172.21.15.40:0/1894428508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d2c108f60 msgr2=0x7f5d2c19ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:34.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d2b400640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d2c108f60 0x7f5d2c19ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d2b400640 1 -- 172.21.15.40:0/1894428508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d2c1047e0 msgr2=0x7f5d2c19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:34.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d2b400640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d2c1047e0 0x7f5d2c19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:34.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.988+0000 7f5d2b400640 1 -- 172.21.15.40:0/1894428508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c19f3d0 con 0x7f5d2c103e30 2024-09-11T22:28:34.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.989+0000 7f5d2b400640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c103e30 0x7f5d2c19a420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00e9f0 tx=0x7f5d1c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:34.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.989+0000 7f5d28c00640 1 -- 172.21.15.40:0/1894428508 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00cd80 con 0x7f5d2c103e30 2024-09-11T22:28:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.989+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c19f6c0 con 0x7f5d2c103e30 2024-09-11T22:28:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.989+0000 7f5d28c00640 1 -- 172.21.15.40:0/1894428508 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d1c010910 con 0x7f5d2c103e30 2024-09-11T22:28:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.989+0000 7f5d28c00640 1 -- 172.21.15.40:0/1894428508 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c018990 con 0x7f5d2c103e30 2024-09-11T22:28:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.989+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2c1a6fa0 con 0x7f5d2c103e30 2024-09-11T22:28:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.990+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d2c104210 con 0x7f5d2c103e30 2024-09-11T22:28:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.993+0000 7f5d28c00640 1 -- 172.21.15.40:0/1894428508 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5d1c010ac0 con 0x7f5d2c103e30 2024-09-11T22:28:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.995+0000 7f5d28c00640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d100a2b80 0x7f5d100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.995+0000 7f5d28c00640 1 -- 172.21.15.40:0/1894428508 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8770+0+0 (secure 0 0 0) 0x7f5d1c0cfa10 con 0x7f5d2c103e30 2024-09-11T22:28:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.995+0000 7f5d23e00640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d100a2b80 0x7f5d100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.995+0000 7f5d23e00640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d100a2b80 0x7f5d100a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c10a930 tx=0x7f5d1400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:33.996+0000 7f5d28c00640 1 -- 172.21.15.40:0/1894428508 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d1c09c0a0 con 0x7f5d2c103e30 2024-09-11T22:28:34.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:34.221+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f5d2c10c1a0 con 0x7f5d2c103e30 2024-09-11T22:28:34.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:34 smithi040 ceph-mon[30787]: pgmap v308: 129 pgs: 6 creating+peering, 2 unknown, 121 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T22:28:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:34 smithi177 ceph-mon[35530]: pgmap v308: 129 pgs: 6 creating+peering, 2 unknown, 121 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T22:28:34.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:34 smithi146 ceph-mon[34996]: pgmap v308: 129 pgs: 6 creating+peering, 2 unknown, 121 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T22:28:35.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.194+0000 7f5d28c00640 1 -- 172.21.15.40:0/1894428508 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f5d1c0a03a0 con 0x7f5d2c103e30 2024-09-11T22:28:35.195 INFO:teuthology.orchestra.run.smithi040.stderr:added data pool 4 to fsmap 2024-09-11T22:28:35.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d100a2b80 msgr2=0x7f5d100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:35.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d100a2b80 0x7f5d100a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c10a930 tx=0x7f5d1400b390 comp rx=0 tx=0).stop 2024-09-11T22:28:35.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c103e30 msgr2=0x7f5d2c19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:35.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c103e30 0x7f5d2c19a420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00e9f0 tx=0x7f5d1c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:35.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 shutdown_connections 2024-09-11T22:28:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5d100a2b80 0x7f5d100a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d2c108f60 0x7f5d2c19ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d2c1047e0 0x7f5d2c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 --2- 172.21.15.40:0/1894428508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c103e30 0x7f5d2c19a420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 >> 172.21.15.40:0/1894428508 conn(0x7f5d2c0ff8d0 msgr2=0x7f5d2c100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 shutdown_connections 2024-09-11T22:28:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:35.197+0000 7f5d30a00640 1 -- 172.21.15.40:0/1894428508 wait complete. 2024-09-11T22:28:35.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:35 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1894428508' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T22:28:35.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:35 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T22:28:35.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:35 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1894428508' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T22:28:35.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:35 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T22:28:35.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:35 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1894428508' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T22:28:35.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:35 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-11T22:28:36.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:36.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:36 smithi040 ceph-mon[30787]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T22:28:36.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:36 smithi040 ceph-mon[30787]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T22:28:36.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:36 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T22:28:36.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:36 smithi040 ceph-mon[30787]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:28:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:36 smithi177 ceph-mon[35530]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T22:28:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:36 smithi177 ceph-mon[35530]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T22:28:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:36 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T22:28:36.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:36 smithi177 ceph-mon[35530]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:28:36.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:36 smithi146 ceph-mon[34996]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-11T22:28:36.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:36 smithi146 ceph-mon[34996]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T22:28:36.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:36 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T22:28:36.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:36 smithi146 ceph-mon[34996]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:28:37.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.037+0000 7f5ec6c00640 1 -- 172.21.15.40:0/3594511088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 msgr2=0x7f5ec010def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.037+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/3594511088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 0x7f5ec010def0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009900 tx=0x7f5ea802a480 comp rx=0 tx=0).stop 2024-09-11T22:28:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.038+0000 7f5ec6c00640 1 -- 172.21.15.40:0/3594511088 shutdown_connections 2024-09-11T22:28:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.038+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/3594511088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec010e430 0x7f5ec0110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.038+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/3594511088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 0x7f5ec010def0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.038+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/3594511088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec00745c0 0x7f5ec00749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.038+0000 7f5ec6c00640 1 -- 172.21.15.40:0/3594511088 >> 172.21.15.40:0/3594511088 conn(0x7f5ec00fd8b0 msgr2=0x7f5ec00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.038+0000 7f5ec6c00640 1 -- 172.21.15.40:0/3594511088 shutdown_connections 2024-09-11T22:28:37.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.038+0000 7f5ec6c00640 1 -- 172.21.15.40:0/3594511088 wait complete. 2024-09-11T22:28:37.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ec6c00640 1 Processor -- start 2024-09-11T22:28:37.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ec6c00640 1 -- start start 2024-09-11T22:28:37.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ec6c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec00745c0 0x7f5ec019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ec6c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 0x7f5ec019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ec6c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec010e430 0x7f5ec019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ec6c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01141e0 con 0x7f5ec00745c0 2024-09-11T22:28:37.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ec6c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0114060 con 0x7f5ec0074ee0 2024-09-11T22:28:37.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ec6c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0114360 con 0x7f5ec010e430 2024-09-11T22:28:37.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ebfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec00745c0 0x7f5ec019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5eb7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 0x7f5ec019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5eb7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 0x7f5ec019abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:45700/0 (socket says 172.21.15.40:45700) 2024-09-11T22:28:37.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5eb7e00640 1 -- 172.21.15.40:0/484915162 learned_addr learned my addr 172.21.15.40:0/484915162 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:37.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.039+0000 7f5ebfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec00745c0 0x7f5ec019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54252/0 (socket says 172.21.15.40:54252) 2024-09-11T22:28:37.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.040+0000 7f5ec4c00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec010e430 0x7f5ec019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.040+0000 7f5ebfe00640 1 -- 172.21.15.40:0/484915162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec010e430 msgr2=0x7f5ec019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.040+0000 7f5ebfe00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec010e430 0x7f5ec019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.040+0000 7f5ebfe00640 1 -- 172.21.15.40:0/484915162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 msgr2=0x7f5ec019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.040+0000 7f5ebfe00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 0x7f5ec019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.040+0000 7f5ebfe00640 1 -- 172.21.15.40:0/484915162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec019f630 con 0x7f5ec00745c0 2024-09-11T22:28:37.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.040+0000 7f5eb7e00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 0x7f5ec019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:37.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.040+0000 7f5ebfe00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec00745c0 0x7f5ec019a680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000e9f0 tx=0x7f5eb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:37.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.040+0000 7f5ebd600640 1 -- 172.21.15.40:0/484915162 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000ccc0 con 0x7f5ec00745c0 2024-09-11T22:28:37.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.041+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec019f920 con 0x7f5ec00745c0 2024-09-11T22:28:37.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.041+0000 7f5ebd600640 1 -- 172.21.15.40:0/484915162 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eb0005020 con 0x7f5ec00745c0 2024-09-11T22:28:37.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.041+0000 7f5ebd600640 1 -- 172.21.15.40:0/484915162 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb00049e0 con 0x7f5ec00745c0 2024-09-11T22:28:37.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.041+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec01a7200 con 0x7f5ec00745c0 2024-09-11T22:28:37.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.042+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec00749a0 con 0x7f5ec00745c0 2024-09-11T22:28:37.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.044+0000 7f5ebd600640 1 -- 172.21.15.40:0/484915162 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5eb0005560 con 0x7f5ec00745c0 2024-09-11T22:28:37.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.045+0000 7f5ebd600640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ea40a2b80 0x7f5ea40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:37.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.045+0000 7f5ebd600640 1 -- 172.21.15.40:0/484915162 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f5eb00cf250 con 0x7f5ec00745c0 2024-09-11T22:28:37.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.045+0000 7f5eb7e00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ea40a2b80 0x7f5ea40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:37.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.046+0000 7f5eb7e00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ea40a2b80 0x7f5ea40a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80096c0 tx=0x7f5ea80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:37.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.049+0000 7f5ebd600640 1 -- 172.21.15.40:0/484915162 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5eb00051d0 con 0x7f5ec00745c0 2024-09-11T22:28:37.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.274+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ec0109610 con 0x7f5ec00745c0 2024-09-11T22:28:37.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.275+0000 7f5ebd600640 1 -- 172.21.15.40:0/484915162 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7f5eb009bf10 con 0x7f5ec00745c0 2024-09-11T22:28:37.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:37.276 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"btime":"2024-09-11T22:28:35:182115+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:28:34.223750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24527,"qdb_cluster":[24527]},"id":1}]} 2024-09-11T22:28:37.276 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 17 2024-09-11T22:28:37.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.277+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ea40a2b80 msgr2=0x7f5ea40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.277+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ea40a2b80 0x7f5ea40a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80096c0 tx=0x7f5ea80046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.277+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec00745c0 msgr2=0x7f5ec019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.277+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec00745c0 0x7f5ec019a680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000e9f0 tx=0x7f5eb000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.278+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 shutdown_connections 2024-09-11T22:28:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.278+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5ea40a2b80 0x7f5ea40a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.278+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec010e430 0x7f5ec019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.278+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ec0074ee0 0x7f5ec019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.278+0000 7f5ec6c00640 1 --2- 172.21.15.40:0/484915162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec00745c0 0x7f5ec019a680 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.278+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 >> 172.21.15.40:0/484915162 conn(0x7f5ec00fd8b0 msgr2=0x7f5ec00fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.278+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 shutdown_connections 2024-09-11T22:28:37.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:37.278+0000 7f5ec6c00640 1 -- 172.21.15.40:0/484915162 wait complete. 2024-09-11T22:28:37.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:37 smithi177 ceph-mon[35530]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T22:28:37.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:37 smithi177 ceph-mon[35530]: Cluster is now healthy 2024-09-11T22:28:37.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:37 smithi146 ceph-mon[34996]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T22:28:37.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:37 smithi146 ceph-mon[34996]: Cluster is now healthy 2024-09-11T22:28:37.634 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:37 smithi040 ceph-mon[30787]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T22:28:37.635 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:37 smithi040 ceph-mon[30787]: Cluster is now healthy 2024-09-11T22:28:38.159 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:28:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:38 smithi040 ceph-mon[30787]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:38 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/484915162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:38.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:38 smithi177 ceph-mon[35530]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:38.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:38 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/484915162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:38.535 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:38.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:38 smithi146 ceph-mon[34996]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:38.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:38 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/484915162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:39.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.115+0000 7f69bac00640 1 -- 172.21.15.40:0/3186541826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4106f10 msgr2=0x7f69b410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.115+0000 7f69bac00640 1 --2- 172.21.15.40:0/3186541826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4106f10 0x7f69b410ea90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009ca0 tx=0x7f69ac02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.115+0000 7f69bac00640 1 -- 172.21.15.40:0/3186541826 shutdown_connections 2024-09-11T22:28:39.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.115+0000 7f69bac00640 1 --2- 172.21.15.40:0/3186541826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4106f10 0x7f69b410ea90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.115+0000 7f69bac00640 1 --2- 172.21.15.40:0/3186541826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69b4102790 0x7f69b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.115+0000 7f69bac00640 1 --2- 172.21.15.40:0/3186541826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b4101de0 0x7f69b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.115+0000 7f69bac00640 1 -- 172.21.15.40:0/3186541826 >> 172.21.15.40:0/3186541826 conn(0x7f69b40fd8c0 msgr2=0x7f69b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:39.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.115+0000 7f69bac00640 1 -- 172.21.15.40:0/3186541826 shutdown_connections 2024-09-11T22:28:39.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.115+0000 7f69bac00640 1 -- 172.21.15.40:0/3186541826 wait complete. 2024-09-11T22:28:39.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.116+0000 7f69bac00640 1 Processor -- start 2024-09-11T22:28:39.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69bac00640 1 -- start start 2024-09-11T22:28:39.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69bac00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4101de0 0x7f69b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:39.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69bac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b4102790 0x7f69b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:39.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69bac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69b4106f10 0x7f69b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69bac00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4111fc0 con 0x7f69b4101de0 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69bac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4111e40 con 0x7f69b4102790 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69bac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4112140 con 0x7f69b4106f10 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4101de0 0x7f69b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69b3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4101de0 0x7f69b40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54268/0 (socket says 172.21.15.40:54268) 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69b3e00640 1 -- 172.21.15.40:0/2362786540 learned_addr learned my addr 172.21.15.40:0/2362786540 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69b8c00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69b4106f10 0x7f69b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.117+0000 7f69b3400640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b4102790 0x7f69b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69b3e00640 1 -- 172.21.15.40:0/2362786540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69b4106f10 msgr2=0x7f69b4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69b3e00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69b4106f10 0x7f69b4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69b3e00640 1 -- 172.21.15.40:0/2362786540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b4102790 msgr2=0x7f69b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69b3e00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b4102790 0x7f69b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69b3e00640 1 -- 172.21.15.40:0/2362786540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b41a68c0 con 0x7f69b4101de0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69b3e00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4101de0 0x7f69b40744f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69a400e9f0 tx=0x7f69a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69b0c00640 1 -- 172.21.15.40:0/2362786540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a400cd80 con 0x7f69b4101de0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b41a6bb0 con 0x7f69b4101de0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69b0c00640 1 -- 172.21.15.40:0/2362786540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a4010910 con 0x7f69b4101de0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69b0c00640 1 -- 172.21.15.40:0/2362786540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4018990 con 0x7f69b4101de0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.118+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b41a7140 con 0x7f69b4101de0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.119+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b41021c0 con 0x7f69b4101de0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.121+0000 7f69b0c00640 1 -- 172.21.15.40:0/2362786540 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f69a4010ac0 con 0x7f69b4101de0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.122+0000 7f69b0c00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69980a2c00 0x7f69980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.123+0000 7f69b0c00640 1 -- 172.21.15.40:0/2362786540 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f69a40cf550 con 0x7f69b4101de0 2024-09-11T22:28:39.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.123+0000 7f69b3400640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69980a2c00 0x7f69980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:39.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.123+0000 7f69b3400640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69980a2c00 0x7f69980a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f69b41087d0 tx=0x7f69a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:39.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.127+0000 7f69b0c00640 1 -- 172.21.15.40:0/2362786540 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69a409bbc0 con 0x7f69b4101de0 2024-09-11T22:28:39.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.316+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69b41a73e0 con 0x7f69b4101de0 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.317+0000 7f69b0c00640 1 -- 172.21.15.40:0/2362786540 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24238 (secure 0 0 0) 0x7f69a409fec0 con 0x7f69b4101de0 2024-09-11T22:28:39.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:39.319 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":91,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:28:34.223592+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:28:39.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69980a2c00 msgr2=0x7f69980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69980a2c00 0x7f69980a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f69b41087d0 tx=0x7f69a0005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4101de0 msgr2=0x7f69b40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4101de0 0x7f69b40744f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69a400e9f0 tx=0x7f69a400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 shutdown_connections 2024-09-11T22:28:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69980a2c00 0x7f69980a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69b4106f10 0x7f69b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69b4102790 0x7f69b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 --2- 172.21.15.40:0/2362786540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4101de0 0x7f69b40744f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:39.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 >> 172.21.15.40:0/2362786540 conn(0x7f69b40fd8c0 msgr2=0x7f69b40fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:39.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 shutdown_connections 2024-09-11T22:28:39.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:39.320+0000 7f69bac00640 1 -- 172.21.15.40:0/2362786540 wait complete. 2024-09-11T22:28:40.170 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:28:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:40 smithi040 ceph-mon[30787]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:40 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2362786540' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:40.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:40 smithi177 ceph-mon[35530]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:40.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:40 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2362786540' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:40.546 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:40.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:40 smithi146 ceph-mon[34996]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:40.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:40 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2362786540' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:41.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.120+0000 7ff56fc00640 1 -- 172.21.15.40:0/2973304054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff568106f10 msgr2=0x7ff56810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.120+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2973304054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff568106f10 0x7ff56810ea90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff560009ca0 tx=0x7ff56002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.120+0000 7ff56fc00640 1 -- 172.21.15.40:0/2973304054 shutdown_connections 2024-09-11T22:28:41.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.120+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2973304054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff568106f10 0x7ff56810ea90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.120+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2973304054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff568102790 0x7ff5681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.120+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2973304054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff568101de0 0x7ff5681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.120+0000 7ff56fc00640 1 -- 172.21.15.40:0/2973304054 >> 172.21.15.40:0/2973304054 conn(0x7ff5680fd8c0 msgr2=0x7ff5680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:41.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.120+0000 7ff56fc00640 1 -- 172.21.15.40:0/2973304054 shutdown_connections 2024-09-11T22:28:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.120+0000 7ff56fc00640 1 -- 172.21.15.40:0/2973304054 wait complete. 2024-09-11T22:28:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.121+0000 7ff56fc00640 1 Processor -- start 2024-09-11T22:28:41.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.121+0000 7ff56fc00640 1 -- start start 2024-09-11T22:28:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff56fc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff568101de0 0x7ff56819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff56fc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff568102790 0x7ff56819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff56fc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff568106f10 0x7ff56819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff56fc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff568111fc0 con 0x7ff568101de0 2024-09-11T22:28:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff56fc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff568111e40 con 0x7ff568106f10 2024-09-11T22:28:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff56fc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff568112140 con 0x7ff568102790 2024-09-11T22:28:41.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff55fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff568102790 0x7ff56819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff56d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff568101de0 0x7ff56819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff55fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff568102790 0x7ff56819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:39720/0 (socket says 172.21.15.40:39720) 2024-09-11T22:28:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff55fe00640 1 -- 172.21.15.40:0/2947182174 learned_addr learned my addr 172.21.15.40:0/2947182174 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff56dc00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff568106f10 0x7ff56819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff55fe00640 1 -- 172.21.15.40:0/2947182174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff568106f10 msgr2=0x7ff56819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff55fe00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff568106f10 0x7ff56819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff55fe00640 1 -- 172.21.15.40:0/2947182174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff568101de0 msgr2=0x7ff56819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff55fe00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff568101de0 0x7ff56819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.122+0000 7ff55fe00640 1 -- 172.21.15.40:0/2947182174 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56819f5a0 con 0x7ff568102790 2024-09-11T22:28:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.123+0000 7ff55fe00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff568102790 0x7ff56819ab30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff55000e9f0 tx=0x7ff55000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.123+0000 7ff566000640 1 -- 172.21.15.40:0/2947182174 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55000cd80 con 0x7ff568102790 2024-09-11T22:28:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.123+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56819f890 con 0x7ff568102790 2024-09-11T22:28:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.123+0000 7ff566000640 1 -- 172.21.15.40:0/2947182174 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff550010910 con 0x7ff568102790 2024-09-11T22:28:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.123+0000 7ff566000640 1 -- 172.21.15.40:0/2947182174 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5500188f0 con 0x7ff568102790 2024-09-11T22:28:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.123+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5681a7170 con 0x7ff568102790 2024-09-11T22:28:41.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.124+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5681021c0 con 0x7ff568102790 2024-09-11T22:28:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.126+0000 7ff566000640 1 -- 172.21.15.40:0/2947182174 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff550010ac0 con 0x7ff568102790 2024-09-11T22:28:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.127+0000 7ff566000640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff54c0a2b80 0x7ff54c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.128+0000 7ff566000640 1 -- 172.21.15.40:0/2947182174 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7ff5500cf9f0 con 0x7ff568102790 2024-09-11T22:28:41.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.128+0000 7ff56d200640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff54c0a2b80 0x7ff54c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.128+0000 7ff56d200640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff54c0a2b80 0x7ff54c0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff558009bd0 tx=0x7ff558005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:41.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.129+0000 7ff566000640 1 -- 172.21.15.40:0/2947182174 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff55009c060 con 0x7ff568102790 2024-09-11T22:28:41.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.320+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5681a74a0 con 0x7ff568102790 2024-09-11T22:28:41.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.322+0000 7ff566000640 1 -- 172.21.15.40:0/2947182174 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24238 (secure 0 0 0) 0x7ff5500a0360 con 0x7ff568102790 2024-09-11T22:28:41.323 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:41.323 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":91,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:28:34.223592+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff54c0a2b80 msgr2=0x7ff54c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff54c0a2b80 0x7ff54c0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff558009bd0 tx=0x7ff558005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff568102790 msgr2=0x7ff56819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff568102790 0x7ff56819ab30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff55000e9f0 tx=0x7ff55000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 shutdown_connections 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff54c0a2b80 0x7ff54c0a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff568106f10 0x7ff56819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff568102790 0x7ff56819ab30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 --2- 172.21.15.40:0/2947182174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff568101de0 0x7ff56819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.324+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 >> 172.21.15.40:0/2947182174 conn(0x7ff5680fd8c0 msgr2=0x7ff5680ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:41.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.325+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 shutdown_connections 2024-09-11T22:28:41.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:41.325+0000 7ff56fc00640 1 -- 172.21.15.40:0/2947182174 wait complete. 2024-09-11T22:28:42.385 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:28:42.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:42 smithi177 ceph-mon[35530]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:42.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:42 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2947182174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:42.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:42 smithi146 ceph-mon[34996]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:42.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:42 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2947182174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:42.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:42 smithi040 ceph-mon[30787]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:42.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:42 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2947182174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:42.772 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:43.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.317+0000 7f40dde00640 1 -- 172.21.15.40:0/3448679024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d8103e30 msgr2=0x7f40d8104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.317+0000 7f40dde00640 1 --2- 172.21.15.40:0/3448679024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d8103e30 0x7f40d8104210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009900 tx=0x7f40c802a410 comp rx=0 tx=0).stop 2024-09-11T22:28:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.317+0000 7f40dde00640 1 -- 172.21.15.40:0/3448679024 shutdown_connections 2024-09-11T22:28:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.317+0000 7f40dde00640 1 --2- 172.21.15.40:0/3448679024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d8108f60 0x7f40d8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.317+0000 7f40dde00640 1 --2- 172.21.15.40:0/3448679024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40d81047e0 0x7f40d8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.317+0000 7f40dde00640 1 --2- 172.21.15.40:0/3448679024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d8103e30 0x7f40d8104210 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.317+0000 7f40dde00640 1 -- 172.21.15.40:0/3448679024 >> 172.21.15.40:0/3448679024 conn(0x7f40d80ff8d0 msgr2=0x7f40d8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.317+0000 7f40dde00640 1 -- 172.21.15.40:0/3448679024 shutdown_connections 2024-09-11T22:28:43.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.317+0000 7f40dde00640 1 -- 172.21.15.40:0/3448679024 wait complete. 2024-09-11T22:28:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.318+0000 7f40dde00640 1 Processor -- start 2024-09-11T22:28:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.318+0000 7f40dde00640 1 -- start start 2024-09-11T22:28:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40dde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40d8103e30 0x7f40d819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40dde00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d81047e0 0x7f40d819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40dde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d8108f60 0x7f40d819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40dde00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8114010 con 0x7f40d81047e0 2024-09-11T22:28:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40dde00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8113e90 con 0x7f40d8103e30 2024-09-11T22:28:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40dde00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8114190 con 0x7f40d8108f60 2024-09-11T22:28:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d81047e0 0x7f40d819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40dca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40d8103e30 0x7f40d819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40cfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d81047e0 0x7f40d819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51470/0 (socket says 172.21.15.40:51470) 2024-09-11T22:28:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40cfe00640 1 -- 172.21.15.40:0/2119754435 learned_addr learned my addr 172.21.15.40:0/2119754435 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.319+0000 7f40dd400640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d8108f60 0x7f40d819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40dca00640 1 -- 172.21.15.40:0/2119754435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d8108f60 msgr2=0x7f40d819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40dca00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d8108f60 0x7f40d819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40dca00640 1 -- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d81047e0 msgr2=0x7f40d819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40dca00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d81047e0 0x7f40d819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40dca00640 1 -- 172.21.15.40:0/2119754435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d819f450 con 0x7f40d8103e30 2024-09-11T22:28:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40cfe00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d81047e0 0x7f40d819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:43.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40dca00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40d8103e30 0x7f40d819a4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f40c802a930 tx=0x7f40c8003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:43.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40d6000640 1 -- 172.21.15.40:0/2119754435 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c803f070 con 0x7f40d8103e30 2024-09-11T22:28:43.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40d6000640 1 -- 172.21.15.40:0/2119754435 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40c8031c90 con 0x7f40d8103e30 2024-09-11T22:28:43.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40d6000640 1 -- 172.21.15.40:0/2119754435 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8035030 con 0x7f40d8103e30 2024-09-11T22:28:43.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.320+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d819f6e0 con 0x7f40d8103e30 2024-09-11T22:28:43.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.321+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d81a7020 con 0x7f40d8103e30 2024-09-11T22:28:43.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.322+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d8105310 con 0x7f40d8103e30 2024-09-11T22:28:43.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.323+0000 7f40d6000640 1 -- 172.21.15.40:0/2119754435 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f40c8042070 con 0x7f40d8103e30 2024-09-11T22:28:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.324+0000 7f40d6000640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f40bc0a2b80 0x7f40bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.325+0000 7f40d6000640 1 -- 172.21.15.40:0/2119754435 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f40c80ef910 con 0x7f40d8103e30 2024-09-11T22:28:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.325+0000 7f40cfe00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f40bc0a2b80 0x7f40bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.325+0000 7f40cfe00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f40bc0a2b80 0x7f40bc0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40d80ffd60 tx=0x7f40c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:43.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.329+0000 7f40d6000640 1 -- 172.21.15.40:0/2119754435 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40c80bbf80 con 0x7f40d8103e30 2024-09-11T22:28:43.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.554+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40d810c140 con 0x7f40d8103e30 2024-09-11T22:28:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.555+0000 7f40d6000640 1 -- 172.21.15.40:0/2119754435 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7f40c80c0280 con 0x7f40d8103e30 2024-09-11T22:28:43.556 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:43.557 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"btime":"2024-09-11T22:28:35:182115+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24464,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:28:34.223750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24527,"qdb_cluster":[24527]},"id":1}]} 2024-09-11T22:28:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 17 2024-09-11T22:28:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f40bc0a2b80 msgr2=0x7f40bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f40bc0a2b80 0x7f40bc0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40d80ffd60 tx=0x7f40c0005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40d8103e30 msgr2=0x7f40d819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40d8103e30 0x7f40d819a4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f40c802a930 tx=0x7f40c8003b90 comp rx=0 tx=0).stop 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 shutdown_connections 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f40bc0a2b80 0x7f40bc0a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d8108f60 0x7f40d819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d81047e0 0x7f40d819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 --2- 172.21.15.40:0/2119754435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40d8103e30 0x7f40d819a4a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 >> 172.21.15.40:0/2119754435 conn(0x7f40d80ff8d0 msgr2=0x7f40d8100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 shutdown_connections 2024-09-11T22:28:43.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:43.558+0000 7f40dde00640 1 -- 172.21.15.40:0/2119754435 wait complete. 2024-09-11T22:28:44.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:28:44.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:44 smithi040 ceph-mon[30787]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:44.509 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:44 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2119754435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:44.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:44 smithi177 ceph-mon[35530]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:44.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:44 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2119754435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:44.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:44 smithi146 ceph-mon[34996]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:44.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:44 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2119754435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:28:44.839 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.360+0000 7f50e9200640 1 -- 172.21.15.40:0/631453956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4112a30 msgr2=0x7f50e4114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.360+0000 7f50e9200640 1 --2- 172.21.15.40:0/631453956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4112a30 0x7f50e4114e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009ca0 tx=0x7f50dc02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.360+0000 7f50e9200640 1 -- 172.21.15.40:0/631453956 shutdown_connections 2024-09-11T22:28:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.360+0000 7f50e9200640 1 --2- 172.21.15.40:0/631453956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4112a30 0x7f50e4114e20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.360+0000 7f50e9200640 1 --2- 172.21.15.40:0/631453956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4077040 0x7f50e41124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.360+0000 7f50e9200640 1 --2- 172.21.15.40:0/631453956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e4076720 0x7f50e4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.360+0000 7f50e9200640 1 -- 172.21.15.40:0/631453956 >> 172.21.15.40:0/631453956 conn(0x7f50e40ffa90 msgr2=0x7f50e4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.360+0000 7f50e9200640 1 -- 172.21.15.40:0/631453956 shutdown_connections 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.360+0000 7f50e9200640 1 -- 172.21.15.40:0/631453956 wait complete. 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.361+0000 7f50e9200640 1 Processor -- start 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.361+0000 7f50e9200640 1 -- start start 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e9200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4076720 0x7f50e41a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4077040 0x7f50e41a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e4112a30 0x7f50e419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e9200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f50e41185c0 con 0x7f50e4076720 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e9200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f50e4118440 con 0x7f50e4112a30 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e9200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f50e4118740 con 0x7f50e4077040 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4076720 0x7f50e41a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4076720 0x7f50e41a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51482/0 (socket says 172.21.15.40:51482) 2024-09-11T22:28:45.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e1e00640 1 -- 172.21.15.40:0/2783640944 learned_addr learned my addr 172.21.15.40:0/2783640944 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e1400640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4077040 0x7f50e41a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e2800640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e4112a30 0x7f50e419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e1e00640 1 -- 172.21.15.40:0/2783640944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4077040 msgr2=0x7f50e41a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e1e00640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4077040 0x7f50e41a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e1e00640 1 -- 172.21.15.40:0/2783640944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e4112a30 msgr2=0x7f50e419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e1e00640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e4112a30 0x7f50e419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.362+0000 7f50e1e00640 1 -- 172.21.15.40:0/2783640944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e419efc0 con 0x7f50e4076720 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.363+0000 7f50e1e00640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4076720 0x7f50e41a46d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f50d400e9f0 tx=0x7f50d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.363+0000 7f50daa00640 1 -- 172.21.15.40:0/2783640944 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d400cd80 con 0x7f50e4076720 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.363+0000 7f50daa00640 1 -- 172.21.15.40:0/2783640944 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50d4010910 con 0x7f50e4076720 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.363+0000 7f50daa00640 1 -- 172.21.15.40:0/2783640944 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4018990 con 0x7f50e4076720 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.363+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e419f2b0 con 0x7f50e4076720 2024-09-11T22:28:45.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.363+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e41ab5a0 con 0x7f50e4076720 2024-09-11T22:28:45.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.364+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e4076b00 con 0x7f50e4076720 2024-09-11T22:28:45.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.366+0000 7f50daa00640 1 -- 172.21.15.40:0/2783640944 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f50d4010ac0 con 0x7f50e4076720 2024-09-11T22:28:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.368+0000 7f50daa00640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f50c80a2c00 0x7f50c80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.369+0000 7f50daa00640 1 -- 172.21.15.40:0/2783640944 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f50d40cf550 con 0x7f50e4076720 2024-09-11T22:28:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.369+0000 7f50e1400640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f50c80a2c00 0x7f50c80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:45.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.369+0000 7f50e1400640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f50c80a2c00 0x7f50c80a50c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50e4079290 tx=0x7f50d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:45.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.373+0000 7f50daa00640 1 -- 172.21.15.40:0/2783640944 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50d409bbc0 con 0x7f50e4076720 2024-09-11T22:28:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.558+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50e410d630 con 0x7f50e4076720 2024-09-11T22:28:45.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.560+0000 7f50daa00640 1 -- 172.21.15.40:0/2783640944 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24238 (secure 0 0 0) 0x7f50d409fec0 con 0x7f50e4076720 2024-09-11T22:28:45.561 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:45.562 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":91,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:28:34.223592+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:28:45.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.563+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f50c80a2c00 msgr2=0x7f50c80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:45.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.563+0000 7f50e9200640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f50c80a2c00 0x7f50c80a50c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50e4079290 tx=0x7f50d0005f90 comp rx=0 tx=0).stop 2024-09-11T22:28:45.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.563+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4076720 msgr2=0x7f50e41a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:45.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.563+0000 7f50e9200640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4076720 0x7f50e41a46d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f50d400e9f0 tx=0x7f50d400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.564+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 shutdown_connections 2024-09-11T22:28:45.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.564+0000 7f50e9200640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f50c80a2c00 0x7f50c80a50c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.564+0000 7f50e9200640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e4112a30 0x7f50e419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.564+0000 7f50e9200640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e4077040 0x7f50e41a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.564+0000 7f50e9200640 1 --2- 172.21.15.40:0/2783640944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e4076720 0x7f50e41a46d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:45.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.564+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 >> 172.21.15.40:0/2783640944 conn(0x7f50e40ffa90 msgr2=0x7f50e4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:45.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.564+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 shutdown_connections 2024-09-11T22:28:45.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:45.564+0000 7f50e9200640 1 -- 172.21.15.40:0/2783640944 wait complete. 2024-09-11T22:28:46.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:28:22.255886+0000', 'modified': '2024-09-11T22:28:34.223750+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24527}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.146:6839/2365077357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 2365077357}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 2365077357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24527, 'qdb_cluster': [24527]} 2024-09-11T22:28:46.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:28:46.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T22:28:46.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:46 smithi177 ceph-mon[35530]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:46.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:46 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2783640944' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:46.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:46 smithi146 ceph-mon[34996]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:46.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:46 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2783640944' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:46.684 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:46 smithi040 ceph-mon[30787]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:46.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:46 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2783640944' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:28:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.210+0000 7f2ef3800640 1 -- 172.21.15.40:0/2857225347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eec112b90 msgr2=0x7f2eec114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.210+0000 7f2ef3800640 1 --2- 172.21.15.40:0/2857225347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eec112b90 0x7f2eec114f80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009ca0 tx=0x7f2ee402a950 comp rx=0 tx=0).stop 2024-09-11T22:28:47.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.211+0000 7f2ef3800640 1 -- 172.21.15.40:0/2857225347 shutdown_connections 2024-09-11T22:28:47.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.211+0000 7f2ef3800640 1 --2- 172.21.15.40:0/2857225347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eec112b90 0x7f2eec114f80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.211+0000 7f2ef3800640 1 --2- 172.21.15.40:0/2857225347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eec074eb0 0x7f2eec112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.211+0000 7f2ef3800640 1 --2- 172.21.15.40:0/2857225347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eec074590 0x7f2eec074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.211+0000 7f2ef3800640 1 -- 172.21.15.40:0/2857225347 >> 172.21.15.40:0/2857225347 conn(0x7f2eec0fd8c0 msgr2=0x7f2eec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:47.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.211+0000 7f2ef3800640 1 -- 172.21.15.40:0/2857225347 shutdown_connections 2024-09-11T22:28:47.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.211+0000 7f2ef3800640 1 -- 172.21.15.40:0/2857225347 wait complete. 2024-09-11T22:28:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.212+0000 7f2ef3800640 1 Processor -- start 2024-09-11T22:28:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.212+0000 7f2ef3800640 1 -- start start 2024-09-11T22:28:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.212+0000 7f2ef3800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eec074590 0x7f2eec1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.212+0000 7f2ef3800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eec074eb0 0x7f2eec1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.212+0000 7f2ef3800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eec112b90 0x7f2eec19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.212+0000 7f2ef3800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec1185a0 con 0x7f2eec074eb0 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.212+0000 7f2ef3800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec118420 con 0x7f2eec074590 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.212+0000 7f2ef3800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2eec118720 con 0x7f2eec112b90 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ee3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eec074eb0 0x7f2eec1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eec074590 0x7f2eec1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eec074590 0x7f2eec1a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:43752/0 (socket says 172.21.15.40:43752) 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef0e00640 1 -- 172.21.15.40:0/698525123 learned_addr learned my addr 172.21.15.40:0/698525123 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef1800640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eec112b90 0x7f2eec19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef0e00640 1 -- 172.21.15.40:0/698525123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eec112b90 msgr2=0x7f2eec19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef0e00640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eec112b90 0x7f2eec19e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef0e00640 1 -- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eec074eb0 msgr2=0x7f2eec1a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef0e00640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eec074eb0 0x7f2eec1a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef0e00640 1 -- 172.21.15.40:0/698525123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eec19efc0 con 0x7f2eec074590 2024-09-11T22:28:47.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eec074eb0 0x7f2eec1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:47.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.213+0000 7f2ef0e00640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eec074590 0x7f2eec1a46d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00d950 tx=0x7f2edc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:47.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.214+0000 7f2eea000640 1 -- 172.21.15.40:0/698525123 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc017070 con 0x7f2eec074590 2024-09-11T22:28:47.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.214+0000 7f2ef3800640 1 -- 172.21.15.40:0/698525123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eec19f2b0 con 0x7f2eec074590 2024-09-11T22:28:47.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.214+0000 7f2eea000640 1 -- 172.21.15.40:0/698525123 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2edc009c30 con 0x7f2eec074590 2024-09-11T22:28:47.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.214+0000 7f2eea000640 1 -- 172.21.15.40:0/698525123 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00f6b0 con 0x7f2eec074590 2024-09-11T22:28:47.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.214+0000 7f2ef3800640 1 -- 172.21.15.40:0/698525123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eec1ab5a0 con 0x7f2eec074590 2024-09-11T22:28:47.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.217+0000 7f2ef61db740 1 Processor -- start 2024-09-11T22:28:47.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.217+0000 7f2ef61db740 1 -- start start 2024-09-11T22:28:47.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.217+0000 7f2eea000640 1 -- 172.21.15.40:0/698525123 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2edc0109d0 con 0x7f2eec074590 2024-09-11T22:28:47.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.217+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426db330 0x55dc426db710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.217+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426dbc50 0x55dc426e5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.217+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.217+0000 7f2ef61db740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55dc426410b0 con 0x55dc426e6510 2024-09-11T22:28:47.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.217+0000 7f2ef61db740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dc425e8ab0 con 0x55dc426dbc50 2024-09-11T22:28:47.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.217+0000 7f2ef61db740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc4263d070 con 0x55dc426db330 2024-09-11T22:28:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ef0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426dbc50 0x55dc426e5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ef1800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426db330 0x55dc426db710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ee3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ef1800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426db330 0x55dc426db710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:57872/0 (socket says 172.21.15.40:57872) 2024-09-11T22:28:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ef1800640 1 -- 172.21.15.40:0/2434829220 learned_addr learned my addr 172.21.15.40:0/2434829220 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:47.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ef1800640 1 -- 172.21.15.40:0/2434829220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426dbc50 msgr2=0x55dc426e5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:47.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ef1800640 1 --2- 172.21.15.40:0/2434829220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426dbc50 0x55dc426e5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ef1800640 1 -- 172.21.15.40:0/2434829220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 msgr2=0x55dc426e8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:47.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ef1800640 1 --2- 172.21.15.40:0/2434829220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.218+0000 7f2ef1800640 1 -- 172.21.15.40:0/2434829220 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc425f54a0 con 0x55dc426db330 2024-09-11T22:28:47.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.219+0000 7f2ef1800640 1 --2- 172.21.15.40:0/2434829220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426db330 0x55dc426db710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009ca0 tx=0x7f2ee402f450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ed5fa0c08d02567 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:47.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.219+0000 7f2eea000640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2ed00a2c00 0x7f2ed00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.219+0000 7f2ee2000640 1 -- 172.21.15.40:0/2434829220 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4048070 con 0x55dc426db330 2024-09-11T22:28:47.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.219+0000 7f2eea000640 1 -- 172.21.15.40:0/698525123 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f2edc0cee30 con 0x7f2eec074590 2024-09-11T22:28:47.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.219+0000 7f2ef0e00640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2ed00a2c00 0x7f2ed00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.219+0000 7f2ee2000640 1 -- 172.21.15.40:0/2434829220 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ee4003e50 con 0x55dc426db330 2024-09-11T22:28:47.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.219+0000 7f2ee2000640 1 -- 172.21.15.40:0/2434829220 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4034040 con 0x55dc426db330 2024-09-11T22:28:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef61db740 1 -- 172.21.15.40:0/2434829220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426db330 msgr2=0x55dc426db710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef0e00640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2ed00a2c00 0x7f2ed00a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0a3b30 tx=0x7f2edc0d2870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef61db740 1 --2- 172.21.15.40:0/2434829220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426db330 0x55dc426db710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009ca0 tx=0x7f2ee402f450 comp rx=0 tx=0).stop 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef61db740 1 -- 172.21.15.40:0/2434829220 shutdown_connections 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef61db740 1 --2- 172.21.15.40:0/2434829220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef61db740 1 --2- 172.21.15.40:0/2434829220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426dbc50 0x55dc426e5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef61db740 1 --2- 172.21.15.40:0/2434829220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426db330 0x55dc426db710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef61db740 1 -- 172.21.15.40:0/2434829220 >> 172.21.15.40:0/2434829220 conn(0x55dc426d78c0 msgr2=0x55dc426d7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef61db740 1 -- 172.21.15.40:0/2434829220 shutdown_connections 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.220+0000 7f2ef61db740 1 -- 172.21.15.40:0/2434829220 wait complete. 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.221+0000 7f2ef61db740 1 -- start start 2024-09-11T22:28:47.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.221+0000 7f2ef61db740 1 Processor -- start 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc426e35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef61db740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55dc426e9060 con 0x55dc426e6510 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef61db740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dc425c9920 con 0x55dc426db330 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef61db740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc426e91e0 con 0x55dc426dbc50 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef61db740 10 client.0 _ll_register_callbacks cb 0x55dc425ed8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ee3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ee3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:57876/0 (socket says 172.21.15.40:57876) 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ee3e00640 1 -- 172.21.15.40:0/3676337861 learned_addr learned my addr 172.21.15.40:0/3676337861 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef1800640 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc426e35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef1800640 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ee3e00640 1 -- 172.21.15.40:0/3676337861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 msgr2=0x55dc426e35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc426e35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ee3e00640 1 -- 172.21.15.40:0/3676337861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 msgr2=0x55dc426e4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ee3e00640 1 -- 172.21.15.40:0/3676337861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc423b22b0 con 0x55dc426dbc50 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.222+0000 7f2ef1800640 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.223+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e3af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4011760 tx=0x7f2ed4011c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca678cb17ef0dfea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.223+0000 7f2edaa00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.223+0000 7f2edaa00640 1 -- 172.21.15.40:0/3676337861 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4010c00 con 0x55dc426dbc50 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.223+0000 7f2ef61db740 1 -- 172.21.15.40:0/3676337861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ee4003e50 con 0x55dc426dbc50 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.223+0000 7f2edaa00640 1 -- 172.21.15.40:0/3676337861 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f2ed4010da0 con 0x55dc426dbc50 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.223+0000 7f2edaa00640 1 -- 172.21.15.40:0/3676337861 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2ed4004020 con 0x55dc426dbc50 2024-09-11T22:28:47.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.223+0000 7f2ef61db740 10 client.24640 fetch_fsmap learned FSMap version 17 2024-09-11T22:28:47.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.223+0000 7f2ef61db740 1 -- 172.21.15.40:0/3676337861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55dc426f4e90 con 0x55dc426dbc50 2024-09-11T22:28:47.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.224+0000 7f2edaa00640 1 -- 172.21.15.40:0/3676337861 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ee4003e50 con 0x55dc426dbc50 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.224+0000 7f2edaa00640 1 -- 172.21.15.40:0/3676337861 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f2ed4020430 con 0x55dc426dbc50 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.224+0000 7f2ef61db740 10 client.24640 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.224+0000 7f2ef61db740 10 client.24640 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.224+0000 7f2ef61db740 20 client.24640 populate_metadata read hostname 'smithi040' 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.224+0000 7f2ef61db740 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55dc426f7570 0x55dc426f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.224+0000 7f2ef61db740 4 client.24640 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.224+0000 7f2ef61db740 1 -- 172.21.15.40:0/3676337861 --> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc4264e620 con 0x55dc426f7570 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.225+0000 7f2ef1800640 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55dc426f7570 0x55dc426f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.225+0000 7f2ef1800640 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55dc426f7570 0x55dc426f89e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7fbb698fd4efeb server_cookie=6672b5d9d0388eb3 in_seq=0 out_seq=0 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.225+0000 7f2edaa00640 10 client.24640 ms_handle_connect on v2:172.21.15.146:6838/2365077357 2024-09-11T22:28:47.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.226+0000 7f2edaa00640 1 -- 172.21.15.40:0/3676337861 <== mds.0 v2:172.21.15.146:6838/2365077357 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc4264e620 con 0x55dc426f7570 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.226+0000 7f2edaa00640 10 client.24640 handle_command_reply: tid=0 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.226+0000 7f2ef61db740 1 client.24640 shutdown 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 -- 172.21.15.40:0/3676337861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 msgr2=0x55dc426e3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e3af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4011760 tx=0x7f2ed4011c20 comp rx=0 tx=0).stop 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 -- 172.21.15.40:0/3676337861 shutdown_connections 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e3af0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55dc426f7570 0x55dc426f89e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 --2- 172.21.15.40:0/3676337861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc426e35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2edaa00640 0 client.24640 ms_handle_reset on v2:172.21.15.146:6838/2365077357 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 -- 172.21.15.40:0/3676337861 >> 172.21.15.40:0/3676337861 conn(0x55dc426d78c0 msgr2=0x55dc426dd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 -- 172.21.15.40:0/3676337861 shutdown_connections 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 1 -- 172.21.15.40:0/3676337861 wait complete. 2024-09-11T22:28:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.227+0000 7f2ef61db740 20 client.24640 trim_cache size 0 max 16384 2024-09-11T22:28:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.246+0000 7f2ef61db740 1 Processor -- start 2024-09-11T22:28:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.246+0000 7f2ef61db740 1 -- start start 2024-09-11T22:28:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.246+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc426e4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.246+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.246+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.246+0000 7f2ef61db740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55dc426f6d20 con 0x55dc426e6510 2024-09-11T22:28:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.246+0000 7f2ef61db740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dc426f73f0 con 0x55dc426db330 2024-09-11T22:28:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.246+0000 7f2ef61db740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc426f7ac0 con 0x55dc426dbc50 2024-09-11T22:28:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ef1800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ef1800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51532/0 (socket says 172.21.15.40:51532) 2024-09-11T22:28:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ef1800640 1 -- 172.21.15.40:0/1437669489 learned_addr learned my addr 172.21.15.40:0/1437669489 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ef1800640 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc426e4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ee3e00640 1 -- 172.21.15.40:0/1437669489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 msgr2=0x55dc426e4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc426e4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ee3e00640 1 -- 172.21.15.40:0/1437669489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 msgr2=0x55dc426e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ee3e00640 1 -- 172.21.15.40:0/1437669489 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc426dba80 con 0x55dc426dbc50 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ef1800640 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.247+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e5350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40208a0 tx=0x7f2ed4010880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd51d52599bcde5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.248+0000 7f2ee1600640 1 -- 172.21.15.40:0/1437669489 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed402d070 con 0x55dc426dbc50 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.248+0000 7f2ee1600640 1 -- 172.21.15.40:0/1437669489 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed4005520 con 0x55dc426dbc50 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.248+0000 7f2ee1600640 1 -- 172.21.15.40:0/1437669489 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4010e60 con 0x55dc426dbc50 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.248+0000 7f2ef61db740 1 -- 172.21.15.40:0/1437669489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 msgr2=0x55dc426e5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.248+0000 7f2ef61db740 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e5350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40208a0 tx=0x7f2ed4010880 comp rx=0 tx=0).stop 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.249+0000 7f2ef61db740 1 -- 172.21.15.40:0/1437669489 shutdown_connections 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.249+0000 7f2ef61db740 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426e6510 0x55dc426e5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.249+0000 7f2ef61db740 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426dbc50 0x55dc426e5350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.249+0000 7f2ef61db740 1 --2- 172.21.15.40:0/1437669489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc426e4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.249+0000 7f2ef61db740 1 -- 172.21.15.40:0/1437669489 >> 172.21.15.40:0/1437669489 conn(0x55dc426d78c0 msgr2=0x55dc426d7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.249+0000 7f2ef61db740 1 -- 172.21.15.40:0/1437669489 shutdown_connections 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.249+0000 7f2ef61db740 1 -- 172.21.15.40:0/1437669489 wait complete. 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.249+0000 7f2ef61db740 1 -- start start 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.249+0000 7f2ef61db740 1 Processor -- start 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc42701490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426dbc50 0x55dc426e0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef61db740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426e6510 0x55dc426e0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef61db740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55dc426f8860 con 0x55dc426dbc50 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef61db740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dc426f8190 con 0x55dc426db330 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef61db740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc426f8f30 con 0x55dc426e6510 2024-09-11T22:28:47.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef61db740 10 client.0 _ll_register_callbacks cb 0x7f2ed400bed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:28:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc42701490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ee3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426dbc50 0x55dc426e0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef1800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc42701490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:43776/0 (socket says 172.21.15.40:43776) 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef1800640 1 -- 172.21.15.40:0/384394882 learned_addr learned my addr 172.21.15.40:0/384394882 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.250+0000 7f2ef1800640 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426e6510 0x55dc426e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2ef1800640 1 -- 172.21.15.40:0/384394882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426e6510 msgr2=0x55dc426e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2ef1800640 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426e6510 0x55dc426e0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2ef1800640 1 -- 172.21.15.40:0/384394882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426dbc50 msgr2=0x55dc426e0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2ef1800640 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426dbc50 0x55dc426e0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2ef1800640 1 -- 172.21.15.40:0/384394882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc426e1150 con 0x55dc426db330 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2ef1800640 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc42701490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4046040 tx=0x7f2ee4005df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91cc456f2c96402e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2edaa00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2edaa00640 1 -- 172.21.15.40:0/384394882 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4048040 con 0x55dc426db330 2024-09-11T22:28:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2ef61db740 1 -- 172.21.15.40:0/384394882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ed4005520 con 0x55dc426db330 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.251+0000 7f2edaa00640 1 -- 172.21.15.40:0/384394882 <== mon.2 v2:172.21.15.146:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f2ee402f940 con 0x55dc426db330 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2edaa00640 1 -- 172.21.15.40:0/384394882 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2ee402c020 con 0x55dc426db330 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2ef61db740 10 client.24626 fetch_fsmap learned FSMap version 17 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2ef61db740 1 -- 172.21.15.40:0/384394882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55dc42761d40 con 0x55dc426db330 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2edaa00640 1 -- 172.21.15.40:0/384394882 <== mon.2 v2:172.21.15.146:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed4005520 con 0x55dc426db330 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2edaa00640 1 -- 172.21.15.40:0/384394882 <== mon.2 v2:172.21.15.146:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f2ee404f040 con 0x55dc426db330 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2ef61db740 10 client.24626 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2ef61db740 10 client.24626 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2ef61db740 20 client.24626 populate_metadata read hostname 'smithi040' 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2ef61db740 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55dc42766510 0x55dc42765220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2ef61db740 4 client.24626 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.252+0000 7f2ef61db740 1 -- 172.21.15.40:0/384394882 --> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] -- command(tid 0: {"prefix": "status"}) -- 0x55dc42648b30 con 0x55dc42766510 2024-09-11T22:28:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.253+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55dc42766510 0x55dc42765220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.253+0000 7f2ee3e00640 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55dc42766510 0x55dc42765220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c7b81180ed74a8 server_cookie=37190237b95e0801 in_seq=0 out_seq=0 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.253+0000 7f2edaa00640 10 client.24626 ms_handle_connect on v2:172.21.15.146:6838/2365077357 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.253+0000 7f2edaa00640 1 -- 172.21.15.40:0/384394882 <== mds.0 v2:172.21.15.146:6838/2365077357 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55dc42648b30 con 0x55dc42766510 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.253+0000 7f2edaa00640 10 client.24626 handle_command_reply: tid=0 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.253+0000 7f2ef61db740 1 client.24626 shutdown 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 -- 172.21.15.40:0/384394882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 msgr2=0x55dc42701490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc42701490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4046040 tx=0x7f2ee4005df0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 -- 172.21.15.40:0/384394882 shutdown_connections 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dc426e6510 0x55dc426e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dc426dbc50 0x55dc426e0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55dc42766510 0x55dc42765220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 --2- 172.21.15.40:0/384394882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dc426db330 0x55dc42701490 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2edaa00640 0 client.24626 ms_handle_reset on v2:172.21.15.146:6838/2365077357 2024-09-11T22:28:47.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 -- 172.21.15.40:0/384394882 >> 172.21.15.40:0/384394882 conn(0x55dc426d78c0 msgr2=0x55dc426e4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 -- 172.21.15.40:0/384394882 shutdown_connections 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 1 -- 172.21.15.40:0/384394882 wait complete. 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.254+0000 7f2ef61db740 20 client.24626 trim_cache size 0 max 16384 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24527, 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-11T22:28:47.259 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-11T22:28:47.260 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 24.131685885, 2024-09-11T22:28:47.260 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 17, 2024-09-11T22:28:47.260 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 91, 2024-09-11T22:28:47.260 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 91, 2024-09-11T22:28:47.260 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 39.476611628999997 2024-09-11T22:28:47.260 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 -- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2ed00a2c00 msgr2=0x7f2ed00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2ed00a2c00 0x7f2ed00a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0a3b30 tx=0x7f2edc0d2870 comp rx=0 tx=0).stop 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 -- 172.21.15.40:0/698525123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eec074590 msgr2=0x7f2eec1a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eec074590 0x7f2eec1a46d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00d950 tx=0x7f2edc00de10 comp rx=0 tx=0).stop 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 -- 172.21.15.40:0/698525123 shutdown_connections 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2ed00a2c00 0x7f2ed00a50c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eec112b90 0x7f2eec19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2eec074eb0 0x7f2eec1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 --2- 172.21.15.40:0/698525123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2eec074590 0x7f2eec1a46d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 -- 172.21.15.40:0/698525123 >> 172.21.15.40:0/698525123 conn(0x7f2eec0fd8c0 msgr2=0x7f2eec0fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:47.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 -- 172.21.15.40:0/698525123 shutdown_connections 2024-09-11T22:28:47.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:47.255+0000 7f2ef3800640 1 -- 172.21.15.40:0/698525123 wait complete. 2024-09-11T22:28:48.051 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:28:48.052 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:28:48.052 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T22:28:48.430 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:48.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:48 smithi040 ceph-mon[30787]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:48.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:48 smithi177 ceph-mon[35530]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:48.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:48 smithi146 ceph-mon[34996]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:48.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.977+0000 7f73ed800640 1 -- 172.21.15.40:0/1347972622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e810e3c0 msgr2=0x7f73e8110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:48.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.977+0000 7f73ed800640 1 --2- 172.21.15.40:0/1347972622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e810e3c0 0x7f73e8110810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009ca0 tx=0x7f73e002a950 comp rx=0 tx=0).stop 2024-09-11T22:28:48.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.977+0000 7f73ed800640 1 -- 172.21.15.40:0/1347972622 shutdown_connections 2024-09-11T22:28:48.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.977+0000 7f73ed800640 1 --2- 172.21.15.40:0/1347972622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e810e3c0 0x7f73e8110810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:48.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.977+0000 7f73ed800640 1 --2- 172.21.15.40:0/1347972622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e8074f40 0x7f73e810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:48.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.977+0000 7f73ed800640 1 --2- 172.21.15.40:0/1347972622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73e8074620 0x7f73e8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:48.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.977+0000 7f73ed800640 1 -- 172.21.15.40:0/1347972622 >> 172.21.15.40:0/1347972622 conn(0x7f73e80fd8c0 msgr2=0x7f73e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:48.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.977+0000 7f73ed800640 1 -- 172.21.15.40:0/1347972622 shutdown_connections 2024-09-11T22:28:48.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.978+0000 7f73ed800640 1 -- 172.21.15.40:0/1347972622 wait complete. 2024-09-11T22:28:48.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.978+0000 7f73ed800640 1 Processor -- start 2024-09-11T22:28:48.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73ed800640 1 -- start start 2024-09-11T22:28:48.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73ed800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73e8074620 0x7f73e819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:48.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73ed800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8074f40 0x7f73e819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:48.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73ed800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e810e3c0 0x7f73e819ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73ed800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f73e8114150 con 0x7f73e8074f40 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73ed800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f73e8113fd0 con 0x7f73e810e3c0 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73ed800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81142d0 con 0x7f73e8074620 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73dfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8074f40 0x7f73e819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73dfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8074f40 0x7f73e819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51560/0 (socket says 172.21.15.40:51560) 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73dfe00640 1 -- 172.21.15.40:0/1145735240 learned_addr learned my addr 172.21.15.40:0/1145735240 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.979+0000 7f73e6a00640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73e8074620 0x7f73e819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.980+0000 7f73e7400640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e810e3c0 0x7f73e819ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.980+0000 7f73dfe00640 1 -- 172.21.15.40:0/1145735240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73e8074620 msgr2=0x7f73e819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.980+0000 7f73dfe00640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73e8074620 0x7f73e819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.980+0000 7f73dfe00640 1 -- 172.21.15.40:0/1145735240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e810e3c0 msgr2=0x7f73e819ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:48.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.980+0000 7f73dfe00640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e810e3c0 0x7f73e819ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:48.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.980+0000 7f73dfe00640 1 -- 172.21.15.40:0/1145735240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e819f4e0 con 0x7f73e8074f40 2024-09-11T22:28:48.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.980+0000 7f73dfe00640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8074f40 0x7f73e819aa70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f73d000c920 tx=0x7f73d000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:48.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.980+0000 7f73df400640 1 -- 172.21.15.40:0/1145735240 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0007bb0 con 0x7f73e8074f40 2024-09-11T22:28:48.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.981+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e819f7d0 con 0x7f73e8074f40 2024-09-11T22:28:48.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.981+0000 7f73df400640 1 -- 172.21.15.40:0/1145735240 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73d0007d50 con 0x7f73e8074f40 2024-09-11T22:28:48.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.981+0000 7f73df400640 1 -- 172.21.15.40:0/1145735240 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0018780 con 0x7f73e8074f40 2024-09-11T22:28:48.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.981+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e81a70b0 con 0x7f73e8074f40 2024-09-11T22:28:48.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.982+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e8074a00 con 0x7f73e8074f40 2024-09-11T22:28:48.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.984+0000 7f73df400640 1 -- 172.21.15.40:0/1145735240 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f73d000f450 con 0x7f73e8074f40 2024-09-11T22:28:48.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.985+0000 7f73df400640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f73cc0a2c00 0x7f73cc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:48.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.985+0000 7f73df400640 1 -- 172.21.15.40:0/1145735240 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f73d00cf550 con 0x7f73e8074f40 2024-09-11T22:28:48.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.985+0000 7f73e6a00640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f73cc0a2c00 0x7f73cc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:48.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.986+0000 7f73e6a00640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f73cc0a2c00 0x7f73cc0a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f73d800abe0 tx=0x7f73d800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:48.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:48.988+0000 7f73df400640 1 -- 172.21.15.40:0/1145735240 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73d0014030 con 0x7f73e8074f40 2024-09-11T22:28:49.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.208+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f73e819b890 con 0x7f73e8074f40 2024-09-11T22:28:49.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.208+0000 7f73df400640 1 -- 172.21.15.40:0/1145735240 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f73e819b890 con 0x7f73e8074f40 2024-09-11T22:28:49.209 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T22:28:49.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.210+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f73cc0a2c00 msgr2=0x7f73cc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.210+0000 7f73ed800640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f73cc0a2c00 0x7f73cc0a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f73d800abe0 tx=0x7f73d800a2d0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.210+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8074f40 msgr2=0x7f73e819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.210+0000 7f73ed800640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8074f40 0x7f73e819aa70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f73d000c920 tx=0x7f73d000cd20 comp rx=0 tx=0).stop 2024-09-11T22:28:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.211+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 shutdown_connections 2024-09-11T22:28:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.211+0000 7f73ed800640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f73cc0a2c00 0x7f73cc0a50c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.211+0000 7f73ed800640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e810e3c0 0x7f73e819ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.211+0000 7f73ed800640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73e8074f40 0x7f73e819aa70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.211+0000 7f73ed800640 1 --2- 172.21.15.40:0/1145735240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73e8074620 0x7f73e819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.211+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 >> 172.21.15.40:0/1145735240 conn(0x7f73e80fd8c0 msgr2=0x7f73e80fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.211+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 shutdown_connections 2024-09-11T22:28:49.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:49.211+0000 7f73ed800640 1 -- 172.21.15.40:0/1145735240 wait complete. 2024-09-11T22:28:49.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:49 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1145735240' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:28:49.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:49 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1145735240' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:28:49.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:49 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1145735240' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:28:50.007 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:28:50.007 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:28:50.008 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-11T22:28:50.008 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-11T22:28:50.008 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:28:50.008 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:28:50.008 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:28:50.008 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:28:50.008 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T22:28:50.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:50.008 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-11T22:28:50.044 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42179sec preferred_lft 42179sec 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-11T22:28:50.045 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-11T22:28:50.047 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T22:28:50.047 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:50.047 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:28:50.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-09-11T22:28:50.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-09-11T22:28:50.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-09-11T22:28:50.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T22:28:50.047 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:28:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:28:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:50.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:50.462 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:28:50.519 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-11T22:28:50.520 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:50 smithi040 ceph-mon[30787]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:50.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:50.524 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-11T22:28:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:50 smithi177 ceph-mon[35530]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:50.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:50 smithi146 ceph-mon[34996]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:50.597 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-11T22:28:50.598 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:28:50.598 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:28:50.598 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:28:50.598 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:28:50.598 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:50.599 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:28:50.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:28:50.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:28:50.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:28:50.599 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:28:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:28:51.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:51.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:51.181 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-11T22:28:51.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:51.218 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-09-11T22:28:51.294 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:51.294 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:28:51.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:28:51.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-11T22:28:51.294 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:28:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:28:51.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:51.476 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-11T22:28:51.476 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:51.476 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:28:51.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-11T22:28:51.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T22:28:51.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-11T22:28:51.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-11T22:28:51.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-11T22:28:51.477 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:28:51.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:28:51.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:51.723 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:28:51.723 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:28:51.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-09-11T22:28:51.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T22:28:51.723 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:28:51.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:28:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:51.918 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-11T22:28:51.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:28:51.919 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:28:51.957 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T22:28:51.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:28:51.957 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:28:52.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T22:28:52.137 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T22:28:52.174 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T22:28:52.175 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T22:28:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/745a20e47ca21f844770ebfa5e3714000453a1e467614ce7b31de01e7977ba14/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/2b15102fd82bb31882d8fc968f888c913e924ba4900ecf4fdb1b85fa0ad50342/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/0 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/5dbf052e07fe98ed0be842df3da8632e0dfb156713fce09a7ca0710c7087231b/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/3725a091a3ff281b16c71b29e5d83caa2f5cceebf9e636b306f8976a48e49750/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/4c0a1de190bbd04013d50d9f816f401cd71b9a3470a4df1129f2a4f8c648bc7a/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/8c2d5c3f2a368e6a7223187e2fb68e77f51797ddf0c00dfb82703b02b804df30/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/5dfcc0ad61610431fdd672178f8ee1a1163ca9705feac1076cb63d00bb216bad/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/f27a11954b7ee7da9ac3f2f00d8f5602bb8d6856d363fbd2e32b5fa2ced37d9a/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/210826263e31bc2053170eb0d37bbee9cdcac6adb99212f76559190e151d1e79/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/3bb709d5dc4250fcfc33add474e8b28578fe273e1d1b9de521ae094e452bd563/merged 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T22:28:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:28:52.178 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:28:52.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:52.179 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T22:28:52.255 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T22:28:52.255 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-11T22:28:52.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T22:28:52.359 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T22:28:52.379 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:52 smithi040 ceph-mon[30787]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:52.396 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T22:28:52.396 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T22:28:52.397 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/745a20e47ca21f844770ebfa5e3714000453a1e467614ce7b31de01e7977ba14/merged 2024-09-11T22:28:52.398 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/2b15102fd82bb31882d8fc968f888c913e924ba4900ecf4fdb1b85fa0ad50342/merged 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/0 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/5dbf052e07fe98ed0be842df3da8632e0dfb156713fce09a7ca0710c7087231b/merged 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/3725a091a3ff281b16c71b29e5d83caa2f5cceebf9e636b306f8976a48e49750/merged 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/4c0a1de190bbd04013d50d9f816f401cd71b9a3470a4df1129f2a4f8c648bc7a/merged 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/8c2d5c3f2a368e6a7223187e2fb68e77f51797ddf0c00dfb82703b02b804df30/merged 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/5dfcc0ad61610431fdd672178f8ee1a1163ca9705feac1076cb63d00bb216bad/merged 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/f27a11954b7ee7da9ac3f2f00d8f5602bb8d6856d363fbd2e32b5fa2ced37d9a/merged 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/210826263e31bc2053170eb0d37bbee9cdcac6adb99212f76559190e151d1e79/merged 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/3bb709d5dc4250fcfc33add474e8b28578fe273e1d1b9de521ae094e452bd563/merged 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:28:52.399 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:28:52.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:52.401 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T22:28:52.485 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:2024-09-11T22:28:52.483+0000 7ff04dd0a480 -1 init, newargv = 0x561f7ff23240 newargc=15 2024-09-11T22:28:52.485 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[72400]: starting ceph client 2024-09-11T22:28:52.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[72400]: starting fuse 2024-09-11T22:28:52.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:52 smithi177 ceph-mon[35530]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:52.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:52 smithi146 ceph-mon[34996]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:53.577 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-11T22:28:53.644 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T22:28:53.684 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-09-11T22:28:53.684 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-09-11T22:28:53.684 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-09-11T22:28:53.685 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/745a20e47ca21f844770ebfa5e3714000453a1e467614ce7b31de01e7977ba14/merged 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/2b15102fd82bb31882d8fc968f888c913e924ba4900ecf4fdb1b85fa0ad50342/merged 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/0 2024-09-11T22:28:53.686 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/5dbf052e07fe98ed0be842df3da8632e0dfb156713fce09a7ca0710c7087231b/merged 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/3725a091a3ff281b16c71b29e5d83caa2f5cceebf9e636b306f8976a48e49750/merged 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/4c0a1de190bbd04013d50d9f816f401cd71b9a3470a4df1129f2a4f8c648bc7a/merged 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/8c2d5c3f2a368e6a7223187e2fb68e77f51797ddf0c00dfb82703b02b804df30/merged 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/5dfcc0ad61610431fdd672178f8ee1a1163ca9705feac1076cb63d00bb216bad/merged 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/f27a11954b7ee7da9ac3f2f00d8f5602bb8d6856d363fbd2e32b5fa2ced37d9a/merged 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/210826263e31bc2053170eb0d37bbee9cdcac6adb99212f76559190e151d1e79/merged 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/containers/storage/overlay/3bb709d5dc4250fcfc33add474e8b28578fe273e1d1b9de521ae094e452bd563/merged 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:28:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-11T22:28:53.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:53.688 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-11T22:28:53.766 INFO:teuthology.orchestra.run.smithi040.stdout:120 2024-09-11T22:28:53.766 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-09-11T22:28:53.767 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.admin")) 2024-09-11T22:28:53.768 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-09-11T22:28:53.932 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.admin.72400.asok 2024-09-11T22:28:53.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:53.947 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.72400.asok 2024-09-11T22:28:53.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:53.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.72400.asok status 2024-09-11T22:28:54.134 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:28:54.134 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-09-11T22:28:54.134 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T22:28:54.134 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T22:28:54.134 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "admin", 2024-09-11T22:28:54.134 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-09-11T22:28:54.134 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-11T22:28:54.134 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "72400", 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24635, 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 24635 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-09-11T22:28:54.135 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3464022910 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3464022910 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.24635 192.168.0.1:0/3464022910", 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/3464022910", 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 17, 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 91, 2024-09-11T22:28:54.136 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-09-11T22:28:54.137 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-09-11T22:28:54.137 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2024-09-11T22:28:54.137 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:28:54.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:54.148 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-09-11T22:28:54.148 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:28:54.185 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-09-11T22:28:54.186 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:28:54.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:54.186 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:28:54.286 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-11T22:28:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:28:54.397 INFO:teuthology.orchestra.run.smithi040.stdout:# file: . 2024-09-11T22:28:54.397 INFO:teuthology.orchestra.run.smithi040.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-11T22:28:54.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:28:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:28:54.405 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:28:54.405 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:28:54.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T22:28:54.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:54 smithi177 ceph-mon[35530]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:54.535 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:54 smithi040 ceph-mon[30787]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:54.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:54 smithi146 ceph-mon[34996]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:54.865 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:55.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.433+0000 7f892c600640 1 -- 172.21.15.40:0/4071543825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8924104010 msgr2=0x7f89241043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.433+0000 7f892c600640 1 --2- 172.21.15.40:0/4071543825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8924104010 0x7f89241043f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8918009900 tx=0x7f891802a410 comp rx=0 tx=0).stop 2024-09-11T22:28:55.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.433+0000 7f892c600640 1 -- 172.21.15.40:0/4071543825 shutdown_connections 2024-09-11T22:28:55.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.433+0000 7f892c600640 1 --2- 172.21.15.40:0/4071543825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8924109140 0x7f8924110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.433+0000 7f892c600640 1 --2- 172.21.15.40:0/4071543825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89241049c0 0x7f8924108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.433+0000 7f892c600640 1 --2- 172.21.15.40:0/4071543825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8924104010 0x7f89241043f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.433+0000 7f892c600640 1 -- 172.21.15.40:0/4071543825 >> 172.21.15.40:0/4071543825 conn(0x7f89240ffa50 msgr2=0x7f8924101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:55.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.433+0000 7f892c600640 1 -- 172.21.15.40:0/4071543825 shutdown_connections 2024-09-11T22:28:55.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.434+0000 7f892c600640 1 -- 172.21.15.40:0/4071543825 wait complete. 2024-09-11T22:28:55.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.435+0000 7f892c600640 1 Processor -- start 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.435+0000 7f892c600640 1 -- start start 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.435+0000 7f892c600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8924104010 0x7f892419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.435+0000 7f892c600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89241049c0 0x7f892419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.435+0000 7f892c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8924109140 0x7f892419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.435+0000 7f892c600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8924114170 con 0x7f89241049c0 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.435+0000 7f892c600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8924113ff0 con 0x7f8924109140 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.435+0000 7f892c600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f89241142f0 con 0x7f8924104010 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f8929200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89241049c0 0x7f892419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f8929200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89241049c0 0x7f892419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48008/0 (socket says 172.21.15.40:48008) 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f8929200640 1 -- 172.21.15.40:0/400915981 learned_addr learned my addr 172.21.15.40:0/400915981 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f892a600640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8924109140 0x7f892419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f8929c00640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8924104010 0x7f892419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f8929200640 1 -- 172.21.15.40:0/400915981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8924104010 msgr2=0x7f892419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f8929200640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8924104010 0x7f892419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f8929200640 1 -- 172.21.15.40:0/400915981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8924109140 msgr2=0x7f892419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f8929200640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8924109140 0x7f892419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.436+0000 7f8929200640 1 -- 172.21.15.40:0/400915981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892419f5e0 con 0x7f89241049c0 2024-09-11T22:28:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.437+0000 7f8929200640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89241049c0 0x7f892419ab70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f891000e9f0 tx=0x7f891000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.437+0000 7f8922000640 1 -- 172.21.15.40:0/400915981 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891000cd80 con 0x7f89241049c0 2024-09-11T22:28:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.437+0000 7f8922000640 1 -- 172.21.15.40:0/400915981 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8910010910 con 0x7f89241049c0 2024-09-11T22:28:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.437+0000 7f8922000640 1 -- 172.21.15.40:0/400915981 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910018990 con 0x7f89241049c0 2024-09-11T22:28:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.437+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892419f8d0 con 0x7f89241049c0 2024-09-11T22:28:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.437+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89241a71b0 con 0x7f89241049c0 2024-09-11T22:28:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.438+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89241043f0 con 0x7f89241049c0 2024-09-11T22:28:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.440+0000 7f8922000640 1 -- 172.21.15.40:0/400915981 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8910010ac0 con 0x7f89241049c0 2024-09-11T22:28:55.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.442+0000 7f8922000640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f890c0a2c00 0x7f890c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.442+0000 7f8922000640 1 -- 172.21.15.40:0/400915981 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f89100cf550 con 0x7f89241049c0 2024-09-11T22:28:55.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.442+0000 7f8929c00640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f890c0a2c00 0x7f890c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.443+0000 7f8929c00640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f890c0a2c00 0x7f890c0a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8918009230 tx=0x7f89180058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:55.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.446+0000 7f8922000640 1 -- 172.21.15.40:0/400915981 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f891009bbc0 con 0x7f89241049c0 2024-09-11T22:28:55.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.643+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f892402d7c0 con 0x7f89241049c0 2024-09-11T22:28:55.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.644+0000 7f8922000640 1 -- 172.21.15.40:0/400915981 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+592 (secure 0 0 0) 0x7f891009fec0 con 0x7f89241049c0 2024-09-11T22:28:55.646 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3768094180 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:55.646 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2421714119 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:55.646 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3054635908 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:55.646 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/2835470410 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:55.646 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2148182783 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:55.646 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3034121439 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:55.646 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/2370914626 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:55.646 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/2370914626 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:55.646 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/2835470410 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:55.647 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2543187724 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:listed 10 entries 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f890c0a2c00 msgr2=0x7f890c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f890c0a2c00 0x7f890c0a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8918009230 tx=0x7f89180058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89241049c0 msgr2=0x7f892419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89241049c0 0x7f892419ab70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f891000e9f0 tx=0x7f891000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 shutdown_connections 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f890c0a2c00 0x7f890c0a50c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8924109140 0x7f892419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89241049c0 0x7f892419ab70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 --2- 172.21.15.40:0/400915981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8924104010 0x7f892419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 >> 172.21.15.40:0/400915981 conn(0x7f89240ffa50 msgr2=0x7f8924100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:55.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 shutdown_connections 2024-09-11T22:28:55.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:55.646+0000 7f892c600640 1 -- 172.21.15.40:0/400915981 wait complete. 2024-09-11T22:28:56.387 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:28:56.388 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:28:56.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T22:28:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:56 smithi177 ceph-mon[35530]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:56 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/400915981' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:28:56.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:56 smithi146 ceph-mon[34996]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:56.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:56 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/400915981' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:56 smithi040 ceph-mon[30787]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:56 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/400915981' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:28:56.845 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:28:57.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.415+0000 7fe5b4000640 1 -- 172.21.15.40:0/695523475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5ac104010 msgr2=0x7fe5ac1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.415+0000 7fe5b4000640 1 --2- 172.21.15.40:0/695523475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5ac104010 0x7fe5ac1043f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009900 tx=0x7fe5a002a410 comp rx=0 tx=0).stop 2024-09-11T22:28:57.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.415+0000 7fe5b4000640 1 -- 172.21.15.40:0/695523475 shutdown_connections 2024-09-11T22:28:57.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.415+0000 7fe5b4000640 1 --2- 172.21.15.40:0/695523475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac109140 0x7fe5ac110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.415+0000 7fe5b4000640 1 --2- 172.21.15.40:0/695523475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5ac1049c0 0x7fe5ac108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.415+0000 7fe5b4000640 1 --2- 172.21.15.40:0/695523475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5ac104010 0x7fe5ac1043f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.415+0000 7fe5b4000640 1 -- 172.21.15.40:0/695523475 >> 172.21.15.40:0/695523475 conn(0x7fe5ac0ffa50 msgr2=0x7fe5ac101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:57.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.415+0000 7fe5b4000640 1 -- 172.21.15.40:0/695523475 shutdown_connections 2024-09-11T22:28:57.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.415+0000 7fe5b4000640 1 -- 172.21.15.40:0/695523475 wait complete. 2024-09-11T22:28:57.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.417+0000 7fe5b4000640 1 Processor -- start 2024-09-11T22:28:57.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.417+0000 7fe5b4000640 1 -- start start 2024-09-11T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.417+0000 7fe5b4000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac104010 0x7fe5ac19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.417+0000 7fe5b4000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5ac1049c0 0x7fe5ac19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.417+0000 7fe5b4000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5ac109140 0x7fe5ac19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.417+0000 7fe5b4000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac114160 con 0x7fe5ac1049c0 2024-09-11T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.417+0000 7fe5b4000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac113fe0 con 0x7fe5ac104010 2024-09-11T22:28:57.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.417+0000 7fe5b4000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1142e0 con 0x7fe5ac109140 2024-09-11T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5ac109140 0x7fe5ac19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b0c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5ac1049c0 0x7fe5ac19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5ac109140 0x7fe5ac19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:51172/0 (socket says 172.21.15.40:51172) 2024-09-11T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b2000640 1 -- 172.21.15.40:0/3577662266 learned_addr learned my addr 172.21.15.40:0/3577662266 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:28:57.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b1600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac104010 0x7fe5ac19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b2000640 1 -- 172.21.15.40:0/3577662266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac104010 msgr2=0x7fe5ac19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b2000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac104010 0x7fe5ac19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b2000640 1 -- 172.21.15.40:0/3577662266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5ac1049c0 msgr2=0x7fe5ac19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b2000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5ac1049c0 0x7fe5ac19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.418+0000 7fe5b2000640 1 -- 172.21.15.40:0/3577662266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac19f680 con 0x7fe5ac109140 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.419+0000 7fe5b2000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5ac109140 0x7fe5ac19efa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400eaa0 tx=0x7fe5a400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.419+0000 7fe5aa000640 1 -- 172.21.15.40:0/3577662266 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a400cdb0 con 0x7fe5ac109140 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.419+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ac19f970 con 0x7fe5ac109140 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.419+0000 7fe5aa000640 1 -- 172.21.15.40:0/3577662266 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5a4005020 con 0x7fe5ac109140 2024-09-11T22:28:57.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.419+0000 7fe5aa000640 1 -- 172.21.15.40:0/3577662266 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40116b0 con 0x7fe5ac109140 2024-09-11T22:28:57.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.419+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ac1a7250 con 0x7fe5ac109140 2024-09-11T22:28:57.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.420+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5ac1043f0 con 0x7fe5ac109140 2024-09-11T22:28:57.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.422+0000 7fe5aa000640 1 -- 172.21.15.40:0/3577662266 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe5a4005560 con 0x7fe5ac109140 2024-09-11T22:28:57.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.423+0000 7fe5aa000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe5940a2b80 0x7fe5940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.424+0000 7fe5aa000640 1 -- 172.21.15.40:0/3577662266 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fe5a40cf8f0 con 0x7fe5ac109140 2024-09-11T22:28:57.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.424+0000 7fe5b1600640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe5940a2b80 0x7fe5940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.424+0000 7fe5b1600640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe5940a2b80 0x7fe5940a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009230 tx=0x7fe5a00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.426+0000 7fe5aa000640 1 -- 172.21.15.40:0/3577662266 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe5a4016030 con 0x7fe5ac109140 2024-09-11T22:28:57.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11, 2, 1]}]: dispatch 2024-09-11T22:28:57.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-11T22:28:57.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-11T22:28:57.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-09-11T22:28:57.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-11T22:28:57.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]: dispatch 2024-09-11T22:28:57.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-09-11T22:28:57.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-11T22:28:57.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:57 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-11T22:28:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11, 2, 1]}]: dispatch 2024-09-11T22:28:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-11T22:28:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-11T22:28:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-09-11T22:28:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-11T22:28:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]: dispatch 2024-09-11T22:28:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-09-11T22:28:57.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-11T22:28:57.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:57 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-11T22:28:57.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.623+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe5ac10c380 con 0x7fe5ac109140 2024-09-11T22:28:57.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11, 2, 1]}]: dispatch 2024-09-11T22:28:57.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-11T22:28:57.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-11T22:28:57.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-09-11T22:28:57.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2024-09-11T22:28:57.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]: dispatch 2024-09-11T22:28:57.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-09-11T22:28:57.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-11T22:28:57.625 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:57 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-11T22:28:57.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.623+0000 7fe5aa000640 1 -- 172.21.15.40:0/3577662266 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v92) ==== 81+0+592 (secure 0 0 0) 0x7fe5a409be60 con 0x7fe5ac109140 2024-09-11T22:28:57.626 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3768094180 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:57.626 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2421714119 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:57.626 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3054635908 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:57.626 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/2835470410 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:57.627 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2148182783 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:57.627 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3034121439 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:57.627 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/2370914626 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:57.627 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/2370914626 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:57.627 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/2835470410 2024-09-12T22:20:56.889250+0000 2024-09-11T22:28:57.627 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2543187724 2024-09-12T22:20:29.708392+0000 2024-09-11T22:28:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:listed 10 entries 2024-09-11T22:28:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe5940a2b80 msgr2=0x7fe5940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe5940a2b80 0x7fe5940a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5a0009230 tx=0x7fe5a00058d0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5ac109140 msgr2=0x7fe5ac19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5ac109140 0x7fe5ac19efa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400eaa0 tx=0x7fe5a400ef60 comp rx=0 tx=0).stop 2024-09-11T22:28:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 shutdown_connections 2024-09-11T22:28:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe5940a2b80 0x7fe5940a5040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5ac109140 0x7fe5ac19efa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5ac1049c0 0x7fe5ac19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 --2- 172.21.15.40:0/3577662266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac104010 0x7fe5ac19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 >> 172.21.15.40:0/3577662266 conn(0x7fe5ac0ffa50 msgr2=0x7fe5ac100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 shutdown_connections 2024-09-11T22:28:57.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:28:57.626+0000 7fe5b4000640 1 -- 172.21.15.40:0/3577662266 wait complete. 2024-09-11T22:28:58.409 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-09-11T22:28:58.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:28:58.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:28:58.464 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[72400]: fuse finished with error 0 and tester_r 0 2024-09-11T22:28:58.468 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:28:58.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: pgmap v321: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11, 2, 1]}]': finished 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]': finished 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T22:28:58.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:58 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3577662266' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:28:58.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: pgmap v321: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T22:28:58.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11, 2, 1]}]': finished 2024-09-11T22:28:58.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-11T22:28:58.655 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-11T22:28:58.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-11T22:28:58.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-11T22:28:58.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]': finished 2024-09-11T22:28:58.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-11T22:28:58.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-11T22:28:58.656 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-11T22:28:58.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T22:28:58.657 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:58 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3577662266' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:28:58.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: pgmap v321: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T22:28:58.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11, 2, 1]}]': finished 2024-09-11T22:28:58.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-11T22:28:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-11T22:28:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-11T22:28:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2024-09-11T22:28:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]': finished 2024-09-11T22:28:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-11T22:28:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-11T22:28:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-11T22:28:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T22:28:58.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:58 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3577662266' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:28:59.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:28:59 smithi146 ceph-mon[34996]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T22:28:59.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:28:59 smithi040 ceph-mon[30787]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T22:28:59.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:28:59 smithi177 ceph-mon[35530]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T22:29:00.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:00 smithi146 ceph-mon[34996]: pgmap v324: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-11T22:29:00.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:00 smithi040 ceph-mon[30787]: pgmap v324: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-11T22:29:00.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:00 smithi177 ceph-mon[35530]: pgmap v324: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-11T22:29:02.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:02 smithi146 ceph-mon[34996]: pgmap v325: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-11T22:29:02.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:02 smithi040 ceph-mon[30787]: pgmap v325: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-11T22:29:02.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:02 smithi177 ceph-mon[35530]: pgmap v325: 129 pgs: 5 peering, 124 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-11T22:29:04.569 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T22:29:04.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:29:04.570 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-11T22:29:04.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:04 smithi146 ceph-mon[34996]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:04.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:29:04.675 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:04 smithi040 ceph-mon[30787]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:04.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:04 smithi177 ceph-mon[35530]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:05.007 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:05.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.577+0000 7f57f4000640 1 -- 172.21.15.40:0/1707927977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57ec101df0 msgr2=0x7f57ec1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:05.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.577+0000 7f57f4000640 1 --2- 172.21.15.40:0/1707927977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57ec101df0 0x7f57ec1021d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009ca0 tx=0x7f57e002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.577+0000 7f57f4000640 1 -- 172.21.15.40:0/1707927977 shutdown_connections 2024-09-11T22:29:05.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.577+0000 7f57f4000640 1 --2- 172.21.15.40:0/1707927977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ec106f20 0x7f57ec10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.577+0000 7f57f4000640 1 --2- 172.21.15.40:0/1707927977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec1027a0 0x7f57ec1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.577+0000 7f57f4000640 1 --2- 172.21.15.40:0/1707927977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57ec101df0 0x7f57ec1021d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.577+0000 7f57f4000640 1 -- 172.21.15.40:0/1707927977 >> 172.21.15.40:0/1707927977 conn(0x7f57ec0fd8b0 msgr2=0x7f57ec0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:05.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.577+0000 7f57f4000640 1 -- 172.21.15.40:0/1707927977 shutdown_connections 2024-09-11T22:29:05.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.578+0000 7f57f4000640 1 -- 172.21.15.40:0/1707927977 wait complete. 2024-09-11T22:29:05.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.578+0000 7f57f4000640 1 Processor -- start 2024-09-11T22:29:05.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f4000640 1 -- start start 2024-09-11T22:29:05.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f4000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec101df0 0x7f57ec19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:05.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f4000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ec1027a0 0x7f57ec19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:05.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f4000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57ec106f20 0x7f57ec19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:05.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f4000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec111f40 con 0x7f57ec106f20 2024-09-11T22:29:05.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f4000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec111dc0 con 0x7f57ec1027a0 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f4000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec1120c0 con 0x7f57ec101df0 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f1600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec101df0 0x7f57ec19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57ec106f20 0x7f57ec19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f1600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec101df0 0x7f57ec19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:42328/0 (socket says 172.21.15.40:42328) 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f1600640 1 -- 172.21.15.40:0/172185959 learned_addr learned my addr 172.21.15.40:0/172185959 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.579+0000 7f57f0c00640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ec1027a0 0x7f57ec19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57f0c00640 1 -- 172.21.15.40:0/172185959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec101df0 msgr2=0x7f57ec19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57f0c00640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec101df0 0x7f57ec19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57f0c00640 1 -- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57ec106f20 msgr2=0x7f57ec19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57f0c00640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57ec106f20 0x7f57ec19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57f0c00640 1 -- 172.21.15.40:0/172185959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec19f5b0 con 0x7f57ec1027a0 2024-09-11T22:29:05.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57f1600640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec101df0 0x7f57ec19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:05.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57f2000640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57ec106f20 0x7f57ec19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:05.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57f0c00640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ec1027a0 0x7f57ec19ab40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e9f0 tx=0x7f57d800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:05.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57ea000640 1 -- 172.21.15.40:0/172185959 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d800ccc0 con 0x7f57ec1027a0 2024-09-11T22:29:05.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ec19f8a0 con 0x7f57ec1027a0 2024-09-11T22:29:05.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57ea000640 1 -- 172.21.15.40:0/172185959 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d8010910 con 0x7f57ec1027a0 2024-09-11T22:29:05.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.580+0000 7f57ea000640 1 -- 172.21.15.40:0/172185959 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8018960 con 0x7f57ec1027a0 2024-09-11T22:29:05.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.581+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ec1a7180 con 0x7f57ec1027a0 2024-09-11T22:29:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.582+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ec1021d0 con 0x7f57ec1027a0 2024-09-11T22:29:05.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.584+0000 7f57ea000640 1 -- 172.21.15.40:0/172185959 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f57d8010ac0 con 0x7f57ec1027a0 2024-09-11T22:29:05.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.585+0000 7f57ea000640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57d40a2b80 0x7f57d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:05.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.585+0000 7f57ea000640 1 -- 172.21.15.40:0/172185959 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f57d80cfaf0 con 0x7f57ec1027a0 2024-09-11T22:29:05.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.585+0000 7f57f1600640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57d40a2b80 0x7f57d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:05.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.586+0000 7f57f1600640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57d40a2b80 0x7f57d40a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57e0031f80 tx=0x7f57e0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:05.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.587+0000 7f57ea000640 1 -- 172.21.15.40:0/172185959 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57d809c060 con 0x7f57ec1027a0 2024-09-11T22:29:05.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.777+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57ec19b960 con 0x7f57ec1027a0 2024-09-11T22:29:05.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.779+0000 7f57ea000640 1 -- 172.21.15.40:0/172185959 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24737 (secure 0 0 0) 0x7f57ec19b960 con 0x7f57ec1027a0 2024-09-11T22:29:05.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:29:05.782 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":93,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:28:58.283874+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:29:05.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.781+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57d40a2b80 msgr2=0x7f57d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:05.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.781+0000 7f57f4000640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57d40a2b80 0x7f57d40a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57e0031f80 tx=0x7f57e0004a40 comp rx=0 tx=0).stop 2024-09-11T22:29:05.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.781+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ec1027a0 msgr2=0x7f57ec19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:05.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.781+0000 7f57f4000640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ec1027a0 0x7f57ec19ab40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e9f0 tx=0x7f57d800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.782+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 shutdown_connections 2024-09-11T22:29:05.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.782+0000 7f57f4000640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f57d40a2b80 0x7f57d40a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.782+0000 7f57f4000640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57ec106f20 0x7f57ec19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.782+0000 7f57f4000640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57ec1027a0 0x7f57ec19ab40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.782+0000 7f57f4000640 1 --2- 172.21.15.40:0/172185959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57ec101df0 0x7f57ec19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:05.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.782+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 >> 172.21.15.40:0/172185959 conn(0x7f57ec0fd8b0 msgr2=0x7f57ec0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:05.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.782+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 shutdown_connections 2024-09-11T22:29:05.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:05.782+0000 7f57f4000640 1 -- 172.21.15.40:0/172185959 wait complete. 2024-09-11T22:29:06.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:06 smithi040 ceph-mon[30787]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:06.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:06 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/172185959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:06.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:29:06.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:06 smithi146 ceph-mon[34996]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:06.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:06 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/172185959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:06.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:06 smithi177 ceph-mon[35530]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:06.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:06 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/172185959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:07.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.551+0000 7f1f8d200640 1 -- 172.21.15.40:0/3286149781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88103e30 msgr2=0x7f1f88104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:07.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.551+0000 7f1f8d200640 1 --2- 172.21.15.40:0/3286149781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88103e30 0x7f1f88104210 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009900 tx=0x7f1f7802a410 comp rx=0 tx=0).stop 2024-09-11T22:29:07.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.551+0000 7f1f8d200640 1 -- 172.21.15.40:0/3286149781 shutdown_connections 2024-09-11T22:29:07.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.551+0000 7f1f8d200640 1 --2- 172.21.15.40:0/3286149781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f88108f60 0x7f1f88110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.551+0000 7f1f8d200640 1 --2- 172.21.15.40:0/3286149781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f881047e0 0x7f1f88108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.551+0000 7f1f8d200640 1 --2- 172.21.15.40:0/3286149781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88103e30 0x7f1f88104210 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.551+0000 7f1f8d200640 1 -- 172.21.15.40:0/3286149781 >> 172.21.15.40:0/3286149781 conn(0x7f1f880ff8d0 msgr2=0x7f1f88101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:07.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.551+0000 7f1f8d200640 1 -- 172.21.15.40:0/3286149781 shutdown_connections 2024-09-11T22:29:07.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.551+0000 7f1f8d200640 1 -- 172.21.15.40:0/3286149781 wait complete. 2024-09-11T22:29:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.552+0000 7f1f8d200640 1 Processor -- start 2024-09-11T22:29:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.552+0000 7f1f8d200640 1 -- start start 2024-09-11T22:29:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f8d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f88103e30 0x7f1f8819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f8d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f881047e0 0x7f1f8819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f8d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88108f60 0x7f1f8819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f8d200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88113fc0 con 0x7f1f88108f60 2024-09-11T22:29:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f8d200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88113e40 con 0x7f1f881047e0 2024-09-11T22:29:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f8d200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88114140 con 0x7f1f88103e30 2024-09-11T22:29:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88108f60 0x7f1f8819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f88103e30 0x7f1f8819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88108f60 0x7f1f8819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38932/0 (socket says 172.21.15.40:38932) 2024-09-11T22:29:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87e00640 1 -- 172.21.15.40:0/1068565661 learned_addr learned my addr 172.21.15.40:0/1068565661 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f7fe00640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f881047e0 0x7f1f8819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87e00640 1 -- 172.21.15.40:0/1068565661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f88103e30 msgr2=0x7f1f8819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87e00640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f88103e30 0x7f1f8819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87e00640 1 -- 172.21.15.40:0/1068565661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f881047e0 msgr2=0x7f1f8819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87e00640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f881047e0 0x7f1f8819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87e00640 1 -- 172.21.15.40:0/1068565661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8819f410 con 0x7f1f88108f60 2024-09-11T22:29:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.553+0000 7f1f87400640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f88103e30 0x7f1f8819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.554+0000 7f1f87e00640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88108f60 0x7f1f8819ed30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000eb10 tx=0x7f1f8000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.554+0000 7f1f84c00640 1 -- 172.21.15.40:0/1068565661 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f80004b20 con 0x7f1f88108f60 2024-09-11T22:29:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.554+0000 7f1f84c00640 1 -- 172.21.15.40:0/1068565661 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f80004cc0 con 0x7f1f88108f60 2024-09-11T22:29:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.554+0000 7f1f84c00640 1 -- 172.21.15.40:0/1068565661 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f80010760 con 0x7f1f88108f60 2024-09-11T22:29:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.554+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8819f700 con 0x7f1f88108f60 2024-09-11T22:29:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.554+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f881a6fe0 con 0x7f1f88108f60 2024-09-11T22:29:07.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.555+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f88104210 con 0x7f1f88108f60 2024-09-11T22:29:07.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.557+0000 7f1f84c00640 1 -- 172.21.15.40:0/1068565661 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1f80005020 con 0x7f1f88108f60 2024-09-11T22:29:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.558+0000 7f1f84c00640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1f6c0a2c00 0x7f1f6c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.559+0000 7f1f84c00640 1 -- 172.21.15.40:0/1068565661 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f1f800cf9b0 con 0x7f1f88108f60 2024-09-11T22:29:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.559+0000 7f1f87400640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1f6c0a2c00 0x7f1f6c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:07.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.559+0000 7f1f87400640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1f6c0a2c00 0x7f1f6c0a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009230 tx=0x7f1f780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:07.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.563+0000 7f1f84c00640 1 -- 172.21.15.40:0/1068565661 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f8009c570 con 0x7f1f88108f60 2024-09-11T22:29:07.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.748+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f8810bbb0 con 0x7f1f88108f60 2024-09-11T22:29:07.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.750+0000 7f1f84c00640 1 -- 172.21.15.40:0/1068565661 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24737 (secure 0 0 0) 0x7f1f8009be70 con 0x7f1f88108f60 2024-09-11T22:29:07.752 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:29:07.752 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":93,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:28:58.283874+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:29:07.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1f6c0a2c00 msgr2=0x7f1f6c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1f6c0a2c00 0x7f1f6c0a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009230 tx=0x7f1f780058d0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88108f60 msgr2=0x7f1f8819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88108f60 0x7f1f8819ed30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000eb10 tx=0x7f1f8000c2d0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 shutdown_connections 2024-09-11T22:29:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1f6c0a2c00 0x7f1f6c0a50c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f88108f60 0x7f1f8819ed30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f881047e0 0x7f1f8819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 --2- 172.21.15.40:0/1068565661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f88103e30 0x7f1f8819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:07.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 >> 172.21.15.40:0/1068565661 conn(0x7f1f880ff8d0 msgr2=0x7f1f88100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:07.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 shutdown_connections 2024-09-11T22:29:07.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:07.752+0000 7f1f8d200640 1 -- 172.21.15.40:0/1068565661 wait complete. 2024-09-11T22:29:08.469 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:08 smithi040 ceph-mon[30787]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 105 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:08.469 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:08 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1068565661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:08.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:29:08.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:08 smithi146 ceph-mon[34996]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 105 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:08.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:08 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1068565661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:08.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:08 smithi177 ceph-mon[35530]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 105 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:08.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:08 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1068565661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:08.888 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.556+0000 7f1850600640 1 -- 172.21.15.40:0/3311148925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1848109120 msgr2=0x7f1848110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.556+0000 7f1850600640 1 --2- 172.21.15.40:0/3311148925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1848109120 0x7f1848110ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1840009ca0 tx=0x7f184002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.556+0000 7f1850600640 1 -- 172.21.15.40:0/3311148925 shutdown_connections 2024-09-11T22:29:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.556+0000 7f1850600640 1 --2- 172.21.15.40:0/3311148925 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1848109120 0x7f1848110ca0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.556+0000 7f1850600640 1 --2- 172.21.15.40:0/3311148925 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18481049a0 0x7f18481089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.556+0000 7f1850600640 1 --2- 172.21.15.40:0/3311148925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1848103ff0 0x7f18481043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.556+0000 7f1850600640 1 -- 172.21.15.40:0/3311148925 >> 172.21.15.40:0/3311148925 conn(0x7f18480ffa90 msgr2=0x7f1848101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.556+0000 7f1850600640 1 -- 172.21.15.40:0/3311148925 shutdown_connections 2024-09-11T22:29:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.556+0000 7f1850600640 1 -- 172.21.15.40:0/3311148925 wait complete. 2024-09-11T22:29:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.557+0000 7f1850600640 1 Processor -- start 2024-09-11T22:29:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.557+0000 7f1850600640 1 -- start start 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f1850600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1848103ff0 0x7f184819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f1850600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18481049a0 0x7f184819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f1850600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1848109120 0x7f184819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f1850600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1848114180 con 0x7f18481049a0 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f1850600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1848114000 con 0x7f1848109120 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f1850600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1848114300 con 0x7f1848103ff0 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1848103ff0 0x7f184819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184d200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18481049a0 0x7f184819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1848103ff0 0x7f184819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:42366/0 (socket says 172.21.15.40:42366) 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184dc00640 1 -- 172.21.15.40:0/84432723 learned_addr learned my addr 172.21.15.40:0/84432723 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184e600640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1848109120 0x7f184819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184dc00640 1 -- 172.21.15.40:0/84432723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1848109120 msgr2=0x7f184819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184dc00640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1848109120 0x7f184819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184dc00640 1 -- 172.21.15.40:0/84432723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18481049a0 msgr2=0x7f184819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184dc00640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18481049a0 0x7f184819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.558+0000 7f184dc00640 1 -- 172.21.15.40:0/84432723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184819f570 con 0x7f1848103ff0 2024-09-11T22:29:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.559+0000 7f184dc00640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1848103ff0 0x7f184819a5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f183c00ea60 tx=0x7f183c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.559+0000 7f1846000640 1 -- 172.21.15.40:0/84432723 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c00cde0 con 0x7f1848103ff0 2024-09-11T22:29:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.559+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184819f860 con 0x7f1848103ff0 2024-09-11T22:29:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.559+0000 7f1846000640 1 -- 172.21.15.40:0/84432723 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f183c0035f0 con 0x7f1848103ff0 2024-09-11T22:29:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.559+0000 7f1846000640 1 -- 172.21.15.40:0/84432723 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c010670 con 0x7f1848103ff0 2024-09-11T22:29:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.559+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18481a7140 con 0x7f1848103ff0 2024-09-11T22:29:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.560+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18481043d0 con 0x7f1848103ff0 2024-09-11T22:29:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.562+0000 7f1846000640 1 -- 172.21.15.40:0/84432723 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f183c0037a0 con 0x7f1848103ff0 2024-09-11T22:29:09.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.563+0000 7f1846000640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f18300a2b80 0x7f18300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:09.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.564+0000 7f1846000640 1 -- 172.21.15.40:0/84432723 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f183c0cf670 con 0x7f1848103ff0 2024-09-11T22:29:09.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.564+0000 7f184d200640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f18300a2b80 0x7f18300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:09.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.564+0000 7f184d200640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f18300a2b80 0x7f18300a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1848108a30 tx=0x7f1834005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:09.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.566+0000 7f1846000640 1 -- 172.21.15.40:0/84432723 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f183c09c230 con 0x7f1848103ff0 2024-09-11T22:29:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:09.790+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f18481a7430 con 0x7f1848103ff0 2024-09-11T22:29:10.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.321+0000 7f1846000640 1 -- 172.21.15.40:0/84432723 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f183c09bb30 con 0x7f1848103ff0 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f18300a2b80 msgr2=0x7f18300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f18300a2b80 0x7f18300a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1848108a30 tx=0x7f1834005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1848103ff0 msgr2=0x7f184819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1848103ff0 0x7f184819a5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f183c00ea60 tx=0x7f183c00ef20 comp rx=0 tx=0).stop 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 shutdown_connections 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f18300a2b80 0x7f18300a5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1848109120 0x7f184819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18481049a0 0x7f184819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 --2- 172.21.15.40:0/84432723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1848103ff0 0x7f184819a5c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:10.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 >> 172.21.15.40:0/84432723 conn(0x7f18480ffa90 msgr2=0x7f18481004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:10.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 shutdown_connections 2024-09-11T22:29:10.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:10.324+0000 7f1850600640 1 -- 172.21.15.40:0/84432723 wait complete. 2024-09-11T22:29:10.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:10 smithi146 ceph-mon[34996]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 95 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:10.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:10 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/84432723' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:29:10.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:10 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:29:10.584 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:10 smithi177 ceph-mon[35530]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 95 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:10.584 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:10 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/84432723' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:29:10.584 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:10 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:29:10.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:10 smithi040 ceph-mon[30787]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 95 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:10.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:10 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/84432723' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:29:10.664 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:10 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T22:29:11.084 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-11T22:29:11.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-11T22:29:11.463 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:11.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:11 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T22:29:11.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:11 smithi146 ceph-mon[34996]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:29:11.602 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:11 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T22:29:11.602 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:11 smithi040 ceph-mon[30787]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:29:11.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:11 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T22:29:11.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:11 smithi177 ceph-mon[35530]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:29:12.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.017+0000 7fafcf200640 1 -- 172.21.15.40:0/2430117313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01019c0 msgr2=0x7fafd0101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.017+0000 7fafcf200640 1 --2- 172.21.15.40:0/2430117313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01019c0 0x7fafd0101e20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009930 tx=0x7fafbc02a420 comp rx=0 tx=0).stop 2024-09-11T22:29:12.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.017+0000 7fafcf200640 1 -- 172.21.15.40:0/2430117313 shutdown_connections 2024-09-11T22:29:12.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.017+0000 7fafcf200640 1 --2- 172.21.15.40:0/2430117313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafd0102360 0x7fafd010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.017+0000 7fafcf200640 1 --2- 172.21.15.40:0/2430117313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01019c0 0x7fafd0101e20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.017+0000 7fafcf200640 1 --2- 172.21.15.40:0/2430117313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd01079c0 0x7fafd0107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.017+0000 7fafcf200640 1 -- 172.21.15.40:0/2430117313 >> 172.21.15.40:0/2430117313 conn(0x7fafd00fd740 msgr2=0x7fafd00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:12.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.017+0000 7fafcf200640 1 -- 172.21.15.40:0/2430117313 shutdown_connections 2024-09-11T22:29:12.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.017+0000 7fafcf200640 1 -- 172.21.15.40:0/2430117313 wait complete. 2024-09-11T22:29:12.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.018+0000 7fafcf200640 1 Processor -- start 2024-09-11T22:29:12.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.018+0000 7fafcf200640 1 -- start start 2024-09-11T22:29:12.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafcf200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafd01019c0 0x7fafd019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:12.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafcf200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd0102360 0x7fafd019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:12.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafcf200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01079c0 0x7fafd019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:12.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafcf200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0111e10 con 0x7fafd01079c0 2024-09-11T22:29:12.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafcf200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0111c90 con 0x7fafd0102360 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafcf200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0111f90 con 0x7fafd01019c0 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafce800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01079c0 0x7fafd019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafce800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01079c0 0x7fafd019eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42390/0 (socket says 172.21.15.40:42390) 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafce800640 1 -- 172.21.15.40:0/1610360986 learned_addr learned my addr 172.21.15.40:0/1610360986 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafcde00640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafd01019c0 0x7fafd019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.019+0000 7fafcd400640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd0102360 0x7fafd019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafce800640 1 -- 172.21.15.40:0/1610360986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafd01019c0 msgr2=0x7fafd019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafce800640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafd01019c0 0x7fafd019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafce800640 1 -- 172.21.15.40:0/1610360986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd0102360 msgr2=0x7fafd019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafce800640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd0102360 0x7fafd019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafce800640 1 -- 172.21.15.40:0/1610360986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd019f480 con 0x7fafd01079c0 2024-09-11T22:29:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafce800640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01079c0 0x7fafd019eda0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fafc800eaa0 tx=0x7fafc800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:12.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafc6a00640 1 -- 172.21.15.40:0/1610360986 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc800cdb0 con 0x7fafd01079c0 2024-09-11T22:29:12.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafc6a00640 1 -- 172.21.15.40:0/1610360986 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafc8005020 con 0x7fafd01079c0 2024-09-11T22:29:12.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafc6a00640 1 -- 172.21.15.40:0/1610360986 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc80116b0 con 0x7fafd01079c0 2024-09-11T22:29:12.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.020+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd019f770 con 0x7fafd01079c0 2024-09-11T22:29:12.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.021+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd01a7050 con 0x7fafd01079c0 2024-09-11T22:29:12.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.022+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd0101e20 con 0x7fafd01079c0 2024-09-11T22:29:12.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.024+0000 7fafc6a00640 1 -- 172.21.15.40:0/1610360986 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fafc8005560 con 0x7fafd01079c0 2024-09-11T22:29:12.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.025+0000 7fafc6a00640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fafb40a2b80 0x7fafb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:12.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.025+0000 7fafc6a00640 1 -- 172.21.15.40:0/1610360986 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7fafc80cf560 con 0x7fafd01079c0 2024-09-11T22:29:12.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.025+0000 7fafcde00640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fafb40a2b80 0x7fafb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.026+0000 7fafcde00640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fafb40a2b80 0x7fafb40a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009b50 tx=0x7fafc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:12.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.029+0000 7fafc6a00640 1 -- 172.21.15.40:0/1610360986 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafc8016030 con 0x7fafd01079c0 2024-09-11T22:29:12.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.250+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fafd01a72f0 con 0x7fafd01079c0 2024-09-11T22:29:12.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.338+0000 7fafc6a00640 1 -- 172.21.15.40:0/1610360986 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fafc809bad0 con 0x7fafd01079c0 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fafb40a2b80 msgr2=0x7fafb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fafb40a2b80 0x7fafb40a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009b50 tx=0x7fafc0005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01079c0 msgr2=0x7fafd019eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01079c0 0x7fafd019eda0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fafc800eaa0 tx=0x7fafc800ef60 comp rx=0 tx=0).stop 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 shutdown_connections 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fafb40a2b80 0x7fafb40a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd01079c0 0x7fafd019eda0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd0102360 0x7fafd019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 --2- 172.21.15.40:0/1610360986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafd01019c0 0x7fafd019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 >> 172.21.15.40:0/1610360986 conn(0x7fafd00fd740 msgr2=0x7fafd00fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 shutdown_connections 2024-09-11T22:29:12.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:12.340+0000 7fafcf200640 1 -- 172.21.15.40:0/1610360986 wait complete. 2024-09-11T22:29:12.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:12 smithi146 ceph-mon[34996]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:12.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:12 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1610360986' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-11T22:29:12.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:12 smithi040 ceph-mon[30787]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:12.689 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:12 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1610360986' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-11T22:29:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:12 smithi177 ceph-mon[35530]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:12 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1610360986' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-11T22:29:13.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T22:29:13.441 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:13.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:13 smithi040 ceph-mon[30787]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T22:29:13.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:13 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1610360986' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T22:29:13.777 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:13 smithi040 ceph-mon[30787]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T22:29:13.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:13 smithi040 ceph-mon[30787]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:29:13.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:13 smithi040 ceph-mon[30787]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T22:29:13.778 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:13 smithi040 ceph-mon[30787]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T22:29:13.794 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:13 smithi177 ceph-mon[35530]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T22:29:13.794 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:13 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1610360986' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T22:29:13.794 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:13 smithi177 ceph-mon[35530]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T22:29:13.794 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:13 smithi177 ceph-mon[35530]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:29:13.794 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:13 smithi177 ceph-mon[35530]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T22:29:13.794 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:13 smithi177 ceph-mon[35530]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T22:29:13.834 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:29:13 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b[65343]: 2024-09-11T22:29:13.375+0000 7f6ab2ea1640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-11T22:29:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:13 smithi146 ceph-mon[34996]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T22:29:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:13 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1610360986' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T22:29:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:13 smithi146 ceph-mon[34996]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T22:29:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:13 smithi146 ceph-mon[34996]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T22:29:13.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:13 smithi146 ceph-mon[34996]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-11T22:29:13.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:13 smithi146 ceph-mon[34996]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-11T22:29:13.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.993+0000 7f26dec00640 1 -- 172.21.15.40:0/2567553441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d81047e0 msgr2=0x7f26d8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:13.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.993+0000 7f26dec00640 1 --2- 172.21.15.40:0/2567553441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d81047e0 0x7f26d8108830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009900 tx=0x7f26c402a410 comp rx=0 tx=0).stop 2024-09-11T22:29:13.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.993+0000 7f26dec00640 1 -- 172.21.15.40:0/2567553441 shutdown_connections 2024-09-11T22:29:13.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.993+0000 7f26dec00640 1 --2- 172.21.15.40:0/2567553441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26d8108f60 0x7f26d8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:13.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.993+0000 7f26dec00640 1 --2- 172.21.15.40:0/2567553441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d81047e0 0x7f26d8108830 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:13.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.993+0000 7f26dec00640 1 --2- 172.21.15.40:0/2567553441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26d8103e30 0x7f26d8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:13.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.993+0000 7f26dec00640 1 -- 172.21.15.40:0/2567553441 >> 172.21.15.40:0/2567553441 conn(0x7f26d80ff8d0 msgr2=0x7f26d8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:13.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.993+0000 7f26dec00640 1 -- 172.21.15.40:0/2567553441 shutdown_connections 2024-09-11T22:29:13.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.993+0000 7f26dec00640 1 -- 172.21.15.40:0/2567553441 wait complete. 2024-09-11T22:29:13.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.994+0000 7f26dec00640 1 Processor -- start 2024-09-11T22:29:13.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.994+0000 7f26dec00640 1 -- start start 2024-09-11T22:29:13.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.994+0000 7f26dec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26d8103e30 0x7f26d819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:13.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.994+0000 7f26dec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26d81047e0 0x7f26d819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:13.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.994+0000 7f26dec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8108f60 0x7f26d819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:13.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.994+0000 7f26dec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8114010 con 0x7f26d8108f60 2024-09-11T22:29:13.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.994+0000 7f26dec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8113e90 con 0x7f26d8103e30 2024-09-11T22:29:13.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.994+0000 7f26dec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8114190 con 0x7f26d81047e0 2024-09-11T22:29:13.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26de200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8108f60 0x7f26d819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:13.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26de200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8108f60 0x7f26d819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42408/0 (socket says 172.21.15.40:42408) 2024-09-11T22:29:13.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26de200640 1 -- 172.21.15.40:0/3282558880 learned_addr learned my addr 172.21.15.40:0/3282558880 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:13.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26dce00640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26d81047e0 0x7f26d819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:13.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26dd800640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26d8103e30 0x7f26d819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:13.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26de200640 1 -- 172.21.15.40:0/3282558880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26d81047e0 msgr2=0x7f26d819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:13.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26de200640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26d81047e0 0x7f26d819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:13.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26de200640 1 -- 172.21.15.40:0/3282558880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26d8103e30 msgr2=0x7f26d819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:13.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26de200640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26d8103e30 0x7f26d819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26de200640 1 -- 172.21.15.40:0/3282558880 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d819f420 con 0x7f26d8108f60 2024-09-11T22:29:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.995+0000 7f26de200640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8108f60 0x7f26d819ed40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f26d000eb10 tx=0x7f26d000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.996+0000 7f26d6000640 1 -- 172.21.15.40:0/3282558880 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0004b20 con 0x7f26d8108f60 2024-09-11T22:29:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.996+0000 7f26d6000640 1 -- 172.21.15.40:0/3282558880 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d0004cc0 con 0x7f26d8108f60 2024-09-11T22:29:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.996+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d819f710 con 0x7f26d8108f60 2024-09-11T22:29:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.996+0000 7f26d6000640 1 -- 172.21.15.40:0/3282558880 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0010760 con 0x7f26d8108f60 2024-09-11T22:29:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.996+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d81a6ff0 con 0x7f26d8108f60 2024-09-11T22:29:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.997+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d8104210 con 0x7f26d8108f60 2024-09-11T22:29:13.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:13.999+0000 7f26d6000640 1 -- 172.21.15.40:0/3282558880 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f26d0005020 con 0x7f26d8108f60 2024-09-11T22:29:14.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.000+0000 7f26d6000640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f26c00a2c00 0x7f26c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:14.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.000+0000 7f26d6000640 1 -- 172.21.15.40:0/3282558880 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f26d00cf870 con 0x7f26d8108f60 2024-09-11T22:29:14.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.000+0000 7f26dd800640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f26c00a2c00 0x7f26c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.001+0000 7f26dd800640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f26c00a2c00 0x7f26c00a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f26cc005fd0 tx=0x7f26cc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:14.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.004+0000 7f26d6000640 1 -- 172.21.15.40:0/3282558880 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26d009c430 con 0x7f26d8108f60 2024-09-11T22:29:14.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.225+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f26d802d7c0 con 0x7f26d8108f60 2024-09-11T22:29:14.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.353+0000 7f26d6000640 1 -- 172.21.15.40:0/3282558880 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f26d009bd30 con 0x7f26d8108f60 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f26c00a2c00 msgr2=0x7f26c00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f26c00a2c00 0x7f26c00a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f26cc005fd0 tx=0x7f26cc00b390 comp rx=0 tx=0).stop 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8108f60 msgr2=0x7f26d819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8108f60 0x7f26d819ed40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f26d000eb10 tx=0x7f26d000c2d0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 shutdown_connections 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f26c00a2c00 0x7f26c00a50c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26d8108f60 0x7f26d819ed40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26d81047e0 0x7f26d819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 --2- 172.21.15.40:0/3282558880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26d8103e30 0x7f26d819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:14.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 >> 172.21.15.40:0/3282558880 conn(0x7f26d80ff8d0 msgr2=0x7f26d8100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:14.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 shutdown_connections 2024-09-11T22:29:14.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:14.356+0000 7f26dec00640 1 -- 172.21.15.40:0/3282558880 wait complete. 2024-09-11T22:29:14.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:14 smithi040 ceph-mon[30787]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:14.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:14 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] up:active 2024-09-11T22:29:14.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:14 smithi040 ceph-mon[30787]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T22:29:14.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:14 smithi040 ceph-mon[30787]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T22:29:14.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:14 smithi040 ceph-mon[30787]: Cluster is now healthy 2024-09-11T22:29:14.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:14 smithi040 ceph-mon[30787]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T22:29:14.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:14 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-11T22:29:14.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:14 smithi040 ceph-mon[30787]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T22:29:14.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:14 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3282558880' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T22:29:14.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:14 smithi177 ceph-mon[35530]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:14.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:14 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] up:active 2024-09-11T22:29:14.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:14 smithi177 ceph-mon[35530]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T22:29:14.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:14 smithi177 ceph-mon[35530]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T22:29:14.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:14 smithi177 ceph-mon[35530]: Cluster is now healthy 2024-09-11T22:29:14.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:14 smithi177 ceph-mon[35530]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T22:29:14.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:14 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-11T22:29:14.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:14 smithi177 ceph-mon[35530]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T22:29:14.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:14 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3282558880' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T22:29:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:14 smithi146 ceph-mon[34996]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T22:29:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:14 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] up:active 2024-09-11T22:29:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:14 smithi146 ceph-mon[34996]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T22:29:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:14 smithi146 ceph-mon[34996]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T22:29:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:14 smithi146 ceph-mon[34996]: Cluster is now healthy 2024-09-11T22:29:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:14 smithi146 ceph-mon[34996]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-11T22:29:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:14 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-11T22:29:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:14 smithi146 ceph-mon[34996]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T22:29:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:14 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3282558880' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T22:29:15.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T22:29:15.517 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:15 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3282558880' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T22:29:15.517 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:15 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] up:active 2024-09-11T22:29:15.517 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:15 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-11T22:29:15.517 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:15 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:29:15.518 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:15 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:15.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:15 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3282558880' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T22:29:15.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:15 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] up:active 2024-09-11T22:29:15.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:15 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-11T22:29:15.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:15 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:29:15.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:15 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:15.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:15 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3282558880' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T22:29:15.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:15 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] up:active 2024-09-11T22:29:15.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:15 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-11T22:29:15.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:15 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:29:15.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:15 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:29:16.000 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:16.459 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:16 smithi040 ceph-mon[30787]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-11T22:29:16.459 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.459 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.459 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.459 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:16 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.578+0000 7f5995a00640 1 -- 172.21.15.40:0/725729549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5990074510 msgr2=0x7f59900748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.578+0000 7f5995a00640 1 --2- 172.21.15.40:0/725729549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5990074510 0x7f59900748f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5980009900 tx=0x7f598002a480 comp rx=0 tx=0).stop 2024-09-11T22:29:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.578+0000 7f5995a00640 1 -- 172.21.15.40:0/725729549 shutdown_connections 2024-09-11T22:29:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.578+0000 7f5995a00640 1 --2- 172.21.15.40:0/725729549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f599010e280 0x7f5990110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.578+0000 7f5995a00640 1 --2- 172.21.15.40:0/725729549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5990074e30 0x7f599010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.578+0000 7f5995a00640 1 --2- 172.21.15.40:0/725729549 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5990074510 0x7f59900748f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.578+0000 7f5995a00640 1 -- 172.21.15.40:0/725729549 >> 172.21.15.40:0/725729549 conn(0x7f59900fd740 msgr2=0x7f59900ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.578+0000 7f5995a00640 1 -- 172.21.15.40:0/725729549 shutdown_connections 2024-09-11T22:29:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.578+0000 7f5995a00640 1 -- 172.21.15.40:0/725729549 wait complete. 2024-09-11T22:29:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.580+0000 7f5995a00640 1 Processor -- start 2024-09-11T22:29:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.580+0000 7f5995a00640 1 -- start start 2024-09-11T22:29:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.580+0000 7f5995a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5990074510 0x7f599019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.580+0000 7f5995a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5990074e30 0x7f599019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.580+0000 7f5995a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599010e280 0x7f599019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.580+0000 7f5995a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5990113fc0 con 0x7f5990074510 2024-09-11T22:29:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.580+0000 7f5995a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5990113e40 con 0x7f599010e280 2024-09-11T22:29:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.580+0000 7f5995a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5990114140 con 0x7f5990074e30 2024-09-11T22:29:16.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f598fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5990074510 0x7f599019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:16.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f598f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5990074e30 0x7f599019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:16.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f598f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5990074e30 0x7f599019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:46604/0 (socket says 172.21.15.40:46604) 2024-09-11T22:29:16.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f598f400640 1 -- 172.21.15.40:0/354268714 learned_addr learned my addr 172.21.15.40:0/354268714 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:16.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f5995000640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599010e280 0x7f599019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f598fe00640 1 -- 172.21.15.40:0/354268714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5990074e30 msgr2=0x7f599019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f598fe00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5990074e30 0x7f599019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f598fe00640 1 -- 172.21.15.40:0/354268714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599010e280 msgr2=0x7f599019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f598fe00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599010e280 0x7f599019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.581+0000 7f598fe00640 1 -- 172.21.15.40:0/354268714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599019f4f0 con 0x7f5990074510 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.582+0000 7f598fe00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5990074510 0x7f599019a540 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f598002a9a0 tx=0x7f5980003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.582+0000 7f598cc00640 1 -- 172.21.15.40:0/354268714 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598003f070 con 0x7f5990074510 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.582+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599019f780 con 0x7f5990074510 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.582+0000 7f598cc00640 1 -- 172.21.15.40:0/354268714 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5980031c90 con 0x7f5990074510 2024-09-11T22:29:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.582+0000 7f598cc00640 1 -- 172.21.15.40:0/354268714 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980035030 con 0x7f5990074510 2024-09-11T22:29:16.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.582+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59901a70c0 con 0x7f5990074510 2024-09-11T22:29:16.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.584+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5990075c50 con 0x7f5990074510 2024-09-11T22:29:16.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.585+0000 7f598cc00640 1 -- 172.21.15.40:0/354268714 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5980042070 con 0x7f5990074510 2024-09-11T22:29:16.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.587+0000 7f598cc00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f59740a2b80 0x7f59740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:16.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.587+0000 7f598cc00640 1 -- 172.21.15.40:0/354268714 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f59800ef9f0 con 0x7f5990074510 2024-09-11T22:29:16.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.587+0000 7f598f400640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f59740a2b80 0x7f59740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.588+0000 7f598f400640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f59740a2b80 0x7f59740a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f599010f630 tx=0x7f597c00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:16.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.592+0000 7f598cc00640 1 -- 172.21.15.40:0/354268714 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f59800bbf60 con 0x7f5990074510 2024-09-11T22:29:16.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:16 smithi177 ceph-mon[35530]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-11T22:29:16.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:16 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:16 smithi146 ceph-mon[34996]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-11T22:29:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:16 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:16.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:16.867+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f5990109400 con 0x7f5990074510 2024-09-11T22:29:17.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.367+0000 7f598cc00640 1 -- 172.21.15.40:0/354268714 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f59800c0260 con 0x7f5990074510 2024-09-11T22:29:17.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.369+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f59740a2b80 msgr2=0x7f59740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:17.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.369+0000 7f5995a00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f59740a2b80 0x7f59740a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f599010f630 tx=0x7f597c00b480 comp rx=0 tx=0).stop 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.369+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5990074510 msgr2=0x7f599019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.369+0000 7f5995a00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5990074510 0x7f599019a540 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f598002a9a0 tx=0x7f5980003b90 comp rx=0 tx=0).stop 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.370+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 shutdown_connections 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.370+0000 7f5995a00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f59740a2b80 0x7f59740a5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.370+0000 7f5995a00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f599010e280 0x7f599019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.370+0000 7f5995a00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5990074e30 0x7f599019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.370+0000 7f5995a00640 1 --2- 172.21.15.40:0/354268714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5990074510 0x7f599019a540 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.370+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 >> 172.21.15.40:0/354268714 conn(0x7f59900fd740 msgr2=0x7f59900fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.370+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 shutdown_connections 2024-09-11T22:29:17.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:17.370+0000 7f5995a00640 1 -- 172.21.15.40:0/354268714 wait complete. 2024-09-11T22:29:17.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:17 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/354268714' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T22:29:17.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:17 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:17.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:17 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:17.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:17 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/354268714' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T22:29:17.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:17 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:17.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:17 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:17.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:17 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/354268714' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T22:29:17.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:17 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:17.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:17 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:18.123 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-11T22:29:18.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T22:29:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:18.647 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:18 smithi040 ceph-mon[30787]: pgmap v333: 129 pgs: 129 active+clean; 583 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T22:29:18.648 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:18 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/354268714' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T22:29:18.648 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:18 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:29:18.648 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:18 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:18.648 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:18 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:18.648 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:18 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:18.735 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:29:18 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b[65343]: 2024-09-11T22:29:18.375+0000 7f6ab2ea1640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-11T22:29:18.735 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:18 smithi146 ceph-mon[34996]: pgmap v333: 129 pgs: 129 active+clean; 583 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T22:29:18.735 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:18 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/354268714' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T22:29:18.736 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:18 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:29:18.736 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:18 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:18.736 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:18 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:18.736 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:18 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:18.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:18 smithi177 ceph-mon[35530]: pgmap v333: 129 pgs: 129 active+clean; 583 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T22:29:18.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:18 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/354268714' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T22:29:18.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:18 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:29:18.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:18 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:29:18.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:18 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:29:18.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:18 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:29:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.093+0000 7f0a2d600640 1 -- 172.21.15.40:0/624224974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 msgr2=0x7f0a281043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.093+0000 7f0a2d600640 1 --2- 172.21.15.40:0/624224974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 0x7f0a281043f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009900 tx=0x7f0a1802a410 comp rx=0 tx=0).stop 2024-09-11T22:29:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.093+0000 7f0a2d600640 1 -- 172.21.15.40:0/624224974 shutdown_connections 2024-09-11T22:29:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.093+0000 7f0a2d600640 1 --2- 172.21.15.40:0/624224974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a28109140 0x7f0a28110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.093+0000 7f0a2d600640 1 --2- 172.21.15.40:0/624224974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a281049c0 0x7f0a28108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.093+0000 7f0a2d600640 1 --2- 172.21.15.40:0/624224974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 0x7f0a281043f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.093+0000 7f0a2d600640 1 -- 172.21.15.40:0/624224974 >> 172.21.15.40:0/624224974 conn(0x7f0a280ffa50 msgr2=0x7f0a28101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.093+0000 7f0a2d600640 1 -- 172.21.15.40:0/624224974 shutdown_connections 2024-09-11T22:29:19.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.094+0000 7f0a2d600640 1 -- 172.21.15.40:0/624224974 wait complete. 2024-09-11T22:29:19.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.094+0000 7f0a2d600640 1 Processor -- start 2024-09-11T22:29:19.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.094+0000 7f0a2d600640 1 -- start start 2024-09-11T22:29:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a2d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 0x7f0a2819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a2d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a281049c0 0x7f0a2819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a2d600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a28109140 0x7f0a2819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a2d600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28114170 con 0x7f0a28104010 2024-09-11T22:29:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a2d600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28113ff0 con 0x7f0a281049c0 2024-09-11T22:29:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a2d600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0a281142f0 con 0x7f0a28109140 2024-09-11T22:29:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a26a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 0x7f0a2819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a26a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 0x7f0a2819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42442/0 (socket says 172.21.15.40:42442) 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a26a00640 1 -- 172.21.15.40:0/2341284601 learned_addr learned my addr 172.21.15.40:0/2341284601 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a27400640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a28109140 0x7f0a2819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.095+0000 7f0a1e000640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a281049c0 0x7f0a2819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a26a00640 1 -- 172.21.15.40:0/2341284601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a28109140 msgr2=0x7f0a2819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a26a00640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a28109140 0x7f0a2819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a26a00640 1 -- 172.21.15.40:0/2341284601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a281049c0 msgr2=0x7f0a2819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a26a00640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a281049c0 0x7f0a2819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a26a00640 1 -- 172.21.15.40:0/2341284601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2819f5e0 con 0x7f0a28104010 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a26a00640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 0x7f0a2819a630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a18006010 tx=0x7f0a18004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a1fe00640 1 -- 172.21.15.40:0/2341284601 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1803f030 con 0x7f0a28104010 2024-09-11T22:29:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a1fe00640 1 -- 172.21.15.40:0/2341284601 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a18004440 con 0x7f0a28104010 2024-09-11T22:29:19.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a1fe00640 1 -- 172.21.15.40:0/2341284601 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18035070 con 0x7f0a28104010 2024-09-11T22:29:19.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.096+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2819f870 con 0x7f0a28104010 2024-09-11T22:29:19.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.097+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2819fd00 con 0x7f0a28104010 2024-09-11T22:29:19.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.098+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a281043f0 con 0x7f0a28104010 2024-09-11T22:29:19.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.099+0000 7f0a1fe00640 1 -- 172.21.15.40:0/2341284601 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0a18042030 con 0x7f0a28104010 2024-09-11T22:29:19.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.101+0000 7f0a1fe00640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.101+0000 7f0a1fe00640 1 -- 172.21.15.40:0/2341284601 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f0a180ef990 con 0x7f0a28104010 2024-09-11T22:29:19.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.101+0000 7f0a1e000640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.102+0000 7f0a1e000640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a280fff70 tx=0x7f0a10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:19.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.103+0000 7f0a1fe00640 1 -- 172.21.15.40:0/2341284601 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a180bbf00 con 0x7f0a28104010 2024-09-11T22:29:19.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.315+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0a28062630 con 0x7f0a0c0a2b80 2024-09-11T22:29:19.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.347+0000 7f0a1fe00640 1 -- 172.21.15.40:0/2341284601 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0a28062630 con 0x7f0a0c0a2b80 2024-09-11T22:29:19.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.349+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0a0c0a2b80 msgr2=0x7f0a0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.349+0000 7f0a2d600640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a280fff70 tx=0x7f0a10005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:19.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.349+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 msgr2=0x7f0a2819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.349+0000 7f0a2d600640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 0x7f0a2819a630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a18006010 tx=0x7f0a18004040 comp rx=0 tx=0).stop 2024-09-11T22:29:19.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.350+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 shutdown_connections 2024-09-11T22:29:19.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.350+0000 7f0a2d600640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0a0c0a2b80 0x7f0a0c0a5040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.350+0000 7f0a2d600640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a28109140 0x7f0a2819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.350+0000 7f0a2d600640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a281049c0 0x7f0a2819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.350+0000 7f0a2d600640 1 --2- 172.21.15.40:0/2341284601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a28104010 0x7f0a2819a630 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.350+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 >> 172.21.15.40:0/2341284601 conn(0x7f0a280ffa50 msgr2=0x7f0a28100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:19.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.350+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 shutdown_connections 2024-09-11T22:29:19.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:19.350+0000 7f0a2d600640 1 -- 172.21.15.40:0/2341284601 wait complete. 2024-09-11T22:29:19.682 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:29:19 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:29:19.321+0000 7f0dee000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:19.683 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:29:19 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:29:19.321+0000 7f0dee000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:19.683 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:29:19 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:29:19.321+0000 7f0dee000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:19.683 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:29:19 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:29:19.321+0000 7f0dee000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:19.683 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:29:19 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:29:19.321+0000 7f0dee000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T22:29:20.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T22:29:20.427 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:20.725 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:20 smithi040 ceph-mon[30787]: pgmap v334: 129 pgs: 129 active+clean; 584 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-11T22:29:20.726 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:20 smithi040 ceph-mon[30787]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:20.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:20 smithi177 ceph-mon[35530]: pgmap v334: 129 pgs: 129 active+clean; 584 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-11T22:29:20.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:20 smithi177 ceph-mon[35530]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:20.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:20 smithi146 ceph-mon[34996]: pgmap v334: 129 pgs: 129 active+clean; 584 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-11T22:29:20.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:20 smithi146 ceph-mon[34996]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:20.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.981+0000 7efcfe000640 1 -- 172.21.15.40:0/3881123719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 msgr2=0x7efcf8104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:20.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.981+0000 7efcfe000640 1 --2- 172.21.15.40:0/3881123719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 0x7efcf8104210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efcec009900 tx=0x7efcec02a3f0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.981+0000 7efcfe000640 1 -- 172.21.15.40:0/3881123719 shutdown_connections 2024-09-11T22:29:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.981+0000 7efcfe000640 1 --2- 172.21.15.40:0/3881123719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8108f60 0x7efcf8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.981+0000 7efcfe000640 1 --2- 172.21.15.40:0/3881123719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcf81047e0 0x7efcf8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.981+0000 7efcfe000640 1 --2- 172.21.15.40:0/3881123719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 0x7efcf8104210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.981+0000 7efcfe000640 1 -- 172.21.15.40:0/3881123719 >> 172.21.15.40:0/3881123719 conn(0x7efcf80ff8d0 msgr2=0x7efcf8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.981+0000 7efcfe000640 1 -- 172.21.15.40:0/3881123719 shutdown_connections 2024-09-11T22:29:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.981+0000 7efcfe000640 1 -- 172.21.15.40:0/3881123719 wait complete. 2024-09-11T22:29:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.982+0000 7efcfe000640 1 Processor -- start 2024-09-11T22:29:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.982+0000 7efcfe000640 1 -- start start 2024-09-11T22:29:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.982+0000 7efcfe000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 0x7efcf819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.982+0000 7efcfe000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcf81047e0 0x7efcf819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.982+0000 7efcfe000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8108f60 0x7efcf819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.982+0000 7efcfe000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8113fd0 con 0x7efcf81047e0 2024-09-11T22:29:20.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.982+0000 7efcfe000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8113e50 con 0x7efcf8108f60 2024-09-11T22:29:20.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.982+0000 7efcfe000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8114150 con 0x7efcf8103e30 2024-09-11T22:29:20.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfcc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 0x7efcf819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:20.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfcc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 0x7efcf819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:46654/0 (socket says 172.21.15.40:46654) 2024-09-11T22:29:20.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfcc00640 1 -- 172.21.15.40:0/1851393023 learned_addr learned my addr 172.21.15.40:0/1851393023 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:20.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcf7e00640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcf81047e0 0x7efcf819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:20.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfd600640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8108f60 0x7efcf819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:20.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfcc00640 1 -- 172.21.15.40:0/1851393023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8108f60 msgr2=0x7efcf819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:20.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfcc00640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8108f60 0x7efcf819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfcc00640 1 -- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcf81047e0 msgr2=0x7efcf819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:20.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfcc00640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcf81047e0 0x7efcf819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:20.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfcc00640 1 -- 172.21.15.40:0/1851393023 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf819f420 con 0x7efcf8103e30 2024-09-11T22:29:20.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcf7e00640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcf81047e0 0x7efcf819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:20.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.983+0000 7efcfd600640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8108f60 0x7efcf819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:20.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.984+0000 7efcfcc00640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 0x7efcf819a470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efcec004770 tx=0x7efcec003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:20.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.984+0000 7efcf5600640 1 -- 172.21.15.40:0/1851393023 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec03f070 con 0x7efcf8103e30 2024-09-11T22:29:20.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.984+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf819f6b0 con 0x7efcf8103e30 2024-09-11T22:29:20.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.984+0000 7efcf5600640 1 -- 172.21.15.40:0/1851393023 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcec031ca0 con 0x7efcf8103e30 2024-09-11T22:29:20.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.984+0000 7efcf5600640 1 -- 172.21.15.40:0/1851393023 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec035030 con 0x7efcf8103e30 2024-09-11T22:29:20.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.984+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf81a6ff0 con 0x7efcf8103e30 2024-09-11T22:29:20.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.986+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf8105310 con 0x7efcf8103e30 2024-09-11T22:29:20.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.987+0000 7efcf5600640 1 -- 172.21.15.40:0/1851393023 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efcec042070 con 0x7efcf8103e30 2024-09-11T22:29:20.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.989+0000 7efcf5600640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efce00a2b80 0x7efce00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:20.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.989+0000 7efcf5600640 1 -- 172.21.15.40:0/1851393023 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7efcec0efa80 con 0x7efcf8103e30 2024-09-11T22:29:20.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.989+0000 7efcf7e00640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efce00a2b80 0x7efce00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:20.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.990+0000 7efcf7e00640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efce00a2b80 0x7efce00a5040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efcf80ffcf0 tx=0x7efce4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:20.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:20.993+0000 7efcf5600640 1 -- 172.21.15.40:0/1851393023 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcec0f1e20 con 0x7efcf8103e30 2024-09-11T22:29:21.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.203+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7efcf810c1b0 con 0x7efce00a2b80 2024-09-11T22:29:21.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.229+0000 7efcf5600640 1 -- 172.21.15.40:0/1851393023 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efce4004030 con 0x7efce00a2b80 2024-09-11T22:29:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.231+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efce00a2b80 msgr2=0x7efce00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.231+0000 7efcfe000640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efce00a2b80 0x7efce00a5040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efcf80ffcf0 tx=0x7efce4005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.231+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 msgr2=0x7efcf819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.231+0000 7efcfe000640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 0x7efcf819a470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efcec004770 tx=0x7efcec003c10 comp rx=0 tx=0).stop 2024-09-11T22:29:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.232+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 shutdown_connections 2024-09-11T22:29:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.232+0000 7efcfe000640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efce00a2b80 0x7efce00a5040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.232+0000 7efcfe000640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf8108f60 0x7efcf819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.232+0000 7efcfe000640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcf81047e0 0x7efcf819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.232+0000 7efcfe000640 1 --2- 172.21.15.40:0/1851393023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efcf8103e30 0x7efcf819a470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.232+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 >> 172.21.15.40:0/1851393023 conn(0x7efcf80ff8d0 msgr2=0x7efcf8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:21.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.232+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 shutdown_connections 2024-09-11T22:29:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:21.232+0000 7efcfe000640 1 -- 172.21.15.40:0/1851393023 wait complete. 2024-09-11T22:29:21.997 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T22:29:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:22.699 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:22 smithi040 ceph-mon[30787]: pgmap v335: 129 pgs: 129 active+clean; 584 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-11T22:29:22.700 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:22 smithi040 ceph-mon[30787]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:22.700 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:22 smithi040 ceph-mon[30787]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-11T22:29:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:22 smithi177 ceph-mon[35530]: pgmap v335: 129 pgs: 129 active+clean; 584 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-11T22:29:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:22 smithi177 ceph-mon[35530]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:22 smithi177 ceph-mon[35530]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-11T22:29:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:22 smithi146 ceph-mon[34996]: pgmap v335: 129 pgs: 129 active+clean; 584 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-11T22:29:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:22 smithi146 ceph-mon[34996]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:22 smithi146 ceph-mon[34996]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-11T22:29:22.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.955+0000 7fdb13200640 1 -- 172.21.15.40:0/1364651716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb14103e30 msgr2=0x7fdb14104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:22.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.955+0000 7fdb13200640 1 --2- 172.21.15.40:0/1364651716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb14103e30 0x7fdb14104210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009900 tx=0x7fdb0402a410 comp rx=0 tx=0).stop 2024-09-11T22:29:22.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.955+0000 7fdb13200640 1 -- 172.21.15.40:0/1364651716 shutdown_connections 2024-09-11T22:29:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.955+0000 7fdb13200640 1 --2- 172.21.15.40:0/1364651716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb14108f60 0x7fdb14110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.955+0000 7fdb13200640 1 --2- 172.21.15.40:0/1364651716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb141047e0 0x7fdb14108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.955+0000 7fdb13200640 1 --2- 172.21.15.40:0/1364651716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb14103e30 0x7fdb14104210 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.955+0000 7fdb13200640 1 -- 172.21.15.40:0/1364651716 >> 172.21.15.40:0/1364651716 conn(0x7fdb140ff910 msgr2=0x7fdb14101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.955+0000 7fdb13200640 1 -- 172.21.15.40:0/1364651716 shutdown_connections 2024-09-11T22:29:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.955+0000 7fdb13200640 1 -- 172.21.15.40:0/1364651716 wait complete. 2024-09-11T22:29:22.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.956+0000 7fdb13200640 1 Processor -- start 2024-09-11T22:29:22.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb13200640 1 -- start start 2024-09-11T22:29:22.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb13200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb14103e30 0x7fdb1419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb13200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb141047e0 0x7fdb1419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb13200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb14108f60 0x7fdb1419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb13200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14113fc0 con 0x7fdb141047e0 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb13200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14113e40 con 0x7fdb14108f60 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb13200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14114140 con 0x7fdb14103e30 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb141047e0 0x7fdb1419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb141047e0 0x7fdb1419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48240/0 (socket says 172.21.15.40:48240) 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb0be00640 1 -- 172.21.15.40:0/1710641803 learned_addr learned my addr 172.21.15.40:0/1710641803 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.957+0000 7fdb11e00640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb14103e30 0x7fdb1419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.958+0000 7fdb12800640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb14108f60 0x7fdb1419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.958+0000 7fdb0be00640 1 -- 172.21.15.40:0/1710641803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb14103e30 msgr2=0x7fdb1419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:22.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.958+0000 7fdb0be00640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb14103e30 0x7fdb1419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.958+0000 7fdb0be00640 1 -- 172.21.15.40:0/1710641803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb14108f60 msgr2=0x7fdb1419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.958+0000 7fdb0be00640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb14108f60 0x7fdb1419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.958+0000 7fdb0be00640 1 -- 172.21.15.40:0/1710641803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1419f470 con 0x7fdb141047e0 2024-09-11T22:29:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.958+0000 7fdb12800640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb14108f60 0x7fdb1419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.958+0000 7fdb11e00640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb14103e30 0x7fdb1419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.958+0000 7fdb0be00640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb141047e0 0x7fdb1419aa00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00d950 tx=0x7fdafc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.959+0000 7fdb0aa00640 1 -- 172.21.15.40:0/1710641803 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc017070 con 0x7fdb141047e0 2024-09-11T22:29:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.959+0000 7fdb0aa00640 1 -- 172.21.15.40:0/1710641803 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdafc009c30 con 0x7fdb141047e0 2024-09-11T22:29:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.959+0000 7fdb0aa00640 1 -- 172.21.15.40:0/1710641803 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00f6b0 con 0x7fdb141047e0 2024-09-11T22:29:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.959+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1419f760 con 0x7fdb141047e0 2024-09-11T22:29:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.959+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb141a7040 con 0x7fdb141047e0 2024-09-11T22:29:22.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.960+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb14104210 con 0x7fdb141047e0 2024-09-11T22:29:22.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.962+0000 7fdb0aa00640 1 -- 172.21.15.40:0/1710641803 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdafc0109d0 con 0x7fdb141047e0 2024-09-11T22:29:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.964+0000 7fdb0aa00640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdaf80a2c90 0x7fdaf80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.964+0000 7fdb0aa00640 1 -- 172.21.15.40:0/1710641803 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7fdafc0cf160 con 0x7fdb141047e0 2024-09-11T22:29:22.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.964+0000 7fdb11e00640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdaf80a2c90 0x7fdaf80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.965+0000 7fdb11e00640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdaf80a2c90 0x7fdaf80a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009230 tx=0x7fdb040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:22.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:22.969+0000 7fdb0aa00640 1 -- 172.21.15.40:0/1710641803 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdafc009de0 con 0x7fdb141047e0 2024-09-11T22:29:23.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.182+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fdb14062630 con 0x7fdaf80a2c90 2024-09-11T22:29:23.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.188+0000 7fdb0aa00640 1 -- 172.21.15.40:0/1710641803 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fdb14062630 con 0x7fdaf80a2c90 2024-09-11T22:29:23.189 INFO:teuthology.orchestra.run.smithi040.stdout:/volumes/qa/sv_0/e24518f7-df63-4bca-a109-3264c2733af7 2024-09-11T22:29:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.190+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdaf80a2c90 msgr2=0x7fdaf80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdaf80a2c90 0x7fdaf80a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009230 tx=0x7fdb040058d0 comp rx=0 tx=0).stop 2024-09-11T22:29:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb141047e0 msgr2=0x7fdb1419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:23.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb141047e0 0x7fdb1419aa00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00d950 tx=0x7fdafc00de10 comp rx=0 tx=0).stop 2024-09-11T22:29:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 shutdown_connections 2024-09-11T22:29:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdaf80a2c90 0x7fdaf80a5150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb14108f60 0x7fdb1419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb141047e0 0x7fdb1419aa00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 --2- 172.21.15.40:0/1710641803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb14103e30 0x7fdb1419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 >> 172.21.15.40:0/1710641803 conn(0x7fdb140ff910 msgr2=0x7fdb14100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 shutdown_connections 2024-09-11T22:29:23.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:23.191+0000 7fdb13200640 1 -- 172.21.15.40:0/1710641803 wait complete. 2024-09-11T22:29:23.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T22:29:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:24.651 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:24 smithi040 ceph-mon[30787]: pgmap v336: 129 pgs: 129 active+clean; 605 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-11T22:29:24.652 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:24 smithi040 ceph-mon[30787]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:24.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:24 smithi177 ceph-mon[35530]: pgmap v336: 129 pgs: 129 active+clean; 605 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-11T22:29:24.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:24 smithi177 ceph-mon[35530]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:24.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:24 smithi146 ceph-mon[34996]: pgmap v336: 129 pgs: 129 active+clean; 605 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-11T22:29:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:24 smithi146 ceph-mon[34996]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.894+0000 7f0f64c00640 1 -- 172.21.15.40:0/1134734391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60108f60 msgr2=0x7f0f60110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.894+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1134734391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60108f60 0x7f0f60110ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009ca0 tx=0x7f0f5802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.894+0000 7f0f64c00640 1 -- 172.21.15.40:0/1134734391 shutdown_connections 2024-09-11T22:29:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.894+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1134734391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60108f60 0x7f0f60110ae0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.894+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1134734391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f601047e0 0x7f0f60108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.894+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1134734391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f60103e30 0x7f0f60104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.894+0000 7f0f64c00640 1 -- 172.21.15.40:0/1134734391 >> 172.21.15.40:0/1134734391 conn(0x7f0f600ff8d0 msgr2=0x7f0f60101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:24.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.894+0000 7f0f64c00640 1 -- 172.21.15.40:0/1134734391 shutdown_connections 2024-09-11T22:29:24.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.895+0000 7f0f64c00640 1 -- 172.21.15.40:0/1134734391 wait complete. 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.895+0000 7f0f64c00640 1 Processor -- start 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f64c00640 1 -- start start 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f64c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60103e30 0x7f0f6019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f64c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f601047e0 0x7f0f6019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f64c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f60108f60 0x7f0f6019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f64c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60113fc0 con 0x7f0f60103e30 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f64c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60113e40 con 0x7f0f601047e0 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f64c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60114140 con 0x7f0f60108f60 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f5f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60103e30 0x7f0f6019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f5f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60103e30 0x7f0f6019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48262/0 (socket says 172.21.15.40:48262) 2024-09-11T22:29:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.896+0000 7f0f5f400640 1 -- 172.21.15.40:0/1301652491 learned_addr learned my addr 172.21.15.40:0/1301652491 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.897+0000 7f0f5fe00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f60108f60 0x7f0f6019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.897+0000 7f0f5ea00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f601047e0 0x7f0f6019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.897+0000 7f0f5f400640 1 -- 172.21.15.40:0/1301652491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f60108f60 msgr2=0x7f0f6019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.897+0000 7f0f5f400640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f60108f60 0x7f0f6019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.897+0000 7f0f5f400640 1 -- 172.21.15.40:0/1301652491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f601047e0 msgr2=0x7f0f6019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.897+0000 7f0f5f400640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f601047e0 0x7f0f6019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.897+0000 7f0f5f400640 1 -- 172.21.15.40:0/1301652491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6019f3b0 con 0x7f0f60103e30 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.897+0000 7f0f5ea00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f601047e0 0x7f0f6019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.897+0000 7f0f5f400640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60103e30 0x7f0f6019a400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000e9f0 tx=0x7f0f5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.898+0000 7f0f57e00640 1 -- 172.21.15.40:0/1301652491 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000cd80 con 0x7f0f60103e30 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.898+0000 7f0f57e00640 1 -- 172.21.15.40:0/1301652491 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f50005500 con 0x7f0f60103e30 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.898+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6019f6a0 con 0x7f0f60103e30 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.898+0000 7f0f57e00640 1 -- 172.21.15.40:0/1301652491 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50010690 con 0x7f0f60103e30 2024-09-11T22:29:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.898+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f601a6f80 con 0x7f0f60103e30 2024-09-11T22:29:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.899+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f60104210 con 0x7f0f60103e30 2024-09-11T22:29:24.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.901+0000 7f0f57e00640 1 -- 172.21.15.40:0/1301652491 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0f500046c0 con 0x7f0f60103e30 2024-09-11T22:29:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.902+0000 7f0f57e00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0f440a2c10 0x7f0f440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.902+0000 7f0f57e00640 1 -- 172.21.15.40:0/1301652491 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f0f500cf950 con 0x7f0f60103e30 2024-09-11T22:29:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.902+0000 7f0f5ea00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0f440a2c10 0x7f0f440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:24.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.903+0000 7f0f5ea00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0f440a2c10 0x7f0f440a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0f6010a930 tx=0x7f0f4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:24.906+0000 7f0f57e00640 1 -- 172.21.15.40:0/1301652491 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f5009c3b0 con 0x7f0f60103e30 2024-09-11T22:29:25.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.117+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0f6010c210 con 0x7f0f440a2c10 2024-09-11T22:29:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.144+0000 7f0f57e00640 1 -- 172.21.15.40:0/1301652491 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0f4c004030 con 0x7f0f440a2c10 2024-09-11T22:29:25.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0f440a2c10 msgr2=0x7f0f440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:25.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0f440a2c10 0x7f0f440a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0f6010a930 tx=0x7f0f4c005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60103e30 msgr2=0x7f0f6019a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60103e30 0x7f0f6019a400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000e9f0 tx=0x7f0f5000edf0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 shutdown_connections 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0f440a2c10 0x7f0f440a50d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f60108f60 0x7f0f6019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f601047e0 0x7f0f6019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 --2- 172.21.15.40:0/1301652491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f60103e30 0x7f0f6019a400 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 >> 172.21.15.40:0/1301652491 conn(0x7f0f600ff8d0 msgr2=0x7f0f60100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 shutdown_connections 2024-09-11T22:29:25.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:25.146+0000 7f0f64c00640 1 -- 172.21.15.40:0/1301652491 wait complete. 2024-09-11T22:29:25.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T22:29:26.227 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:26.553 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:26 smithi040 ceph-mon[30787]: pgmap v337: 129 pgs: 129 active+clean; 605 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 12 op/s 2024-09-11T22:29:26.553 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:26 smithi040 ceph-mon[30787]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:26.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:26 smithi177 ceph-mon[35530]: pgmap v337: 129 pgs: 129 active+clean; 605 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 12 op/s 2024-09-11T22:29:26.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:26 smithi177 ceph-mon[35530]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.827+0000 7ff892200640 1 -- 172.21.15.40:0/1641520743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff88c1049c0 msgr2=0x7ff88c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.827+0000 7ff892200640 1 --2- 172.21.15.40:0/1641520743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff88c1049c0 0x7ff88c108a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff874009900 tx=0x7ff87402a410 comp rx=0 tx=0).stop 2024-09-11T22:29:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.827+0000 7ff892200640 1 -- 172.21.15.40:0/1641520743 shutdown_connections 2024-09-11T22:29:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.827+0000 7ff892200640 1 --2- 172.21.15.40:0/1641520743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff88c109140 0x7ff88c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.827+0000 7ff892200640 1 --2- 172.21.15.40:0/1641520743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff88c1049c0 0x7ff88c108a10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.827+0000 7ff892200640 1 --2- 172.21.15.40:0/1641520743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff88c104010 0x7ff88c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.827+0000 7ff892200640 1 -- 172.21.15.40:0/1641520743 >> 172.21.15.40:0/1641520743 conn(0x7ff88c0ffa50 msgr2=0x7ff88c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.827+0000 7ff892200640 1 -- 172.21.15.40:0/1641520743 shutdown_connections 2024-09-11T22:29:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.827+0000 7ff892200640 1 -- 172.21.15.40:0/1641520743 wait complete. 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.828+0000 7ff892200640 1 Processor -- start 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.828+0000 7ff892200640 1 -- start start 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff892200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff88c104010 0x7ff88c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff892200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff88c1049c0 0x7ff88c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff892200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff88c109140 0x7ff88c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff892200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c1141b0 con 0x7ff88c1049c0 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff892200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c114030 con 0x7ff88c104010 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff892200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c114330 con 0x7ff88c109140 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff88b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff88c104010 0x7ff88c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff88b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff88c104010 0x7ff88c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:40590/0 (socket says 172.21.15.40:40590) 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff88b400640 1 -- 172.21.15.40:0/699802278 learned_addr learned my addr 172.21.15.40:0/699802278 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff883e00640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff88c1049c0 0x7ff88c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff88be00640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff88c109140 0x7ff88c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff88b400640 1 -- 172.21.15.40:0/699802278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff88c109140 msgr2=0x7ff88c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff88b400640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff88c109140 0x7ff88c19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff88b400640 1 -- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff88c1049c0 msgr2=0x7ff88c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff88b400640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff88c1049c0 0x7ff88c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.829+0000 7ff88b400640 1 -- 172.21.15.40:0/699802278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c19f6a0 con 0x7ff88c104010 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.830+0000 7ff88b400640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff88c104010 0x7ff88c19a6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00e9f0 tx=0x7ff87c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.830+0000 7ff888c00640 1 -- 172.21.15.40:0/699802278 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00cd80 con 0x7ff88c104010 2024-09-11T22:29:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.830+0000 7ff888c00640 1 -- 172.21.15.40:0/699802278 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff87c010910 con 0x7ff88c104010 2024-09-11T22:29:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.830+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c19f990 con 0x7ff88c104010 2024-09-11T22:29:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.830+0000 7ff888c00640 1 -- 172.21.15.40:0/699802278 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c018990 con 0x7ff88c104010 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.830+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c1a7270 con 0x7ff88c104010 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.831+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88c1043f0 con 0x7ff88c104010 2024-09-11T22:29:26.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:26 smithi146 ceph-mon[34996]: pgmap v337: 129 pgs: 129 active+clean; 605 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 12 op/s 2024-09-11T22:29:26.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:26 smithi146 ceph-mon[34996]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:26.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.833+0000 7ff888c00640 1 -- 172.21.15.40:0/699802278 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff87c010ac0 con 0x7ff88c104010 2024-09-11T22:29:26.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.834+0000 7ff888c00640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff8700a2c10 0x7ff8700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.835+0000 7ff888c00640 1 -- 172.21.15.40:0/699802278 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7ff87c0cf880 con 0x7ff88c104010 2024-09-11T22:29:26.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.835+0000 7ff883e00640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff8700a2c10 0x7ff8700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.835+0000 7ff883e00640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff8700a2c10 0x7ff8700a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff874000c00 tx=0x7ff874005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:26.839+0000 7ff888c00640 1 -- 172.21.15.40:0/699802278 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff87c09bc90 con 0x7ff88c104010 2024-09-11T22:29:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.052+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ff88c062630 con 0x7ff8700a2c10 2024-09-11T22:29:27.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.057+0000 7ff888c00640 1 -- 172.21.15.40:0/699802278 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ff88c062630 con 0x7ff8700a2c10 2024-09-11T22:29:27.057 INFO:teuthology.orchestra.run.smithi040.stdout:/volumes/qa/sv_1/3afc77d6-9cb9-46ce-97b9-46e96430fc46 2024-09-11T22:29:27.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff8700a2c10 msgr2=0x7ff8700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:27.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff8700a2c10 0x7ff8700a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff874000c00 tx=0x7ff874005b50 comp rx=0 tx=0).stop 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff88c104010 msgr2=0x7ff88c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff88c104010 0x7ff88c19a6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00e9f0 tx=0x7ff87c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 shutdown_connections 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff8700a2c10 0x7ff8700a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff88c109140 0x7ff88c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff88c1049c0 0x7ff88c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 --2- 172.21.15.40:0/699802278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff88c104010 0x7ff88c19a6f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 >> 172.21.15.40:0/699802278 conn(0x7ff88c0ffa50 msgr2=0x7ff88c100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 shutdown_connections 2024-09-11T22:29:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:27.059+0000 7ff892200640 1 -- 172.21.15.40:0/699802278 wait complete. 2024-09-11T22:29:27.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:29:28.184 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:28.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:28 smithi040 ceph-mon[30787]: pgmap v338: 129 pgs: 129 active+clean; 623 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-09-11T22:29:28.653 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:28 smithi040 ceph-mon[30787]: from='client.24716 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:28.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.765+0000 7f7c95800640 1 -- 172.21.15.40:0/2014251645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c901047e0 msgr2=0x7f7c90108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:28.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.765+0000 7f7c95800640 1 --2- 172.21.15.40:0/2014251645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c901047e0 0x7f7c90108830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009900 tx=0x7f7c7802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:29:28.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.765+0000 7f7c95800640 1 -- 172.21.15.40:0/2014251645 shutdown_connections 2024-09-11T22:29:28.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.765+0000 7f7c95800640 1 --2- 172.21.15.40:0/2014251645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90108f60 0x7f7c90110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:28.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.765+0000 7f7c95800640 1 --2- 172.21.15.40:0/2014251645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c901047e0 0x7f7c90108830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:28.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.765+0000 7f7c95800640 1 --2- 172.21.15.40:0/2014251645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c90103e30 0x7f7c90104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:28.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.765+0000 7f7c95800640 1 -- 172.21.15.40:0/2014251645 >> 172.21.15.40:0/2014251645 conn(0x7f7c900ff910 msgr2=0x7f7c90101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:28.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.765+0000 7f7c95800640 1 -- 172.21.15.40:0/2014251645 shutdown_connections 2024-09-11T22:29:28.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.765+0000 7f7c95800640 1 -- 172.21.15.40:0/2014251645 wait complete. 2024-09-11T22:29:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.766+0000 7f7c95800640 1 Processor -- start 2024-09-11T22:29:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.766+0000 7f7c95800640 1 -- start start 2024-09-11T22:29:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c95800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c90103e30 0x7f7c9019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c95800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c901047e0 0x7f7c9019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c95800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90108f60 0x7f7c9019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c95800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7c90113fc0 con 0x7f7c90103e30 2024-09-11T22:29:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c95800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c90113e40 con 0x7f7c901047e0 2024-09-11T22:29:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c95800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c90114140 con 0x7f7c90108f60 2024-09-11T22:29:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c94e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90108f60 0x7f7c9019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c8fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c90103e30 0x7f7c9019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c94e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90108f60 0x7f7c9019ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:34828/0 (socket says 172.21.15.40:34828) 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c94e00640 1 -- 172.21.15.40:0/3782289259 learned_addr learned my addr 172.21.15.40:0/3782289259 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c87e00640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c901047e0 0x7f7c9019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c94e00640 1 -- 172.21.15.40:0/3782289259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c901047e0 msgr2=0x7f7c9019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c94e00640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c901047e0 0x7f7c9019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c94e00640 1 -- 172.21.15.40:0/3782289259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c90103e30 msgr2=0x7f7c9019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c94e00640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c90103e30 0x7f7c9019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.767+0000 7f7c94e00640 1 -- 172.21.15.40:0/3782289259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9019f430 con 0x7f7c90108f60 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.768+0000 7f7c94e00640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90108f60 0x7f7c9019ed50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800eb10 tx=0x7f7c8800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.768+0000 7f7c8d600640 1 -- 172.21.15.40:0/3782289259 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88004b20 con 0x7f7c90108f60 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.768+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9019f720 con 0x7f7c90108f60 2024-09-11T22:29:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.768+0000 7f7c8d600640 1 -- 172.21.15.40:0/3782289259 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c88004cc0 con 0x7f7c90108f60 2024-09-11T22:29:28.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.768+0000 7f7c8d600640 1 -- 172.21.15.40:0/3782289259 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88010760 con 0x7f7c90108f60 2024-09-11T22:29:28.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.768+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c901a7000 con 0x7f7c90108f60 2024-09-11T22:29:28.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.769+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c90105310 con 0x7f7c90108f60 2024-09-11T22:29:28.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.771+0000 7f7c8d600640 1 -- 172.21.15.40:0/3782289259 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7c88010900 con 0x7f7c90108f60 2024-09-11T22:29:28.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.772+0000 7f7c8d600640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c740a2c10 0x7f7c740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:28.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.773+0000 7f7c8d600640 1 -- 172.21.15.40:0/3782289259 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f7c880cffd0 con 0x7f7c90108f60 2024-09-11T22:29:28.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.773+0000 7f7c8fe00640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c740a2c10 0x7f7c740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:28.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.773+0000 7f7c8fe00640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c740a2c10 0x7f7c740a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7c80005d00 tx=0x7f7c8000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:28.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.774+0000 7f7c8d600640 1 -- 172.21.15.40:0/3782289259 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c8809ca30 con 0x7f7c90108f60 2024-09-11T22:29:28.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:28 smithi177 ceph-mon[35530]: pgmap v338: 129 pgs: 129 active+clean; 623 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-09-11T22:29:28.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:28 smithi177 ceph-mon[35530]: from='client.24716 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:28.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:28 smithi146 ceph-mon[34996]: pgmap v338: 129 pgs: 129 active+clean; 623 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-09-11T22:29:28.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:28 smithi146 ceph-mon[34996]: from='client.24716 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:29:28.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.998+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c90104210 con 0x7f7c90108f60 2024-09-11T22:29:28.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:28.999+0000 7f7c8d600640 1 -- 172.21.15.40:0/3782289259 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f7c90104210 con 0x7f7c90108f60 2024-09-11T22:29:28.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:29:28.999 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"btime":"2024-09-11T22:29:17:363470+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:29:16.869039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24517,"mds_2":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24499,24517,24527]},"id":1}]} 2024-09-11T22:29:29.000 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 25 2024-09-11T22:29:29.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c740a2c10 msgr2=0x7f7c740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c740a2c10 0x7f7c740a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7c80005d00 tx=0x7f7c8000b410 comp rx=0 tx=0).stop 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90108f60 msgr2=0x7f7c9019ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90108f60 0x7f7c9019ed50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800eb10 tx=0x7f7c8800c2d0 comp rx=0 tx=0).stop 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 shutdown_connections 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c740a2c10 0x7f7c740a50d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c90108f60 0x7f7c9019ed50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c901047e0 0x7f7c9019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 --2- 172.21.15.40:0/3782289259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c90103e30 0x7f7c9019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 >> 172.21.15.40:0/3782289259 conn(0x7f7c900ff910 msgr2=0x7f7c90100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 shutdown_connections 2024-09-11T22:29:29.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:29.001+0000 7f7c95800640 1 -- 172.21.15.40:0/3782289259 wait complete. 2024-09-11T22:29:29.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:29 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3782289259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:29.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:29:29.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:29 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3782289259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:29.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:29 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3782289259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:29:30.154 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:30.595 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:30 smithi040 ceph-mon[30787]: pgmap v339: 129 pgs: 129 active+clean; 623 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.6 KiB/s wr, 10 op/s 2024-09-11T22:29:30.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.708+0000 7fbbeaa00640 1 -- 172.21.15.40:0/4286518130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4103ff0 msgr2=0x7fbbe41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:30.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.708+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/4286518130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4103ff0 0x7fbbe41043d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009900 tx=0x7fbbd402a410 comp rx=0 tx=0).stop 2024-09-11T22:29:30.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.708+0000 7fbbeaa00640 1 -- 172.21.15.40:0/4286518130 shutdown_connections 2024-09-11T22:29:30.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.708+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/4286518130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe4109120 0x7fbbe4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.708+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/4286518130 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe41049a0 0x7fbbe41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.708+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/4286518130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe4103ff0 0x7fbbe41043d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.708+0000 7fbbeaa00640 1 -- 172.21.15.40:0/4286518130 >> 172.21.15.40:0/4286518130 conn(0x7fbbe40ffa90 msgr2=0x7fbbe4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.708+0000 7fbbeaa00640 1 -- 172.21.15.40:0/4286518130 shutdown_connections 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.708+0000 7fbbeaa00640 1 -- 172.21.15.40:0/4286518130 wait complete. 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.709+0000 7fbbeaa00640 1 Processor -- start 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbeaa00640 1 -- start start 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe4103ff0 0x7fbbe419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe41049a0 0x7fbbe419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe4109120 0x7fbbe419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbeaa00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4114140 con 0x7fbbe41049a0 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbeaa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4113fc0 con 0x7fbbe4103ff0 2024-09-11T22:29:30.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbeaa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe41142c0 con 0x7fbbe4109120 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbe3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe41049a0 0x7fbbe419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbe3400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe41049a0 0x7fbbe419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48314/0 (socket says 172.21.15.40:48314) 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.710+0000 7fbbe3400640 1 -- 172.21.15.40:0/1484083085 learned_addr learned my addr 172.21.15.40:0/1484083085 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.711+0000 7fbbe8a00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe4109120 0x7fbbe419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.711+0000 7fbbe3e00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe4103ff0 0x7fbbe419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.711+0000 7fbbe3400640 1 -- 172.21.15.40:0/1484083085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe4109120 msgr2=0x7fbbe419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.711+0000 7fbbe3400640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe4109120 0x7fbbe419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.711+0000 7fbbe3400640 1 -- 172.21.15.40:0/1484083085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe4103ff0 msgr2=0x7fbbe419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.711+0000 7fbbe3400640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe4103ff0 0x7fbbe419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.711+0000 7fbbe3400640 1 -- 172.21.15.40:0/1484083085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe419f5b0 con 0x7fbbe41049a0 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.711+0000 7fbbe3400640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe41049a0 0x7fbbe419ab40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000e9f0 tx=0x7fbbd000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.712+0000 7fbbe0c00640 1 -- 172.21.15.40:0/1484083085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000cd80 con 0x7fbbe41049a0 2024-09-11T22:29:30.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.712+0000 7fbbe0c00640 1 -- 172.21.15.40:0/1484083085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbd0005500 con 0x7fbbe41049a0 2024-09-11T22:29:30.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.712+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe419f8a0 con 0x7fbbe41049a0 2024-09-11T22:29:30.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.712+0000 7fbbe0c00640 1 -- 172.21.15.40:0/1484083085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0010690 con 0x7fbbe41049a0 2024-09-11T22:29:30.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.712+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe41a7180 con 0x7fbbe41049a0 2024-09-11T22:29:30.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.713+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe41043d0 con 0x7fbbe41049a0 2024-09-11T22:29:30.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.715+0000 7fbbe0c00640 1 -- 172.21.15.40:0/1484083085 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbbd00046c0 con 0x7fbbe41049a0 2024-09-11T22:29:30.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.717+0000 7fbbe0c00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbbc80a2c10 0x7fbbc80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:30.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.717+0000 7fbbe0c00640 1 -- 172.21.15.40:0/1484083085 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7fbbd00cf950 con 0x7fbbe41049a0 2024-09-11T22:29:30.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.717+0000 7fbbe3e00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbbc80a2c10 0x7fbbc80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:30.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.718+0000 7fbbe3e00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbbc80a2c10 0x7fbbc80a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009230 tx=0x7fbbd40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:30.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.721+0000 7fbbe0c00640 1 -- 172.21.15.40:0/1484083085 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbbd009c3b0 con 0x7fbbe41049a0 2024-09-11T22:29:30.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:30 smithi177 ceph-mon[35530]: pgmap v339: 129 pgs: 129 active+clean; 623 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.6 KiB/s wr, 10 op/s 2024-09-11T22:29:30.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:30 smithi146 ceph-mon[34996]: pgmap v339: 129 pgs: 129 active+clean; 623 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.6 KiB/s wr, 10 op/s 2024-09-11T22:29:30.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.907+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbe402d7c0 con 0x7fbbe41049a0 2024-09-11T22:29:30.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.909+0000 7fbbe0c00640 1 -- 172.21.15.40:0/1484083085 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24737 (secure 0 0 0) 0x7fbbd009bcb0 con 0x7fbbe41049a0 2024-09-11T22:29:30.911 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:29:30.911 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":93,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:28:58.283874+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbbc80a2c10 msgr2=0x7fbbc80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbbc80a2c10 0x7fbbc80a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009230 tx=0x7fbbd40058d0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe41049a0 msgr2=0x7fbbe419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe41049a0 0x7fbbe419ab40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000e9f0 tx=0x7fbbd000edf0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 shutdown_connections 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbbc80a2c10 0x7fbbc80a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe4109120 0x7fbbe419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbe41049a0 0x7fbbe419ab40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 --2- 172.21.15.40:0/1484083085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbe4103ff0 0x7fbbe419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:30.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 >> 172.21.15.40:0/1484083085 conn(0x7fbbe40ffa90 msgr2=0x7fbbe4100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:30.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 shutdown_connections 2024-09-11T22:29:30.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:30.912+0000 7fbbeaa00640 1 -- 172.21.15.40:0/1484083085 wait complete. 2024-09-11T22:29:31.619 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:31 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1484083085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:31.659 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T22:29:31.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:29:31.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:31 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1484083085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:31.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:31 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1484083085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:32.039 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:32.465 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:32 smithi040 ceph-mon[30787]: pgmap v340: 129 pgs: 129 active+clean; 623 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.5 KiB/s wr, 8 op/s 2024-09-11T22:29:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.577+0000 7fb86d800640 1 -- 172.21.15.40:0/3181402531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb868108f60 msgr2=0x7fb868110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.577+0000 7fb86d800640 1 --2- 172.21.15.40:0/3181402531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb868108f60 0x7fb868110ae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb860009be0 tx=0x7fb86002a6c0 comp rx=0 tx=0).stop 2024-09-11T22:29:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.577+0000 7fb86d800640 1 -- 172.21.15.40:0/3181402531 shutdown_connections 2024-09-11T22:29:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.577+0000 7fb86d800640 1 --2- 172.21.15.40:0/3181402531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb868108f60 0x7fb868110ae0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.577+0000 7fb86d800640 1 --2- 172.21.15.40:0/3181402531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8681047e0 0x7fb868108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.577+0000 7fb86d800640 1 --2- 172.21.15.40:0/3181402531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb868103e30 0x7fb868104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.577+0000 7fb86d800640 1 -- 172.21.15.40:0/3181402531 >> 172.21.15.40:0/3181402531 conn(0x7fb8680ff8d0 msgr2=0x7fb868101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.577+0000 7fb86d800640 1 -- 172.21.15.40:0/3181402531 shutdown_connections 2024-09-11T22:29:32.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.577+0000 7fb86d800640 1 -- 172.21.15.40:0/3181402531 wait complete. 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.578+0000 7fb86d800640 1 Processor -- start 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.578+0000 7fb86d800640 1 -- start start 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.578+0000 7fb86d800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb868103e30 0x7fb86819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.578+0000 7fb86d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8681047e0 0x7fb86819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb86d800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb868108f60 0x7fb86819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb86d800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb868113fc0 con 0x7fb868108f60 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb86d800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb868113e40 con 0x7fb8681047e0 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb86d800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb868114140 con 0x7fb868103e30 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb86ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb868108f60 0x7fb86819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb85fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8681047e0 0x7fb86819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb85fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8681047e0 0x7fb86819a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:40766/0 (socket says 172.21.15.40:40766) 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb85fe00640 1 -- 172.21.15.40:0/3008807815 learned_addr learned my addr 172.21.15.40:0/3008807815 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:32.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb867e00640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb868103e30 0x7fb86819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb85fe00640 1 -- 172.21.15.40:0/3008807815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb868103e30 msgr2=0x7fb86819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb85fe00640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb868103e30 0x7fb86819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb85fe00640 1 -- 172.21.15.40:0/3008807815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb868108f60 msgr2=0x7fb86819ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb85fe00640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb868108f60 0x7fb86819ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.579+0000 7fb85fe00640 1 -- 172.21.15.40:0/3008807815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86819f3b0 con 0x7fb8681047e0 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.580+0000 7fb85fe00640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8681047e0 0x7fb86819a940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb85000e9c0 tx=0x7fb85000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.580+0000 7fb865600640 1 -- 172.21.15.40:0/3008807815 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85000cde0 con 0x7fb8681047e0 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.580+0000 7fb865600640 1 -- 172.21.15.40:0/3008807815 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8500035f0 con 0x7fb8681047e0 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.580+0000 7fb865600640 1 -- 172.21.15.40:0/3008807815 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850010690 con 0x7fb8681047e0 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.580+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86819f6a0 con 0x7fb8681047e0 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.580+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8681a6f80 con 0x7fb8681047e0 2024-09-11T22:29:32.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.581+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb868104210 con 0x7fb8681047e0 2024-09-11T22:29:32.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.583+0000 7fb865600640 1 -- 172.21.15.40:0/3008807815 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb8500037a0 con 0x7fb8681047e0 2024-09-11T22:29:32.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.584+0000 7fb865600640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb84c0a2c90 0x7fb84c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:32.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.585+0000 7fb865600640 1 -- 172.21.15.40:0/3008807815 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7fb8500cf770 con 0x7fb8681047e0 2024-09-11T22:29:32.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.585+0000 7fb867e00640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb84c0a2c90 0x7fb84c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:32.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.585+0000 7fb867e00640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb84c0a2c90 0x7fb84c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb858009bd0 tx=0x7fb858005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:32.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.588+0000 7fb865600640 1 -- 172.21.15.40:0/3008807815 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb85009c1d0 con 0x7fb8681047e0 2024-09-11T22:29:32.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.770+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb868062630 con 0x7fb84c0a2c90 2024-09-11T22:29:32.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.780+0000 7fb865600640 1 -- 172.21.15.40:0/3008807815 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340357 (secure 0 0 0) 0x7fb868062630 con 0x7fb84c0a2c90 2024-09-11T22:29:32.785 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:29:32.787 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T22:29:32.789 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:32 smithi177 ceph-mon[35530]: pgmap v340: 129 pgs: 129 active+clean; 623 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.5 KiB/s wr, 8 op/s 2024-09-11T22:29:32.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.784+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb84c0a2c90 msgr2=0x7fb84c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:32.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.784+0000 7fb86d800640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb84c0a2c90 0x7fb84c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb858009bd0 tx=0x7fb858005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:32.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.784+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8681047e0 msgr2=0x7fb86819a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:32.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.784+0000 7fb86d800640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8681047e0 0x7fb86819a940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb85000e9c0 tx=0x7fb85000ee80 comp rx=0 tx=0).stop 2024-09-11T22:29:32.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.785+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 shutdown_connections 2024-09-11T22:29:32.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.785+0000 7fb86d800640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb84c0a2c90 0x7fb84c0a5150 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb858009bd0 tx=0x7fb858005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:32.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.785+0000 7fb86d800640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb868108f60 0x7fb86819ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:32.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.785+0000 7fb86d800640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8681047e0 0x7fb86819a940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:32.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.785+0000 7fb86d800640 1 --2- 172.21.15.40:0/3008807815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb868103e30 0x7fb86819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:32.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.785+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 >> 172.21.15.40:0/3008807815 conn(0x7fb8680ff8d0 msgr2=0x7fb868100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:32.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.785+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 shutdown_connections 2024-09-11T22:29:32.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:32.785+0000 7fb86d800640 1 -- 172.21.15.40:0/3008807815 wait complete. 2024-09-11T22:29:32.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:32 smithi146 ceph-mon[34996]: pgmap v340: 129 pgs: 129 active+clean; 623 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.5 KiB/s wr, 8 op/s 2024-09-11T22:29:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-11T22:29:30.999854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638343,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":229,"num_read_kb":212,"num_write":343,"num_write_kb":3035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363716,"kb_used_data":14468,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578108,"statfs":{"total":1151940427776,"available":1151567982592,"internally_reserved":0,"allocated":14815232,"data_stored":8215775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40521,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":72,"num_write":33,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003064"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.362199+0000","last_change":"2024-09-11T22:28:18.585171+0000","last_active":"2024-09-11T22:29:13.362199+0000","last_peered":"2024-09-11T22:29:13.362199+0000","last_clean":"2024-09-11T22:29:13.362199+0000","last_became_active":"2024-09-11T22:28:18.584790+0000","last_became_peered":"2024-09-11T22:28:18.584790+0000","last_unstale":"2024-09-11T22:29:13.362199+0000","last_undegraded":"2024-09-11T22:29:13.362199+0000","last_fullsized":"2024-09-11T22:29:13.362199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:53.528254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288756+0000","last_change":"2024-09-11T22:28:21.126670+0000","last_active":"2024-09-11T22:28:58.288756+0000","last_peered":"2024-09-11T22:28:58.288756+0000","last_clean":"2024-09-11T22:28:58.288756+0000","last_became_active":"2024-09-11T22:28:21.126352+0000","last_became_peered":"2024-09-11T22:28:21.126352+0000","last_unstale":"2024-09-11T22:28:58.288756+0000","last_undegraded":"2024-09-11T22:28:58.288756+0000","last_fullsized":"2024-09-11T22:28:58.288756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:50.513073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293218+0000","last_change":"2024-09-11T22:28:30.184272+0000","last_active":"2024-09-11T22:28:58.293218+0000","last_peered":"2024-09-11T22:28:58.293218+0000","last_clean":"2024-09-11T22:28:58.293218+0000","last_became_active":"2024-09-11T22:28:30.182956+0000","last_became_peered":"2024-09-11T22:28:30.182956+0000","last_unstale":"2024-09-11T22:28:58.293218+0000","last_undegraded":"2024-09-11T22:28:58.293218+0000","last_fullsized":"2024-09-11T22:28:58.293218+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.773131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289208+0000","last_change":"2024-09-11T22:28:18.782833+0000","last_active":"2024-09-11T22:28:58.289208+0000","last_peered":"2024-09-11T22:28:58.289208+0000","last_clean":"2024-09-11T22:28:58.289208+0000","last_became_active":"2024-09-11T22:28:18.781202+0000","last_became_peered":"2024-09-11T22:28:18.781202+0000","last_unstale":"2024-09-11T22:28:58.289208+0000","last_undegraded":"2024-09-11T22:28:58.289208+0000","last_fullsized":"2024-09-11T22:28:58.289208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:47.389717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322590+0000","last_change":"2024-09-11T22:28:21.126106+0000","last_active":"2024-09-11T22:28:58.322590+0000","last_peered":"2024-09-11T22:28:58.322590+0000","last_clean":"2024-09-11T22:28:58.322590+0000","last_became_active":"2024-09-11T22:28:21.125760+0000","last_became_peered":"2024-09-11T22:28:21.125760+0000","last_unstale":"2024-09-11T22:28:58.322590+0000","last_undegraded":"2024-09-11T22:28:58.322590+0000","last_fullsized":"2024-09-11T22:28:58.322590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:18.500241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402798+0000","last_change":"2024-09-11T22:28:30.183343+0000","last_active":"2024-09-11T22:28:58.402798+0000","last_peered":"2024-09-11T22:28:58.402798+0000","last_clean":"2024-09-11T22:28:58.402798+0000","last_became_active":"2024-09-11T22:28:30.182811+0000","last_became_peered":"2024-09-11T22:28:30.182811+0000","last_unstale":"2024-09-11T22:28:58.402798+0000","last_undegraded":"2024-09-11T22:28:58.402798+0000","last_fullsized":"2024-09-11T22:28:58.402798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:48:18.262267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.360354+0000","last_change":"2024-09-11T22:28:18.586872+0000","last_active":"2024-09-11T22:29:13.360354+0000","last_peered":"2024-09-11T22:29:13.360354+0000","last_clean":"2024-09-11T22:29:13.360354+0000","last_became_active":"2024-09-11T22:28:18.586516+0000","last_became_peered":"2024-09-11T22:28:18.586516+0000","last_unstale":"2024-09-11T22:29:13.360354+0000","last_undegraded":"2024-09-11T22:29:13.360354+0000","last_fullsized":"2024-09-11T22:29:13.360354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:07.479936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290649+0000","last_change":"2024-09-11T22:28:21.132488+0000","last_active":"2024-09-11T22:28:58.290649+0000","last_peered":"2024-09-11T22:28:58.290649+0000","last_clean":"2024-09-11T22:28:58.290649+0000","last_became_active":"2024-09-11T22:28:21.132153+0000","last_became_peered":"2024-09-11T22:28:21.132153+0000","last_unstale":"2024-09-11T22:28:58.290649+0000","last_undegraded":"2024-09-11T22:28:58.290649+0000","last_fullsized":"2024-09-11T22:28:58.290649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:43.791896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402969+0000","last_change":"2024-09-11T22:28:30.190272+0000","last_active":"2024-09-11T22:28:58.402969+0000","last_peered":"2024-09-11T22:28:58.402969+0000","last_clean":"2024-09-11T22:28:58.402969+0000","last_became_active":"2024-09-11T22:28:30.189912+0000","last_became_peered":"2024-09-11T22:28:30.189912+0000","last_unstale":"2024-09-11T22:28:58.402969+0000","last_undegraded":"2024-09-11T22:28:58.402969+0000","last_fullsized":"2024-09-11T22:28:58.402969+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:56.166963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.300107+0000","last_change":"2024-09-11T22:28:58.300107+0000","last_active":"2024-09-11T22:28:58.300107+0000","last_peered":"2024-09-11T22:28:58.300107+0000","last_clean":"2024-09-11T22:28:58.300107+0000","last_became_active":"2024-09-11T22:28:58.294806+0000","last_became_peered":"2024-09-11T22:28:58.294806+0000","last_unstale":"2024-09-11T22:28:58.300107+0000","last_undegraded":"2024-09-11T22:28:58.300107+0000","last_fullsized":"2024-09-11T22:28:58.300107+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:37.494929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288769+0000","last_change":"2024-09-11T22:28:21.128789+0000","last_active":"2024-09-11T22:28:58.288769+0000","last_peered":"2024-09-11T22:28:58.288769+0000","last_clean":"2024-09-11T22:28:58.288769+0000","last_became_active":"2024-09-11T22:28:21.128426+0000","last_became_peered":"2024-09-11T22:28:21.128426+0000","last_unstale":"2024-09-11T22:28:58.288769+0000","last_undegraded":"2024-09-11T22:28:58.288769+0000","last_fullsized":"2024-09-11T22:28:58.288769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:43.945247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402952+0000","last_change":"2024-09-11T22:28:30.190240+0000","last_active":"2024-09-11T22:28:58.402952+0000","last_peered":"2024-09-11T22:28:58.402952+0000","last_clean":"2024-09-11T22:28:58.402952+0000","last_became_active":"2024-09-11T22:28:30.189826+0000","last_became_peered":"2024-09-11T22:28:30.189826+0000","last_unstale":"2024-09-11T22:28:58.402952+0000","last_undegraded":"2024-09-11T22:28:58.402952+0000","last_fullsized":"2024-09-11T22:28:58.402952+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.040193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294035+0000","last_change":"2024-09-11T22:28:21.124389+0000","last_active":"2024-09-11T22:28:58.294035+0000","last_peered":"2024-09-11T22:28:58.294035+0000","last_clean":"2024-09-11T22:28:58.294035+0000","last_became_active":"2024-09-11T22:28:21.124058+0000","last_became_peered":"2024-09-11T22:28:21.124058+0000","last_unstale":"2024-09-11T22:28:58.294035+0000","last_undegraded":"2024-09-11T22:28:58.294035+0000","last_fullsized":"2024-09-11T22:28:58.294035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:02.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.354261+0000","last_change":"2024-09-11T22:28:58.304916+0000","last_active":"2024-09-11T22:29:12.354261+0000","last_peered":"2024-09-11T22:29:12.354261+0000","last_clean":"2024-09-11T22:29:12.354261+0000","last_became_active":"2024-09-11T22:28:58.296717+0000","last_became_peered":"2024-09-11T22:28:58.296717+0000","last_unstale":"2024-09-11T22:29:12.354261+0000","last_undegraded":"2024-09-11T22:29:12.354261+0000","last_fullsized":"2024-09-11T22:29:12.354261+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:30.044871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403390+0000","last_change":"2024-09-11T22:28:30.183135+0000","last_active":"2024-09-11T22:28:58.403390+0000","last_peered":"2024-09-11T22:28:58.403390+0000","last_clean":"2024-09-11T22:28:58.403390+0000","last_became_active":"2024-09-11T22:28:30.182768+0000","last_became_peered":"2024-09-11T22:28:30.182768+0000","last_unstale":"2024-09-11T22:28:58.403390+0000","last_undegraded":"2024-09-11T22:28:58.403390+0000","last_fullsized":"2024-09-11T22:28:58.403390+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:26.703807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288494+0000","last_change":"2024-09-11T22:28:21.128609+0000","last_active":"2024-09-11T22:28:58.288494+0000","last_peered":"2024-09-11T22:28:58.288494+0000","last_clean":"2024-09-11T22:28:58.288494+0000","last_became_active":"2024-09-11T22:28:21.128240+0000","last_became_peered":"2024-09-11T22:28:21.128240+0000","last_unstale":"2024-09-11T22:28:58.288494+0000","last_undegraded":"2024-09-11T22:28:58.288494+0000","last_fullsized":"2024-09-11T22:28:58.288494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:41.610223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293546+0000","last_change":"2024-09-11T22:28:18.588047+0000","last_active":"2024-09-11T22:28:58.293546+0000","last_peered":"2024-09-11T22:28:58.293546+0000","last_clean":"2024-09-11T22:28:58.293546+0000","last_became_active":"2024-09-11T22:28:18.587580+0000","last_became_peered":"2024-09-11T22:28:18.587580+0000","last_unstale":"2024-09-11T22:28:58.293546+0000","last_undegraded":"2024-09-11T22:28:58.293546+0000","last_fullsized":"2024-09-11T22:28:58.293546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:01.625014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403375+0000","last_change":"2024-09-11T22:28:30.194188+0000","last_active":"2024-09-11T22:28:58.403375+0000","last_peered":"2024-09-11T22:28:58.403375+0000","last_clean":"2024-09-11T22:28:58.403375+0000","last_became_active":"2024-09-11T22:28:30.193779+0000","last_became_peered":"2024-09-11T22:28:30.193779+0000","last_unstale":"2024-09-11T22:28:58.403375+0000","last_undegraded":"2024-09-11T22:28:58.403375+0000","last_fullsized":"2024-09-11T22:28:58.403375+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:37.328545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290728+0000","last_change":"2024-09-11T22:28:21.113112+0000","last_active":"2024-09-11T22:28:58.290728+0000","last_peered":"2024-09-11T22:28:58.290728+0000","last_clean":"2024-09-11T22:28:58.290728+0000","last_became_active":"2024-09-11T22:28:21.112644+0000","last_became_peered":"2024-09-11T22:28:21.112644+0000","last_unstale":"2024-09-11T22:28:58.290728+0000","last_undegraded":"2024-09-11T22:28:58.290728+0000","last_fullsized":"2024-09-11T22:28:58.290728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:47.520760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.353250+0000","last_change":"2024-09-11T22:28:18.587008+0000","last_active":"2024-09-11T22:29:12.353250+0000","last_peered":"2024-09-11T22:29:12.353250+0000","last_clean":"2024-09-11T22:29:12.353250+0000","last_became_active":"2024-09-11T22:28:18.586519+0000","last_became_peered":"2024-09-11T22:28:18.586519+0000","last_unstale":"2024-09-11T22:29:12.353250+0000","last_undegraded":"2024-09-11T22:29:12.353250+0000","last_fullsized":"2024-09-11T22:29:12.353250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:53.600253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403251+0000","last_change":"2024-09-11T22:28:30.182409+0000","last_active":"2024-09-11T22:28:58.403251+0000","last_peered":"2024-09-11T22:28:58.403251+0000","last_clean":"2024-09-11T22:28:58.403251+0000","last_became_active":"2024-09-11T22:28:30.181991+0000","last_became_peered":"2024-09-11T22:28:30.181991+0000","last_unstale":"2024-09-11T22:28:58.403251+0000","last_undegraded":"2024-09-11T22:28:58.403251+0000","last_fullsized":"2024-09-11T22:28:58.403251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:11.997540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.292952+0000","last_change":"2024-09-11T22:28:21.120079+0000","last_active":"2024-09-11T22:28:58.292952+0000","last_peered":"2024-09-11T22:28:58.292952+0000","last_clean":"2024-09-11T22:28:58.292952+0000","last_became_active":"2024-09-11T22:28:21.119691+0000","last_became_peered":"2024-09-11T22:28:21.119691+0000","last_unstale":"2024-09-11T22:28:58.292952+0000","last_undegraded":"2024-09-11T22:28:58.292952+0000","last_fullsized":"2024-09-11T22:28:58.292952+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:06.447839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.354670+0000","last_change":"2024-09-11T22:28:18.780774+0000","last_active":"2024-09-11T22:29:12.354670+0000","last_peered":"2024-09-11T22:29:12.354670+0000","last_clean":"2024-09-11T22:29:12.354670+0000","last_became_active":"2024-09-11T22:28:18.780460+0000","last_became_peered":"2024-09-11T22:28:18.780460+0000","last_unstale":"2024-09-11T22:29:12.354670+0000","last_undegraded":"2024-09-11T22:29:12.354670+0000","last_fullsized":"2024-09-11T22:29:12.354670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:03.157973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403725+0000","last_change":"2024-09-11T22:28:30.177658+0000","last_active":"2024-09-11T22:28:58.403725+0000","last_peered":"2024-09-11T22:28:58.403725+0000","last_clean":"2024-09-11T22:28:58.403725+0000","last_became_active":"2024-09-11T22:28:30.177237+0000","last_became_peered":"2024-09-11T22:28:30.177237+0000","last_unstale":"2024-09-11T22:28:58.403725+0000","last_undegraded":"2024-09-11T22:28:58.403725+0000","last_fullsized":"2024-09-11T22:28:58.403725+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:43.495545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322575+0000","last_change":"2024-09-11T22:28:21.127248+0000","last_active":"2024-09-11T22:28:58.322575+0000","last_peered":"2024-09-11T22:28:58.322575+0000","last_clean":"2024-09-11T22:28:58.322575+0000","last_became_active":"2024-09-11T22:28:21.126927+0000","last_became_peered":"2024-09-11T22:28:21.126927+0000","last_unstale":"2024-09-11T22:28:58.322575+0000","last_undegraded":"2024-09-11T22:28:58.322575+0000","last_fullsized":"2024-09-11T22:28:58.322575+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:22.219441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.352907+0000","last_change":"2024-09-11T22:28:18.728680+0000","last_active":"2024-09-11T22:29:12.352907+0000","last_peered":"2024-09-11T22:29:12.352907+0000","last_clean":"2024-09-11T22:29:12.352907+0000","last_became_active":"2024-09-11T22:28:18.728235+0000","last_became_peered":"2024-09-11T22:28:18.728235+0000","last_unstale":"2024-09-11T22:29:12.352907+0000","last_undegraded":"2024-09-11T22:29:12.352907+0000","last_fullsized":"2024-09-11T22:29:12.352907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:26.002304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293326+0000","last_change":"2024-09-11T22:28:30.179945+0000","last_active":"2024-09-11T22:28:58.293326+0000","last_peered":"2024-09-11T22:28:58.293326+0000","last_clean":"2024-09-11T22:28:58.293326+0000","last_became_active":"2024-09-11T22:28:30.179089+0000","last_became_peered":"2024-09-11T22:28:30.179089+0000","last_unstale":"2024-09-11T22:28:58.293326+0000","last_undegraded":"2024-09-11T22:28:58.293326+0000","last_fullsized":"2024-09-11T22:28:58.293326+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:34.126678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289337+0000","last_change":"2024-09-11T22:28:21.120411+0000","last_active":"2024-09-11T22:28:58.289337+0000","last_peered":"2024-09-11T22:28:58.289337+0000","last_clean":"2024-09-11T22:28:58.289337+0000","last_became_active":"2024-09-11T22:28:21.120048+0000","last_became_peered":"2024-09-11T22:28:21.120048+0000","last_unstale":"2024-09-11T22:28:58.289337+0000","last_undegraded":"2024-09-11T22:28:58.289337+0000","last_fullsized":"2024-09-11T22:28:58.289337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:07.194042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'11","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:28.136760+0000","last_change":"2024-09-11T22:28:18.581589+0000","last_active":"2024-09-11T22:29:28.136760+0000","last_peered":"2024-09-11T22:29:28.136760+0000","last_clean":"2024-09-11T22:29:28.136760+0000","last_became_active":"2024-09-11T22:28:18.581104+0000","last_became_peered":"2024-09-11T22:28:18.581104+0000","last_unstale":"2024-09-11T22:29:28.136760+0000","last_undegraded":"2024-09-11T22:29:28.136760+0000","last_fullsized":"2024-09-11T22:29:28.136760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:55.318466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288191+0000","last_change":"2024-09-11T22:28:30.188454+0000","last_active":"2024-09-11T22:28:58.288191+0000","last_peered":"2024-09-11T22:28:58.288191+0000","last_clean":"2024-09-11T22:28:58.288191+0000","last_became_active":"2024-09-11T22:28:30.188048+0000","last_became_peered":"2024-09-11T22:28:30.188048+0000","last_unstale":"2024-09-11T22:28:58.288191+0000","last_undegraded":"2024-09-11T22:28:58.288191+0000","last_fullsized":"2024-09-11T22:28:58.288191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:54.994664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288591+0000","last_change":"2024-09-11T22:28:21.122495+0000","last_active":"2024-09-11T22:28:58.288591+0000","last_peered":"2024-09-11T22:28:58.288591+0000","last_clean":"2024-09-11T22:28:58.288591+0000","last_became_active":"2024-09-11T22:28:21.122157+0000","last_became_peered":"2024-09-11T22:28:21.122157+0000","last_unstale":"2024-09-11T22:28:58.288591+0000","last_undegraded":"2024-09-11T22:28:58.288591+0000","last_fullsized":"2024-09-11T22:28:58.288591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.126632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.353156+0000","last_change":"2024-09-11T22:28:18.781729+0000","last_active":"2024-09-11T22:29:12.353156+0000","last_peered":"2024-09-11T22:29:12.353156+0000","last_clean":"2024-09-11T22:29:12.353156+0000","last_became_active":"2024-09-11T22:28:18.781391+0000","last_became_peered":"2024-09-11T22:28:18.781391+0000","last_unstale":"2024-09-11T22:29:12.353156+0000","last_undegraded":"2024-09-11T22:29:12.353156+0000","last_fullsized":"2024-09-11T22:29:12.353156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.711022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291615+0000","last_change":"2024-09-11T22:28:30.178873+0000","last_active":"2024-09-11T22:28:58.291615+0000","last_peered":"2024-09-11T22:28:58.291615+0000","last_clean":"2024-09-11T22:28:58.291615+0000","last_became_active":"2024-09-11T22:28:30.178479+0000","last_became_peered":"2024-09-11T22:28:30.178479+0000","last_unstale":"2024-09-11T22:28:58.291615+0000","last_undegraded":"2024-09-11T22:28:58.291615+0000","last_fullsized":"2024-09-11T22:28:58.291615+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:18.091351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290269+0000","last_change":"2024-09-11T22:28:21.132816+0000","last_active":"2024-09-11T22:28:58.290269+0000","last_peered":"2024-09-11T22:28:58.290269+0000","last_clean":"2024-09-11T22:28:58.290269+0000","last_became_active":"2024-09-11T22:28:21.132445+0000","last_became_peered":"2024-09-11T22:28:21.132445+0000","last_unstale":"2024-09-11T22:28:58.290269+0000","last_undegraded":"2024-09-11T22:28:58.290269+0000","last_fullsized":"2024-09-11T22:28:58.290269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:23.286982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402830+0000","last_change":"2024-09-11T22:28:18.782841+0000","last_active":"2024-09-11T22:28:58.402830+0000","last_peered":"2024-09-11T22:28:58.402830+0000","last_clean":"2024-09-11T22:28:58.402830+0000","last_became_active":"2024-09-11T22:28:18.782482+0000","last_became_peered":"2024-09-11T22:28:18.782482+0000","last_unstale":"2024-09-11T22:28:58.402830+0000","last_undegraded":"2024-09-11T22:28:58.402830+0000","last_fullsized":"2024-09-11T22:28:58.402830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:40.439534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293334+0000","last_change":"2024-09-11T22:28:30.181202+0000","last_active":"2024-09-11T22:28:58.293334+0000","last_peered":"2024-09-11T22:28:58.293334+0000","last_clean":"2024-09-11T22:28:58.293334+0000","last_became_active":"2024-09-11T22:28:30.180770+0000","last_became_peered":"2024-09-11T22:28:30.180770+0000","last_unstale":"2024-09-11T22:28:58.293334+0000","last_undegraded":"2024-09-11T22:28:58.293334+0000","last_fullsized":"2024-09-11T22:28:58.293334+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.019563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290218+0000","last_change":"2024-09-11T22:28:21.130663+0000","last_active":"2024-09-11T22:28:58.290218+0000","last_peered":"2024-09-11T22:28:58.290218+0000","last_clean":"2024-09-11T22:28:58.290218+0000","last_became_active":"2024-09-11T22:28:21.130299+0000","last_became_peered":"2024-09-11T22:28:21.130299+0000","last_unstale":"2024-09-11T22:28:58.290218+0000","last_undegraded":"2024-09-11T22:28:58.290218+0000","last_fullsized":"2024-09-11T22:28:58.290218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:47.888901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294224+0000","last_change":"2024-09-11T22:28:18.583456+0000","last_active":"2024-09-11T22:28:58.294224+0000","last_peered":"2024-09-11T22:28:58.294224+0000","last_clean":"2024-09-11T22:28:58.294224+0000","last_became_active":"2024-09-11T22:28:18.582547+0000","last_became_peered":"2024-09-11T22:28:18.582547+0000","last_unstale":"2024-09-11T22:28:58.294224+0000","last_undegraded":"2024-09-11T22:28:58.294224+0000","last_fullsized":"2024-09-11T22:28:58.294224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:16.128672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288337+0000","last_change":"2024-09-11T22:28:30.180057+0000","last_active":"2024-09-11T22:28:58.288337+0000","last_peered":"2024-09-11T22:28:58.288337+0000","last_clean":"2024-09-11T22:28:58.288337+0000","last_became_active":"2024-09-11T22:28:30.179653+0000","last_became_peered":"2024-09-11T22:28:30.179653+0000","last_unstale":"2024-09-11T22:28:58.288337+0000","last_undegraded":"2024-09-11T22:28:58.288337+0000","last_fullsized":"2024-09-11T22:28:58.288337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:08.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288078+0000","last_change":"2024-09-11T22:28:21.121130+0000","last_active":"2024-09-11T22:28:58.288078+0000","last_peered":"2024-09-11T22:28:58.288078+0000","last_clean":"2024-09-11T22:28:58.288078+0000","last_became_active":"2024-09-11T22:28:21.119673+0000","last_became_peered":"2024-09-11T22:28:21.119673+0000","last_unstale":"2024-09-11T22:28:58.288078+0000","last_undegraded":"2024-09-11T22:28:58.288078+0000","last_fullsized":"2024-09-11T22:28:58.288078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:48.095820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'4","reported_seq":56,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:26.382126+0000","last_change":"2024-09-11T22:28:18.781124+0000","last_active":"2024-09-11T22:29:26.382126+0000","last_peered":"2024-09-11T22:29:26.382126+0000","last_clean":"2024-09-11T22:29:26.382126+0000","last_became_active":"2024-09-11T22:28:18.780600+0000","last_became_peered":"2024-09-11T22:28:18.780600+0000","last_unstale":"2024-09-11T22:29:26.382126+0000","last_undegraded":"2024-09-11T22:29:26.382126+0000","last_fullsized":"2024-09-11T22:29:26.382126+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.032623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288200+0000","last_change":"2024-09-11T22:28:30.180121+0000","last_active":"2024-09-11T22:28:58.288200+0000","last_peered":"2024-09-11T22:28:58.288200+0000","last_clean":"2024-09-11T22:28:58.288200+0000","last_became_active":"2024-09-11T22:28:30.179736+0000","last_became_peered":"2024-09-11T22:28:30.179736+0000","last_unstale":"2024-09-11T22:28:58.288200+0000","last_undegraded":"2024-09-11T22:28:58.288200+0000","last_fullsized":"2024-09-11T22:28:58.288200+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.199958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.287791+0000","last_change":"2024-09-11T22:28:21.111931+0000","last_active":"2024-09-11T22:28:58.287791+0000","last_peered":"2024-09-11T22:28:58.287791+0000","last_clean":"2024-09-11T22:28:58.287791+0000","last_became_active":"2024-09-11T22:28:21.111219+0000","last_became_peered":"2024-09-11T22:28:21.111219+0000","last_unstale":"2024-09-11T22:28:58.287791+0000","last_undegraded":"2024-09-11T22:28:58.287791+0000","last_fullsized":"2024-09-11T22:28:58.287791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:02.454748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.362193+0000","last_change":"2024-09-11T22:28:18.583841+0000","last_active":"2024-09-11T22:29:13.362193+0000","last_peered":"2024-09-11T22:29:13.362193+0000","last_clean":"2024-09-11T22:29:13.362193+0000","last_became_active":"2024-09-11T22:28:18.583459+0000","last_became_peered":"2024-09-11T22:28:18.583459+0000","last_unstale":"2024-09-11T22:29:13.362193+0000","last_undegraded":"2024-09-11T22:29:13.362193+0000","last_fullsized":"2024-09-11T22:29:13.362193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:05.174157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288686+0000","last_change":"2024-09-11T22:28:30.188646+0000","last_active":"2024-09-11T22:28:58.288686+0000","last_peered":"2024-09-11T22:28:58.288686+0000","last_clean":"2024-09-11T22:28:58.288686+0000","last_became_active":"2024-09-11T22:28:30.188243+0000","last_became_peered":"2024-09-11T22:28:30.188243+0000","last_unstale":"2024-09-11T22:28:58.288686+0000","last_undegraded":"2024-09-11T22:28:58.288686+0000","last_fullsized":"2024-09-11T22:28:58.288686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:46.794048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289850+0000","last_change":"2024-09-11T22:28:21.134979+0000","last_active":"2024-09-11T22:28:58.289850+0000","last_peered":"2024-09-11T22:28:58.289850+0000","last_clean":"2024-09-11T22:28:58.289850+0000","last_became_active":"2024-09-11T22:28:21.130803+0000","last_became_peered":"2024-09-11T22:28:21.130803+0000","last_unstale":"2024-09-11T22:28:58.289850+0000","last_undegraded":"2024-09-11T22:28:58.289850+0000","last_fullsized":"2024-09-11T22:28:58.289850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:04.385857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:14.363575+0000","last_change":"2024-09-11T22:28:18.583434+0000","last_active":"2024-09-11T22:29:14.363575+0000","last_peered":"2024-09-11T22:29:14.363575+0000","last_clean":"2024-09-11T22:29:14.363575+0000","last_became_active":"2024-09-11T22:28:18.583092+0000","last_became_peered":"2024-09-11T22:28:18.583092+0000","last_unstale":"2024-09-11T22:29:14.363575+0000","last_undegraded":"2024-09-11T22:29:14.363575+0000","last_fullsized":"2024-09-11T22:29:14.363575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:10.849520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294003+0000","last_change":"2024-09-11T22:27:00.252474+0000","last_active":"2024-09-11T22:28:58.294003+0000","last_peered":"2024-09-11T22:28:58.294003+0000","last_clean":"2024-09-11T22:28:58.294003+0000","last_became_active":"2024-09-11T22:27:00.252064+0000","last_became_peered":"2024-09-11T22:27:00.252064+0000","last_unstale":"2024-09-11T22:28:58.294003+0000","last_undegraded":"2024-09-11T22:28:58.294003+0000","last_fullsized":"2024-09-11T22:28:58.294003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:19.615362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:19.615362+0000","last_clean_scrub_stamp":"2024-09-11T22:23:19.615362+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:03.016822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294970+0000","last_change":"2024-09-11T22:28:30.181432+0000","last_active":"2024-09-11T22:28:58.294970+0000","last_peered":"2024-09-11T22:28:58.294970+0000","last_clean":"2024-09-11T22:28:58.294970+0000","last_became_active":"2024-09-11T22:28:30.180994+0000","last_became_peered":"2024-09-11T22:28:30.180994+0000","last_unstale":"2024-09-11T22:28:58.294970+0000","last_undegraded":"2024-09-11T22:28:58.294970+0000","last_fullsized":"2024-09-11T22:28:58.294970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:36.258723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.295023+0000","last_change":"2024-09-11T22:28:21.124641+0000","last_active":"2024-09-11T22:28:58.295023+0000","last_peered":"2024-09-11T22:28:58.295023+0000","last_clean":"2024-09-11T22:28:58.295023+0000","last_became_active":"2024-09-11T22:28:21.124266+0000","last_became_peered":"2024-09-11T22:28:21.124266+0000","last_unstale":"2024-09-11T22:28:58.295023+0000","last_undegraded":"2024-09-11T22:28:58.295023+0000","last_fullsized":"2024-09-11T22:28:58.295023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:54.098515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.364049+0000","last_change":"2024-09-11T22:28:18.781028+0000","last_active":"2024-09-11T22:29:13.364049+0000","last_peered":"2024-09-11T22:29:13.364049+0000","last_clean":"2024-09-11T22:29:13.364049+0000","last_became_active":"2024-09-11T22:28:18.780566+0000","last_became_peered":"2024-09-11T22:28:18.780566+0000","last_unstale":"2024-09-11T22:29:13.364049+0000","last_undegraded":"2024-09-11T22:29:13.364049+0000","last_fullsized":"2024-09-11T22:29:13.364049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:14.760302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.297083+0000","last_change":"2024-09-11T22:28:58.297083+0000","last_active":"2024-09-11T22:28:58.297083+0000","last_peered":"2024-09-11T22:28:58.297083+0000","last_clean":"2024-09-11T22:28:58.297083+0000","last_became_active":"2024-09-11T22:28:58.296577+0000","last_became_peered":"2024-09-11T22:28:58.296577+0000","last_unstale":"2024-09-11T22:28:58.297083+0000","last_undegraded":"2024-09-11T22:28:58.297083+0000","last_fullsized":"2024-09-11T22:28:58.297083+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:42.592248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294357+0000","last_change":"2024-09-11T22:28:21.130748+0000","last_active":"2024-09-11T22:28:58.294357+0000","last_peered":"2024-09-11T22:28:58.294357+0000","last_clean":"2024-09-11T22:28:58.294357+0000","last_became_active":"2024-09-11T22:28:21.130397+0000","last_became_peered":"2024-09-11T22:28:21.130397+0000","last_unstale":"2024-09-11T22:28:58.294357+0000","last_undegraded":"2024-09-11T22:28:58.294357+0000","last_fullsized":"2024-09-11T22:28:58.294357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:09.683157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289007+0000","last_change":"2024-09-11T22:28:18.581826+0000","last_active":"2024-09-11T22:28:58.289007+0000","last_peered":"2024-09-11T22:28:58.289007+0000","last_clean":"2024-09-11T22:28:58.289007+0000","last_became_active":"2024-09-11T22:28:18.581485+0000","last_became_peered":"2024-09-11T22:28:18.581485+0000","last_unstale":"2024-09-11T22:28:58.289007+0000","last_undegraded":"2024-09-11T22:28:58.289007+0000","last_fullsized":"2024-09-11T22:28:58.289007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:10.930762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322174+0000","last_change":"2024-09-11T22:28:30.188296+0000","last_active":"2024-09-11T22:28:58.322174+0000","last_peered":"2024-09-11T22:28:58.322174+0000","last_clean":"2024-09-11T22:28:58.322174+0000","last_became_active":"2024-09-11T22:28:30.186935+0000","last_became_peered":"2024-09-11T22:28:30.186935+0000","last_unstale":"2024-09-11T22:28:58.322174+0000","last_undegraded":"2024-09-11T22:28:58.322174+0000","last_fullsized":"2024-09-11T22:28:58.322174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:05.918883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294518+0000","last_change":"2024-09-11T22:28:21.120482+0000","last_active":"2024-09-11T22:28:58.294518+0000","last_peered":"2024-09-11T22:28:58.294518+0000","last_clean":"2024-09-11T22:28:58.294518+0000","last_became_active":"2024-09-11T22:28:21.119896+0000","last_became_peered":"2024-09-11T22:28:21.119896+0000","last_unstale":"2024-09-11T22:28:58.294518+0000","last_undegraded":"2024-09-11T22:28:58.294518+0000","last_fullsized":"2024-09-11T22:28:58.294518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:04.651745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.407709+0000","last_change":"2024-09-11T22:28:58.407709+0000","last_active":"2024-09-11T22:28:58.407709+0000","last_peered":"2024-09-11T22:28:58.407709+0000","last_clean":"2024-09-11T22:28:58.407709+0000","last_became_active":"2024-09-11T22:28:58.404756+0000","last_became_peered":"2024-09-11T22:28:58.404756+0000","last_unstale":"2024-09-11T22:28:58.407709+0000","last_undegraded":"2024-09-11T22:28:58.407709+0000","last_fullsized":"2024-09-11T22:28:58.407709+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.125354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.287962+0000","last_change":"2024-09-11T22:28:30.180575+0000","last_active":"2024-09-11T22:28:58.287962+0000","last_peered":"2024-09-11T22:28:58.287962+0000","last_clean":"2024-09-11T22:28:58.287962+0000","last_became_active":"2024-09-11T22:28:30.180057+0000","last_became_peered":"2024-09-11T22:28:30.180057+0000","last_unstale":"2024-09-11T22:28:58.287962+0000","last_undegraded":"2024-09-11T22:28:58.287962+0000","last_fullsized":"2024-09-11T22:28:58.287962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:18.130207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291864+0000","last_change":"2024-09-11T22:28:21.122167+0000","last_active":"2024-09-11T22:28:58.291864+0000","last_peered":"2024-09-11T22:28:58.291864+0000","last_clean":"2024-09-11T22:28:58.291864+0000","last_became_active":"2024-09-11T22:28:21.121777+0000","last_became_peered":"2024-09-11T22:28:21.121777+0000","last_unstale":"2024-09-11T22:28:58.291864+0000","last_undegraded":"2024-09-11T22:28:58.291864+0000","last_fullsized":"2024-09-11T22:28:58.291864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:42.316290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:14.357424+0000","last_change":"2024-09-11T22:28:18.583557+0000","last_active":"2024-09-11T22:29:14.357424+0000","last_peered":"2024-09-11T22:29:14.357424+0000","last_clean":"2024-09-11T22:29:14.357424+0000","last_became_active":"2024-09-11T22:28:18.583153+0000","last_became_peered":"2024-09-11T22:28:18.583153+0000","last_unstale":"2024-09-11T22:29:14.357424+0000","last_undegraded":"2024-09-11T22:29:14.357424+0000","last_fullsized":"2024-09-11T22:29:14.357424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:40.246846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288031+0000","last_change":"2024-09-11T22:28:30.184545+0000","last_active":"2024-09-11T22:28:58.288031+0000","last_peered":"2024-09-11T22:28:58.288031+0000","last_clean":"2024-09-11T22:28:58.288031+0000","last_became_active":"2024-09-11T22:28:30.184135+0000","last_became_peered":"2024-09-11T22:28:30.184135+0000","last_unstale":"2024-09-11T22:28:58.288031+0000","last_undegraded":"2024-09-11T22:28:58.288031+0000","last_fullsized":"2024-09-11T22:28:58.288031+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:11.088364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294752+0000","last_change":"2024-09-11T22:28:58.294752+0000","last_active":"2024-09-11T22:28:58.294752+0000","last_peered":"2024-09-11T22:28:58.294752+0000","last_clean":"2024-09-11T22:28:58.294752+0000","last_became_active":"2024-09-11T22:28:58.293124+0000","last_became_peered":"2024-09-11T22:28:58.293124+0000","last_unstale":"2024-09-11T22:28:58.294752+0000","last_undegraded":"2024-09-11T22:28:58.294752+0000","last_fullsized":"2024-09-11T22:28:58.294752+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:28.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.364308+0000","last_change":"2024-09-11T22:28:18.781320+0000","last_active":"2024-09-11T22:29:13.364308+0000","last_peered":"2024-09-11T22:29:13.364308+0000","last_clean":"2024-09-11T22:29:13.364308+0000","last_became_active":"2024-09-11T22:28:18.780987+0000","last_became_peered":"2024-09-11T22:28:18.780987+0000","last_unstale":"2024-09-11T22:29:13.364308+0000","last_undegraded":"2024-09-11T22:29:13.364308+0000","last_fullsized":"2024-09-11T22:29:13.364308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:03.717586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288328+0000","last_change":"2024-09-11T22:28:30.185048+0000","last_active":"2024-09-11T22:28:58.288328+0000","last_peered":"2024-09-11T22:28:58.288328+0000","last_clean":"2024-09-11T22:28:58.288328+0000","last_became_active":"2024-09-11T22:28:30.184652+0000","last_became_peered":"2024-09-11T22:28:30.184652+0000","last_unstale":"2024-09-11T22:28:58.288328+0000","last_undegraded":"2024-09-11T22:28:58.288328+0000","last_fullsized":"2024-09-11T22:28:58.288328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:29.449432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293898+0000","last_change":"2024-09-11T22:28:21.126875+0000","last_active":"2024-09-11T22:28:58.293898+0000","last_peered":"2024-09-11T22:28:58.293898+0000","last_clean":"2024-09-11T22:28:58.293898+0000","last_became_active":"2024-09-11T22:28:21.126549+0000","last_became_peered":"2024-09-11T22:28:21.126549+0000","last_unstale":"2024-09-11T22:28:58.293898+0000","last_undegraded":"2024-09-11T22:28:58.293898+0000","last_fullsized":"2024-09-11T22:28:58.293898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:16.410693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'4","reported_seq":59,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:26.382348+0000","last_change":"2024-09-11T22:28:18.586008+0000","last_active":"2024-09-11T22:29:26.382348+0000","last_peered":"2024-09-11T22:29:26.382348+0000","last_clean":"2024-09-11T22:29:26.382348+0000","last_became_active":"2024-09-11T22:28:18.585254+0000","last_became_peered":"2024-09-11T22:28:18.585254+0000","last_unstale":"2024-09-11T22:29:26.382348+0000","last_undegraded":"2024-09-11T22:29:26.382348+0000","last_fullsized":"2024-09-11T22:29:26.382348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:50.083339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.323956+0000","last_change":"2024-09-11T22:28:58.323573+0000","last_active":"2024-09-11T22:28:58.323956+0000","last_peered":"2024-09-11T22:28:58.323956+0000","last_clean":"2024-09-11T22:28:58.323956+0000","last_became_active":"2024-09-11T22:28:58.323233+0000","last_became_peered":"2024-09-11T22:28:58.323233+0000","last_unstale":"2024-09-11T22:28:58.323956+0000","last_undegraded":"2024-09-11T22:28:58.323956+0000","last_fullsized":"2024-09-11T22:28:58.323956+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:33.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294153+0000","last_change":"2024-09-11T22:28:21.133655+0000","last_active":"2024-09-11T22:28:58.294153+0000","last_peered":"2024-09-11T22:28:58.294153+0000","last_clean":"2024-09-11T22:28:58.294153+0000","last_became_active":"2024-09-11T22:28:21.133296+0000","last_became_peered":"2024-09-11T22:28:21.133296+0000","last_unstale":"2024-09-11T22:28:58.294153+0000","last_undegraded":"2024-09-11T22:28:58.294153+0000","last_fullsized":"2024-09-11T22:28:58.294153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:54.956883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.353855+0000","last_change":"2024-09-11T22:28:18.585001+0000","last_active":"2024-09-11T22:29:12.353855+0000","last_peered":"2024-09-11T22:29:12.353855+0000","last_clean":"2024-09-11T22:29:12.353855+0000","last_became_active":"2024-09-11T22:28:18.584570+0000","last_became_peered":"2024-09-11T22:28:18.584570+0000","last_unstale":"2024-09-11T22:29:12.353855+0000","last_undegraded":"2024-09-11T22:29:12.353855+0000","last_fullsized":"2024-09-11T22:29:12.353855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291224+0000","last_change":"2024-09-11T22:28:30.192923+0000","last_active":"2024-09-11T22:28:58.291224+0000","last_peered":"2024-09-11T22:28:58.291224+0000","last_clean":"2024-09-11T22:28:58.291224+0000","last_became_active":"2024-09-11T22:28:30.192600+0000","last_became_peered":"2024-09-11T22:28:30.192600+0000","last_unstale":"2024-09-11T22:28:58.291224+0000","last_undegraded":"2024-09-11T22:28:58.291224+0000","last_fullsized":"2024-09-11T22:28:58.291224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.287990+0000","last_change":"2024-09-11T22:28:21.131088+0000","last_active":"2024-09-11T22:28:58.287990+0000","last_peered":"2024-09-11T22:28:58.287990+0000","last_clean":"2024-09-11T22:28:58.287990+0000","last_became_active":"2024-09-11T22:28:21.127001+0000","last_became_peered":"2024-09-11T22:28:21.127001+0000","last_unstale":"2024-09-11T22:28:58.287990+0000","last_undegraded":"2024-09-11T22:28:58.287990+0000","last_fullsized":"2024-09-11T22:28:58.287990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:50.297619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.362578+0000","last_change":"2024-09-11T22:28:18.587245+0000","last_active":"2024-09-11T22:29:13.362578+0000","last_peered":"2024-09-11T22:29:13.362578+0000","last_clean":"2024-09-11T22:29:13.362578+0000","last_became_active":"2024-09-11T22:28:18.586873+0000","last_became_peered":"2024-09-11T22:28:18.586873+0000","last_unstale":"2024-09-11T22:29:13.362578+0000","last_undegraded":"2024-09-11T22:29:13.362578+0000","last_fullsized":"2024-09-11T22:29:13.362578+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:27.715781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288657+0000","last_change":"2024-09-11T22:28:30.183839+0000","last_active":"2024-09-11T22:28:58.288657+0000","last_peered":"2024-09-11T22:28:58.288657+0000","last_clean":"2024-09-11T22:28:58.288657+0000","last_became_active":"2024-09-11T22:28:30.183382+0000","last_became_peered":"2024-09-11T22:28:30.183382+0000","last_unstale":"2024-09-11T22:28:58.288657+0000","last_undegraded":"2024-09-11T22:28:58.288657+0000","last_fullsized":"2024-09-11T22:28:58.288657+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:31.144195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293886+0000","last_change":"2024-09-11T22:28:21.116932+0000","last_active":"2024-09-11T22:28:58.293886+0000","last_peered":"2024-09-11T22:28:58.293886+0000","last_clean":"2024-09-11T22:28:58.293886+0000","last_became_active":"2024-09-11T22:28:21.116285+0000","last_became_peered":"2024-09-11T22:28:21.116285+0000","last_unstale":"2024-09-11T22:28:58.293886+0000","last_undegraded":"2024-09-11T22:28:58.293886+0000","last_fullsized":"2024-09-11T22:28:58.293886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:04.737879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'25","reported_seq":92,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:25.381942+0000","last_change":"2024-09-11T22:28:18.581616+0000","last_active":"2024-09-11T22:29:25.381942+0000","last_peered":"2024-09-11T22:29:25.381942+0000","last_clean":"2024-09-11T22:29:25.381942+0000","last_became_active":"2024-09-11T22:28:18.581218+0000","last_became_peered":"2024-09-11T22:28:18.581218+0000","last_unstale":"2024-09-11T22:29:25.381942+0000","last_undegraded":"2024-09-11T22:29:25.381942+0000","last_fullsized":"2024-09-11T22:29:25.381942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:10.351050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43345,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":57,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.297809+0000","last_change":"2024-09-11T22:28:58.297256+0000","last_active":"2024-09-11T22:28:58.297809+0000","last_peered":"2024-09-11T22:28:58.297809+0000","last_clean":"2024-09-11T22:28:58.297809+0000","last_became_active":"2024-09-11T22:28:58.296671+0000","last_became_peered":"2024-09-11T22:28:58.296671+0000","last_unstale":"2024-09-11T22:28:58.297809+0000","last_undegraded":"2024-09-11T22:28:58.297809+0000","last_fullsized":"2024-09-11T22:28:58.297809+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:31.240144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291031+0000","last_change":"2024-09-11T22:28:21.128792+0000","last_active":"2024-09-11T22:28:58.291031+0000","last_peered":"2024-09-11T22:28:58.291031+0000","last_clean":"2024-09-11T22:28:58.291031+0000","last_became_active":"2024-09-11T22:28:21.128429+0000","last_became_peered":"2024-09-11T22:28:21.128429+0000","last_unstale":"2024-09-11T22:28:58.291031+0000","last_undegraded":"2024-09-11T22:28:58.291031+0000","last_fullsized":"2024-09-11T22:28:58.291031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:16.049877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.353341+0000","last_change":"2024-09-11T22:28:18.781827+0000","last_active":"2024-09-11T22:29:12.353341+0000","last_peered":"2024-09-11T22:29:12.353341+0000","last_clean":"2024-09-11T22:29:12.353341+0000","last_became_active":"2024-09-11T22:28:18.781453+0000","last_became_peered":"2024-09-11T22:28:18.781453+0000","last_unstale":"2024-09-11T22:29:12.353341+0000","last_undegraded":"2024-09-11T22:29:12.353341+0000","last_fullsized":"2024-09-11T22:29:12.353341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:37.901034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403280+0000","last_change":"2024-09-11T22:28:30.182457+0000","last_active":"2024-09-11T22:28:58.403280+0000","last_peered":"2024-09-11T22:28:58.403280+0000","last_clean":"2024-09-11T22:28:58.403280+0000","last_became_active":"2024-09-11T22:28:30.181834+0000","last_became_peered":"2024-09-11T22:28:30.181834+0000","last_unstale":"2024-09-11T22:28:58.403280+0000","last_undegraded":"2024-09-11T22:28:58.403280+0000","last_fullsized":"2024-09-11T22:28:58.403280+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:21.847470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322601+0000","last_change":"2024-09-11T22:28:21.121896+0000","last_active":"2024-09-11T22:28:58.322601+0000","last_peered":"2024-09-11T22:28:58.322601+0000","last_clean":"2024-09-11T22:28:58.322601+0000","last_became_active":"2024-09-11T22:28:21.120639+0000","last_became_peered":"2024-09-11T22:28:21.120639+0000","last_unstale":"2024-09-11T22:28:58.322601+0000","last_undegraded":"2024-09-11T22:28:58.322601+0000","last_fullsized":"2024-09-11T22:28:58.322601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:59:58.707107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.352998+0000","last_change":"2024-09-11T22:28:18.584577+0000","last_active":"2024-09-11T22:29:12.352998+0000","last_peered":"2024-09-11T22:29:12.352998+0000","last_clean":"2024-09-11T22:29:12.352998+0000","last_became_active":"2024-09-11T22:28:18.583642+0000","last_became_peered":"2024-09-11T22:28:18.583642+0000","last_unstale":"2024-09-11T22:29:12.352998+0000","last_undegraded":"2024-09-11T22:29:12.352998+0000","last_fullsized":"2024-09-11T22:29:12.352998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:09.685642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402362+0000","last_change":"2024-09-11T22:28:30.182767+0000","last_active":"2024-09-11T22:28:58.402362+0000","last_peered":"2024-09-11T22:28:58.402362+0000","last_clean":"2024-09-11T22:28:58.402362+0000","last_became_active":"2024-09-11T22:28:30.181902+0000","last_became_peered":"2024-09-11T22:28:30.181902+0000","last_unstale":"2024-09-11T22:28:58.402362+0000","last_undegraded":"2024-09-11T22:28:58.402362+0000","last_fullsized":"2024-09-11T22:28:58.402362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:49.618633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290420+0000","last_change":"2024-09-11T22:28:21.132388+0000","last_active":"2024-09-11T22:28:58.290420+0000","last_peered":"2024-09-11T22:28:58.290420+0000","last_clean":"2024-09-11T22:28:58.290420+0000","last_became_active":"2024-09-11T22:28:21.132053+0000","last_became_peered":"2024-09-11T22:28:21.132053+0000","last_unstale":"2024-09-11T22:28:58.290420+0000","last_undegraded":"2024-09-11T22:28:58.290420+0000","last_fullsized":"2024-09-11T22:28:58.290420+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:04.813600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'3","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:24.378872+0000","last_change":"2024-09-11T22:28:18.577057+0000","last_active":"2024-09-11T22:29:24.378872+0000","last_peered":"2024-09-11T22:29:24.378872+0000","last_clean":"2024-09-11T22:29:24.378872+0000","last_became_active":"2024-09-11T22:28:18.576678+0000","last_became_peered":"2024-09-11T22:28:18.576678+0000","last_unstale":"2024-09-11T22:29:24.378872+0000","last_undegraded":"2024-09-11T22:29:24.378872+0000","last_fullsized":"2024-09-11T22:29:24.378872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:04.425896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288679+0000","last_change":"2024-09-11T22:28:30.184139+0000","last_active":"2024-09-11T22:28:58.288679+0000","last_peered":"2024-09-11T22:28:58.288679+0000","last_clean":"2024-09-11T22:28:58.288679+0000","last_became_active":"2024-09-11T22:28:30.182817+0000","last_became_peered":"2024-09-11T22:28:30.182817+0000","last_unstale":"2024-09-11T22:28:58.288679+0000","last_undegraded":"2024-09-11T22:28:58.288679+0000","last_fullsized":"2024-09-11T22:28:58.288679+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:43.829873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322444+0000","last_change":"2024-09-11T22:28:30.182250+0000","last_active":"2024-09-11T22:28:58.322444+0000","last_peered":"2024-09-11T22:28:58.322444+0000","last_clean":"2024-09-11T22:28:58.322444+0000","last_became_active":"2024-09-11T22:28:30.178758+0000","last_became_peered":"2024-09-11T22:28:30.178758+0000","last_unstale":"2024-09-11T22:28:58.322444+0000","last_undegraded":"2024-09-11T22:28:58.322444+0000","last_fullsized":"2024-09-11T22:28:58.322444+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:25.120475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402505+0000","last_change":"2024-09-11T22:28:21.121208+0000","last_active":"2024-09-11T22:28:58.402505+0000","last_peered":"2024-09-11T22:28:58.402505+0000","last_clean":"2024-09-11T22:28:58.402505+0000","last_became_active":"2024-09-11T22:28:21.120904+0000","last_became_peered":"2024-09-11T22:28:21.120904+0000","last_unstale":"2024-09-11T22:28:58.402505+0000","last_undegraded":"2024-09-11T22:28:58.402505+0000","last_fullsized":"2024-09-11T22:28:58.402505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:36.696739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288246+0000","last_change":"2024-09-11T22:28:18.584471+0000","last_active":"2024-09-11T22:28:58.288246+0000","last_peered":"2024-09-11T22:28:58.288246+0000","last_clean":"2024-09-11T22:28:58.288246+0000","last_became_active":"2024-09-11T22:28:18.584124+0000","last_became_peered":"2024-09-11T22:28:18.584124+0000","last_unstale":"2024-09-11T22:28:58.288246+0000","last_undegraded":"2024-09-11T22:28:58.288246+0000","last_fullsized":"2024-09-11T22:28:58.288246+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:40.992385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403924+0000","last_change":"2024-09-11T22:28:58.403924+0000","last_active":"2024-09-11T22:28:58.403924+0000","last_peered":"2024-09-11T22:28:58.403924+0000","last_clean":"2024-09-11T22:28:58.403924+0000","last_became_active":"2024-09-11T22:28:58.403543+0000","last_became_peered":"2024-09-11T22:28:58.403543+0000","last_unstale":"2024-09-11T22:28:58.403924+0000","last_undegraded":"2024-09-11T22:28:58.403924+0000","last_fullsized":"2024-09-11T22:28:58.403924+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:16.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289204+0000","last_change":"2024-09-11T22:28:21.136111+0000","last_active":"2024-09-11T22:28:58.289204+0000","last_peered":"2024-09-11T22:28:58.289204+0000","last_clean":"2024-09-11T22:28:58.289204+0000","last_became_active":"2024-09-11T22:28:21.135576+0000","last_became_peered":"2024-09-11T22:28:21.135576+0000","last_unstale":"2024-09-11T22:28:58.289204+0000","last_undegraded":"2024-09-11T22:28:58.289204+0000","last_fullsized":"2024-09-11T22:28:58.289204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:30.134734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.362105+0000","last_change":"2024-09-11T22:28:18.583388+0000","last_active":"2024-09-11T22:29:13.362105+0000","last_peered":"2024-09-11T22:29:13.362105+0000","last_clean":"2024-09-11T22:29:13.362105+0000","last_became_active":"2024-09-11T22:28:18.582215+0000","last_became_peered":"2024-09-11T22:28:18.582215+0000","last_unstale":"2024-09-11T22:29:13.362105+0000","last_undegraded":"2024-09-11T22:29:13.362105+0000","last_fullsized":"2024-09-11T22:29:13.362105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:56.816276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.360834+0000","last_change":"2024-09-11T22:28:18.581722+0000","last_active":"2024-09-11T22:29:13.360834+0000","last_peered":"2024-09-11T22:29:13.360834+0000","last_clean":"2024-09-11T22:29:13.360834+0000","last_became_active":"2024-09-11T22:28:18.580961+0000","last_became_peered":"2024-09-11T22:28:18.580961+0000","last_unstale":"2024-09-11T22:29:13.360834+0000","last_undegraded":"2024-09-11T22:29:13.360834+0000","last_fullsized":"2024-09-11T22:29:13.360834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:22.629114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288305+0000","last_change":"2024-09-11T22:28:21.122053+0000","last_active":"2024-09-11T22:28:58.288305+0000","last_peered":"2024-09-11T22:28:58.288305+0000","last_clean":"2024-09-11T22:28:58.288305+0000","last_became_active":"2024-09-11T22:28:21.121708+0000","last_became_peered":"2024-09-11T22:28:21.121708+0000","last_unstale":"2024-09-11T22:28:58.288305+0000","last_undegraded":"2024-09-11T22:28:58.288305+0000","last_fullsized":"2024-09-11T22:28:58.288305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:36.457640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293934+0000","last_change":"2024-09-11T22:28:30.194472+0000","last_active":"2024-09-11T22:28:58.293934+0000","last_peered":"2024-09-11T22:28:58.293934+0000","last_clean":"2024-09-11T22:28:58.293934+0000","last_became_active":"2024-09-11T22:28:30.193986+0000","last_became_peered":"2024-09-11T22:28:30.193986+0000","last_unstale":"2024-09-11T22:28:58.293934+0000","last_undegraded":"2024-09-11T22:28:58.293934+0000","last_fullsized":"2024-09-11T22:28:58.293934+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:27.608919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:25.381221+0000","last_change":"2024-09-11T22:28:18.588739+0000","last_active":"2024-09-11T22:29:25.381221+0000","last_peered":"2024-09-11T22:29:25.381221+0000","last_clean":"2024-09-11T22:29:25.381221+0000","last_became_active":"2024-09-11T22:28:18.586218+0000","last_became_peered":"2024-09-11T22:28:18.586218+0000","last_unstale":"2024-09-11T22:29:25.381221+0000","last_undegraded":"2024-09-11T22:29:25.381221+0000","last_fullsized":"2024-09-11T22:29:25.381221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:08.493132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293508+0000","last_change":"2024-09-11T22:28:21.122076+0000","last_active":"2024-09-11T22:28:58.293508+0000","last_peered":"2024-09-11T22:28:58.293508+0000","last_clean":"2024-09-11T22:28:58.293508+0000","last_became_active":"2024-09-11T22:28:21.121692+0000","last_became_peered":"2024-09-11T22:28:21.121692+0000","last_unstale":"2024-09-11T22:28:58.293508+0000","last_undegraded":"2024-09-11T22:28:58.293508+0000","last_fullsized":"2024-09-11T22:28:58.293508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:10.165221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294686+0000","last_change":"2024-09-11T22:28:30.179240+0000","last_active":"2024-09-11T22:28:58.294686+0000","last_peered":"2024-09-11T22:28:58.294686+0000","last_clean":"2024-09-11T22:28:58.294686+0000","last_became_active":"2024-09-11T22:28:30.178855+0000","last_became_peered":"2024-09-11T22:28:30.178855+0000","last_unstale":"2024-09-11T22:28:58.294686+0000","last_undegraded":"2024-09-11T22:28:58.294686+0000","last_fullsized":"2024-09-11T22:28:58.294686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:19.671279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290718+0000","last_change":"2024-09-11T22:28:21.115166+0000","last_active":"2024-09-11T22:28:58.290718+0000","last_peered":"2024-09-11T22:28:58.290718+0000","last_clean":"2024-09-11T22:28:58.290718+0000","last_became_active":"2024-09-11T22:28:21.114840+0000","last_became_peered":"2024-09-11T22:28:21.114840+0000","last_unstale":"2024-09-11T22:28:58.290718+0000","last_undegraded":"2024-09-11T22:28:58.290718+0000","last_fullsized":"2024-09-11T22:28:58.290718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:09.505715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293731+0000","last_change":"2024-09-11T22:28:21.119822+0000","last_active":"2024-09-11T22:28:58.293731+0000","last_peered":"2024-09-11T22:28:58.293731+0000","last_clean":"2024-09-11T22:28:58.293731+0000","last_became_active":"2024-09-11T22:28:21.119480+0000","last_became_peered":"2024-09-11T22:28:21.119480+0000","last_unstale":"2024-09-11T22:28:58.293731+0000","last_undegraded":"2024-09-11T22:28:58.293731+0000","last_fullsized":"2024-09-11T22:28:58.293731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:35.654943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293396+0000","last_change":"2024-09-11T22:28:21.123521+0000","last_active":"2024-09-11T22:28:58.293396+0000","last_peered":"2024-09-11T22:28:58.293396+0000","last_clean":"2024-09-11T22:28:58.293396+0000","last_became_active":"2024-09-11T22:28:21.123197+0000","last_became_peered":"2024-09-11T22:28:21.123197+0000","last_unstale":"2024-09-11T22:28:58.293396+0000","last_undegraded":"2024-09-11T22:28:58.293396+0000","last_fullsized":"2024-09-11T22:28:58.293396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.418987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322258+0000","last_change":"2024-09-11T22:28:21.117212+0000","last_active":"2024-09-11T22:28:58.322258+0000","last_peered":"2024-09-11T22:28:58.322258+0000","last_clean":"2024-09-11T22:28:58.322258+0000","last_became_active":"2024-09-11T22:28:21.112432+0000","last_became_peered":"2024-09-11T22:28:21.112432+0000","last_unstale":"2024-09-11T22:28:58.322258+0000","last_undegraded":"2024-09-11T22:28:58.322258+0000","last_fullsized":"2024-09-11T22:28:58.322258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:56.053471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288499+0000","last_change":"2024-09-11T22:28:21.115374+0000","last_active":"2024-09-11T22:28:58.288499+0000","last_peered":"2024-09-11T22:28:58.288499+0000","last_clean":"2024-09-11T22:28:58.288499+0000","last_became_active":"2024-09-11T22:28:21.114943+0000","last_became_peered":"2024-09-11T22:28:21.114943+0000","last_unstale":"2024-09-11T22:28:58.288499+0000","last_undegraded":"2024-09-11T22:28:58.288499+0000","last_fullsized":"2024-09-11T22:28:58.288499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:32.564226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291599+0000","last_change":"2024-09-11T22:28:21.122897+0000","last_active":"2024-09-11T22:28:58.291599+0000","last_peered":"2024-09-11T22:28:58.291599+0000","last_clean":"2024-09-11T22:28:58.291599+0000","last_became_active":"2024-09-11T22:28:21.122594+0000","last_became_peered":"2024-09-11T22:28:21.122594+0000","last_unstale":"2024-09-11T22:28:58.291599+0000","last_undegraded":"2024-09-11T22:28:58.291599+0000","last_fullsized":"2024-09-11T22:28:58.291599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:37.698479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.295550+0000","last_change":"2024-09-11T22:28:21.126252+0000","last_active":"2024-09-11T22:28:58.295550+0000","last_peered":"2024-09-11T22:28:58.295550+0000","last_clean":"2024-09-11T22:28:58.295550+0000","last_became_active":"2024-09-11T22:28:21.125935+0000","last_became_peered":"2024-09-11T22:28:21.125935+0000","last_unstale":"2024-09-11T22:28:58.295550+0000","last_undegraded":"2024-09-11T22:28:58.295550+0000","last_fullsized":"2024-09-11T22:28:58.295550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.451659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.297133+0000","last_change":"2024-09-11T22:28:58.297133+0000","last_active":"2024-09-11T22:28:58.297133+0000","last_peered":"2024-09-11T22:28:58.297133+0000","last_clean":"2024-09-11T22:28:58.297133+0000","last_became_active":"2024-09-11T22:28:58.296767+0000","last_became_peered":"2024-09-11T22:28:58.296767+0000","last_unstale":"2024-09-11T22:28:58.297133+0000","last_undegraded":"2024-09-11T22:28:58.297133+0000","last_fullsized":"2024-09-11T22:28:58.297133+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:28:49.660837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288053+0000","last_change":"2024-09-11T22:28:21.122293+0000","last_active":"2024-09-11T22:28:58.288053+0000","last_peered":"2024-09-11T22:28:58.288053+0000","last_clean":"2024-09-11T22:28:58.288053+0000","last_became_active":"2024-09-11T22:28:21.121930+0000","last_became_peered":"2024-09-11T22:28:21.121930+0000","last_unstale":"2024-09-11T22:28:58.288053+0000","last_undegraded":"2024-09-11T22:28:58.288053+0000","last_fullsized":"2024-09-11T22:28:58.288053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:43.231206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288858+0000","last_change":"2024-09-11T22:28:21.123949+0000","last_active":"2024-09-11T22:28:58.288858+0000","last_peered":"2024-09-11T22:28:58.288858+0000","last_clean":"2024-09-11T22:28:58.288858+0000","last_became_active":"2024-09-11T22:28:21.121894+0000","last_became_peered":"2024-09-11T22:28:21.121894+0000","last_unstale":"2024-09-11T22:28:58.288858+0000","last_undegraded":"2024-09-11T22:28:58.288858+0000","last_fullsized":"2024-09-11T22:28:58.288858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:56.227648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291238+0000","last_change":"2024-09-11T22:28:21.136287+0000","last_active":"2024-09-11T22:28:58.291238+0000","last_peered":"2024-09-11T22:28:58.291238+0000","last_clean":"2024-09-11T22:28:58.291238+0000","last_became_active":"2024-09-11T22:28:21.136000+0000","last_became_peered":"2024-09-11T22:28:21.136000+0000","last_unstale":"2024-09-11T22:28:58.291238+0000","last_undegraded":"2024-09-11T22:28:58.291238+0000","last_fullsized":"2024-09-11T22:28:58.291238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:32.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288409+0000","last_change":"2024-09-11T22:28:21.117324+0000","last_active":"2024-09-11T22:28:58.288409+0000","last_peered":"2024-09-11T22:28:58.288409+0000","last_clean":"2024-09-11T22:28:58.288409+0000","last_became_active":"2024-09-11T22:28:21.116945+0000","last_became_peered":"2024-09-11T22:28:21.116945+0000","last_unstale":"2024-09-11T22:28:58.288409+0000","last_undegraded":"2024-09-11T22:28:58.288409+0000","last_fullsized":"2024-09-11T22:28:58.288409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.672745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291348+0000","last_change":"2024-09-11T22:28:21.117336+0000","last_active":"2024-09-11T22:28:58.291348+0000","last_peered":"2024-09-11T22:28:58.291348+0000","last_clean":"2024-09-11T22:28:58.291348+0000","last_became_active":"2024-09-11T22:28:21.117005+0000","last_became_peered":"2024-09-11T22:28:21.117005+0000","last_unstale":"2024-09-11T22:28:58.291348+0000","last_undegraded":"2024-09-11T22:28:58.291348+0000","last_fullsized":"2024-09-11T22:28:58.291348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:55.932442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294869+0000","last_change":"2024-09-11T22:28:21.132066+0000","last_active":"2024-09-11T22:28:58.294869+0000","last_peered":"2024-09-11T22:28:58.294869+0000","last_clean":"2024-09-11T22:28:58.294869+0000","last_became_active":"2024-09-11T22:28:21.131676+0000","last_became_peered":"2024-09-11T22:28:21.131676+0000","last_unstale":"2024-09-11T22:28:58.294869+0000","last_undegraded":"2024-09-11T22:28:58.294869+0000","last_fullsized":"2024-09-11T22:28:58.294869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:50.484049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402915+0000","last_change":"2024-09-11T22:28:21.125532+0000","last_active":"2024-09-11T22:28:58.402915+0000","last_peered":"2024-09-11T22:28:58.402915+0000","last_clean":"2024-09-11T22:28:58.402915+0000","last_became_active":"2024-09-11T22:28:21.125182+0000","last_became_peered":"2024-09-11T22:28:21.125182+0000","last_unstale":"2024-09-11T22:28:58.402915+0000","last_undegraded":"2024-09-11T22:28:58.402915+0000","last_fullsized":"2024-09-11T22:28:58.402915+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:35.272900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.292241+0000","last_change":"2024-09-11T22:28:21.129029+0000","last_active":"2024-09-11T22:28:58.292241+0000","last_peered":"2024-09-11T22:28:58.292241+0000","last_clean":"2024-09-11T22:28:58.292241+0000","last_became_active":"2024-09-11T22:28:21.128690+0000","last_became_peered":"2024-09-11T22:28:21.128690+0000","last_unstale":"2024-09-11T22:28:58.292241+0000","last_undegraded":"2024-09-11T22:28:58.292241+0000","last_fullsized":"2024-09-11T22:28:58.292241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:57.723871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290546+0000","last_change":"2024-09-11T22:28:21.134491+0000","last_active":"2024-09-11T22:28:58.290546+0000","last_peered":"2024-09-11T22:28:58.290546+0000","last_clean":"2024-09-11T22:28:58.290546+0000","last_became_active":"2024-09-11T22:28:21.134142+0000","last_became_peered":"2024-09-11T22:28:21.134142+0000","last_unstale":"2024-09-11T22:28:58.290546+0000","last_undegraded":"2024-09-11T22:28:58.290546+0000","last_fullsized":"2024-09-11T22:28:58.290546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:16.960823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322092+0000","last_change":"2024-09-11T22:28:21.114033+0000","last_active":"2024-09-11T22:28:58.322092+0000","last_peered":"2024-09-11T22:28:58.322092+0000","last_clean":"2024-09-11T22:28:58.322092+0000","last_became_active":"2024-09-11T22:28:21.113689+0000","last_became_peered":"2024-09-11T22:28:21.113689+0000","last_unstale":"2024-09-11T22:28:58.322092+0000","last_undegraded":"2024-09-11T22:28:58.322092+0000","last_fullsized":"2024-09-11T22:28:58.322092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:16.199958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322149+0000","last_change":"2024-09-11T22:28:21.120938+0000","last_active":"2024-09-11T22:28:58.322149+0000","last_peered":"2024-09-11T22:28:58.322149+0000","last_clean":"2024-09-11T22:28:58.322149+0000","last_became_active":"2024-09-11T22:28:21.120410+0000","last_became_peered":"2024-09-11T22:28:21.120410+0000","last_unstale":"2024-09-11T22:28:58.322149+0000","last_undegraded":"2024-09-11T22:28:58.322149+0000","last_fullsized":"2024-09-11T22:28:58.322149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.745133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289049+0000","last_change":"2024-09-11T22:28:21.131506+0000","last_active":"2024-09-11T22:28:58.289049+0000","last_peered":"2024-09-11T22:28:58.289049+0000","last_clean":"2024-09-11T22:28:58.289049+0000","last_became_active":"2024-09-11T22:28:21.123877+0000","last_became_peered":"2024-09-11T22:28:21.123877+0000","last_unstale":"2024-09-11T22:28:58.289049+0000","last_undegraded":"2024-09-11T22:28:58.289049+0000","last_fullsized":"2024-09-11T22:28:58.289049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:12.399779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403519+0000","last_change":"2024-09-11T22:28:21.121211+0000","last_active":"2024-09-11T22:28:58.403519+0000","last_peered":"2024-09-11T22:28:58.403519+0000","last_clean":"2024-09-11T22:28:58.403519+0000","last_became_active":"2024-09-11T22:28:21.120900+0000","last_became_peered":"2024-09-11T22:28:21.120900+0000","last_unstale":"2024-09-11T22:28:58.403519+0000","last_undegraded":"2024-09-11T22:28:58.403519+0000","last_fullsized":"2024-09-11T22:28:58.403519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:22.052996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294915+0000","last_change":"2024-09-11T22:28:21.125329+0000","last_active":"2024-09-11T22:28:58.294915+0000","last_peered":"2024-09-11T22:28:58.294915+0000","last_clean":"2024-09-11T22:28:58.294915+0000","last_became_active":"2024-09-11T22:28:21.124998+0000","last_became_peered":"2024-09-11T22:28:21.124998+0000","last_unstale":"2024-09-11T22:28:58.294915+0000","last_undegraded":"2024-09-11T22:28:58.294915+0000","last_fullsized":"2024-09-11T22:28:58.294915+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:46.559796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291068+0000","last_change":"2024-09-11T22:28:21.123364+0000","last_active":"2024-09-11T22:28:58.291068+0000","last_peered":"2024-09-11T22:28:58.291068+0000","last_clean":"2024-09-11T22:28:58.291068+0000","last_became_active":"2024-09-11T22:28:21.123042+0000","last_became_peered":"2024-09-11T22:28:21.123042+0000","last_unstale":"2024-09-11T22:28:58.291068+0000","last_undegraded":"2024-09-11T22:28:58.291068+0000","last_fullsized":"2024-09-11T22:28:58.291068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:21.938986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290576+0000","last_change":"2024-09-11T22:28:21.131206+0000","last_active":"2024-09-11T22:28:58.290576+0000","last_peered":"2024-09-11T22:28:58.290576+0000","last_clean":"2024-09-11T22:28:58.290576+0000","last_became_active":"2024-09-11T22:28:21.130879+0000","last_became_peered":"2024-09-11T22:28:21.130879+0000","last_unstale":"2024-09-11T22:28:58.290576+0000","last_undegraded":"2024-09-11T22:28:58.290576+0000","last_fullsized":"2024-09-11T22:28:58.290576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:02.260645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289281+0000","last_change":"2024-09-11T22:28:21.128349+0000","last_active":"2024-09-11T22:28:58.289281+0000","last_peered":"2024-09-11T22:28:58.289281+0000","last_clean":"2024-09-11T22:28:58.289281+0000","last_became_active":"2024-09-11T22:28:21.124628+0000","last_became_peered":"2024-09-11T22:28:21.124628+0000","last_unstale":"2024-09-11T22:28:58.289281+0000","last_undegraded":"2024-09-11T22:28:58.289281+0000","last_fullsized":"2024-09-11T22:28:58.289281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.623110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293890+0000","last_change":"2024-09-11T22:28:21.126140+0000","last_active":"2024-09-11T22:28:58.293890+0000","last_peered":"2024-09-11T22:28:58.293890+0000","last_clean":"2024-09-11T22:28:58.293890+0000","last_became_active":"2024-09-11T22:28:21.125782+0000","last_became_peered":"2024-09-11T22:28:21.125782+0000","last_unstale":"2024-09-11T22:28:58.293890+0000","last_undegraded":"2024-09-11T22:28:58.293890+0000","last_fullsized":"2024-09-11T22:28:58.293890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:10.328879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290703+0000","last_change":"2024-09-11T22:28:21.124145+0000","last_active":"2024-09-11T22:28:58.290703+0000","last_peered":"2024-09-11T22:28:58.290703+0000","last_clean":"2024-09-11T22:28:58.290703+0000","last_became_active":"2024-09-11T22:28:21.123826+0000","last_became_peered":"2024-09-11T22:28:21.123826+0000","last_unstale":"2024-09-11T22:28:58.290703+0000","last_undegraded":"2024-09-11T22:28:58.290703+0000","last_fullsized":"2024-09-11T22:28:58.290703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:35.558812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293206+0000","last_change":"2024-09-11T22:28:21.132106+0000","last_active":"2024-09-11T22:28:58.293206+0000","last_peered":"2024-09-11T22:28:58.293206+0000","last_clean":"2024-09-11T22:28:58.293206+0000","last_became_active":"2024-09-11T22:28:21.131755+0000","last_became_peered":"2024-09-11T22:28:21.131755+0000","last_unstale":"2024-09-11T22:28:58.293206+0000","last_undegraded":"2024-09-11T22:28:58.293206+0000","last_fullsized":"2024-09-11T22:28:58.293206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:20.910633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403449+0000","last_change":"2024-09-11T22:28:21.122348+0000","last_active":"2024-09-11T22:28:58.403449+0000","last_peered":"2024-09-11T22:28:58.403449+0000","last_clean":"2024-09-11T22:28:58.403449+0000","last_became_active":"2024-09-11T22:28:21.121858+0000","last_became_peered":"2024-09-11T22:28:21.121858+0000","last_unstale":"2024-09-11T22:28:58.403449+0000","last_undegraded":"2024-09-11T22:28:58.403449+0000","last_fullsized":"2024-09-11T22:28:58.403449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:11.297623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322390+0000","last_change":"2024-09-11T22:28:21.125006+0000","last_active":"2024-09-11T22:28:58.322390+0000","last_peered":"2024-09-11T22:28:58.322390+0000","last_clean":"2024-09-11T22:28:58.322390+0000","last_became_active":"2024-09-11T22:28:21.124685+0000","last_became_peered":"2024-09-11T22:28:21.124685+0000","last_unstale":"2024-09-11T22:28:58.322390+0000","last_undegraded":"2024-09-11T22:28:58.322390+0000","last_fullsized":"2024-09-11T22:28:58.322390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:30.057740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322452+0000","last_change":"2024-09-11T22:28:21.117285+0000","last_active":"2024-09-11T22:28:58.322452+0000","last_peered":"2024-09-11T22:28:58.322452+0000","last_clean":"2024-09-11T22:28:58.322452+0000","last_became_active":"2024-09-11T22:28:21.116982+0000","last_became_peered":"2024-09-11T22:28:21.116982+0000","last_unstale":"2024-09-11T22:28:58.322452+0000","last_undegraded":"2024-09-11T22:28:58.322452+0000","last_fullsized":"2024-09-11T22:28:58.322452+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:12.068737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.292146+0000","last_change":"2024-09-11T22:28:21.128020+0000","last_active":"2024-09-11T22:28:58.292146+0000","last_peered":"2024-09-11T22:28:58.292146+0000","last_clean":"2024-09-11T22:28:58.292146+0000","last_became_active":"2024-09-11T22:28:21.127665+0000","last_became_peered":"2024-09-11T22:28:21.127665+0000","last_unstale":"2024-09-11T22:28:58.292146+0000","last_undegraded":"2024-09-11T22:28:58.292146+0000","last_fullsized":"2024-09-11T22:28:58.292146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.422202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":47741,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":160,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":143223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481820,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":527068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710752,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37036,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708116,"statfs":{"total":95995035648,"available":95957110784,"internally_reserved":0,"allocated":1732608,"data_stored":1158074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874279,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":531400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135915,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":527224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364849,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1123528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528374,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":522480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790011,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28664,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716488,"statfs":{"total":95995035648,"available":95965683712,"internally_reserved":0,"allocated":1679360,"data_stored":1118723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":527523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":522674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1130496,"data_stored":567478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":565735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":523868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":43345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":45088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":45316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:29:33.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:29:33.718 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:33 smithi040 ceph-mon[30787]: from='client.24734 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:33.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:33 smithi177 ceph-mon[35530]: from='client.24734 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:33.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:33 smithi146 ceph-mon[34996]: from='client.24734 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:34.049 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:34.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:34 smithi040 ceph-mon[30787]: pgmap v341: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.4 KiB/s wr, 11 op/s 2024-09-11T22:29:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.596+0000 7f2f1b600640 1 -- 172.21.15.40:0/2240344425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14106f10 msgr2=0x7f2f1410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.596+0000 7f2f1b600640 1 --2- 172.21.15.40:0/2240344425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14106f10 0x7f2f1410ea90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009ca0 tx=0x7f2f0c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.596+0000 7f2f1b600640 1 -- 172.21.15.40:0/2240344425 shutdown_connections 2024-09-11T22:29:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.596+0000 7f2f1b600640 1 --2- 172.21.15.40:0/2240344425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14106f10 0x7f2f1410ea90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.596+0000 7f2f1b600640 1 --2- 172.21.15.40:0/2240344425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f14102790 0x7f2f141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.596+0000 7f2f1b600640 1 --2- 172.21.15.40:0/2240344425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f14101de0 0x7f2f141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.596+0000 7f2f1b600640 1 -- 172.21.15.40:0/2240344425 >> 172.21.15.40:0/2240344425 conn(0x7f2f140fd8c0 msgr2=0x7f2f140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.596+0000 7f2f1b600640 1 -- 172.21.15.40:0/2240344425 shutdown_connections 2024-09-11T22:29:34.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.596+0000 7f2f1b600640 1 -- 172.21.15.40:0/2240344425 wait complete. 2024-09-11T22:29:34.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.597+0000 7f2f1b600640 1 Processor -- start 2024-09-11T22:29:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.597+0000 7f2f1b600640 1 -- start start 2024-09-11T22:29:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f1b600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f14101de0 0x7f2f140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f1b600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14102790 0x7f2f14074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f1b600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f14106f10 0x7f2f14074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f1b600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14111fc0 con 0x7f2f14102790 2024-09-11T22:29:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f1b600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14111e40 con 0x7f2f14101de0 2024-09-11T22:29:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f1b600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f14112140 con 0x7f2f14106f10 2024-09-11T22:29:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f13e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14102790 0x7f2f14074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f13e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14102790 0x7f2f14074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41450/0 (socket says 172.21.15.40:41450) 2024-09-11T22:29:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f13e00640 1 -- 172.21.15.40:0/1746238119 learned_addr learned my addr 172.21.15.40:0/1746238119 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f18c00640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f14101de0 0x7f2f140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:34.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.598+0000 7f2f19600640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f14106f10 0x7f2f14074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:34.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f13e00640 1 -- 172.21.15.40:0/1746238119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f14106f10 msgr2=0x7f2f14074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:34.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f13e00640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f14106f10 0x7f2f14074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f13e00640 1 -- 172.21.15.40:0/1746238119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f14101de0 msgr2=0x7f2f140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:34.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f13e00640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f14101de0 0x7f2f140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f13e00640 1 -- 172.21.15.40:0/1746238119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f141a68a0 con 0x7f2f14102790 2024-09-11T22:29:34.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f19600640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f14106f10 0x7f2f14074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:34.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f13e00640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14102790 0x7f2f14074a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e9f0 tx=0x7f2f0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:34.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f11600640 1 -- 172.21.15.40:0/1746238119 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000cd80 con 0x7f2f14102790 2024-09-11T22:29:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f11600640 1 -- 172.21.15.40:0/1746238119 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f00010910 con 0x7f2f14102790 2024-09-11T22:29:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f141a6b90 con 0x7f2f14102790 2024-09-11T22:29:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.599+0000 7f2f11600640 1 -- 172.21.15.40:0/1746238119 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00018990 con 0x7f2f14102790 2024-09-11T22:29:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.600+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f141a70d0 con 0x7f2f14102790 2024-09-11T22:29:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.601+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f141021c0 con 0x7f2f14102790 2024-09-11T22:29:34.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.603+0000 7f2f11600640 1 -- 172.21.15.40:0/1746238119 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2f00010ac0 con 0x7f2f14102790 2024-09-11T22:29:34.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.604+0000 7f2f11600640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2efc0a2c10 0x7f2efc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:34.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.604+0000 7f2f11600640 1 -- 172.21.15.40:0/1746238119 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f2f000cf8b0 con 0x7f2f14102790 2024-09-11T22:29:34.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.604+0000 7f2f18c00640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2efc0a2c10 0x7f2efc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:34.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.605+0000 7f2f18c00640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2efc0a2c10 0x7f2efc0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009bd0 tx=0x7f2f08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:34.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.608+0000 7f2f11600640 1 -- 172.21.15.40:0/1746238119 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f0009c310 con 0x7f2f14102790 2024-09-11T22:29:34.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:34 smithi177 ceph-mon[35530]: pgmap v341: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.4 KiB/s wr, 11 op/s 2024-09-11T22:29:34.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.789+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f14062630 con 0x7f2efc0a2c10 2024-09-11T22:29:34.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.797+0000 7f2f11600640 1 -- 172.21.15.40:0/1746238119 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340359 (secure 0 0 0) 0x7f2f14062630 con 0x7f2efc0a2c10 2024-09-11T22:29:34.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:29:34.803 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T22:29:34.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2efc0a2c10 msgr2=0x7f2efc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2efc0a2c10 0x7f2efc0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009bd0 tx=0x7f2f08005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14102790 msgr2=0x7f2f14074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14102790 0x7f2f14074a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e9f0 tx=0x7f2f0000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 shutdown_connections 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2efc0a2c10 0x7f2efc0a50d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f14106f10 0x7f2f14074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f14102790 0x7f2f14074a30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 --2- 172.21.15.40:0/1746238119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f14101de0 0x7f2f140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.801+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 >> 172.21.15.40:0/1746238119 conn(0x7f2f140fd8c0 msgr2=0x7f2f140feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.802+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 shutdown_connections 2024-09-11T22:29:34.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:34.802+0000 7f2f1b600640 1 -- 172.21.15.40:0/1746238119 wait complete. 2024-09-11T22:29:34.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:34 smithi146 ceph-mon[34996]: pgmap v341: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.4 KiB/s wr, 11 op/s 2024-09-11T22:29:35.643 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-11T22:29:33.000278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647411,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":260,"num_read_kb":236,"num_write":347,"num_write_kb":3046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363740,"kb_used_data":14492,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578084,"statfs":{"total":1151940427776,"available":1151567958016,"internally_reserved":0,"allocated":14839808,"data_stored":8242979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49589,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":96,"num_write":37,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002946"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.362199+0000","last_change":"2024-09-11T22:28:18.585171+0000","last_active":"2024-09-11T22:29:13.362199+0000","last_peered":"2024-09-11T22:29:13.362199+0000","last_clean":"2024-09-11T22:29:13.362199+0000","last_became_active":"2024-09-11T22:28:18.584790+0000","last_became_peered":"2024-09-11T22:28:18.584790+0000","last_unstale":"2024-09-11T22:29:13.362199+0000","last_undegraded":"2024-09-11T22:29:13.362199+0000","last_fullsized":"2024-09-11T22:29:13.362199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:53.528254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288756+0000","last_change":"2024-09-11T22:28:21.126670+0000","last_active":"2024-09-11T22:28:58.288756+0000","last_peered":"2024-09-11T22:28:58.288756+0000","last_clean":"2024-09-11T22:28:58.288756+0000","last_became_active":"2024-09-11T22:28:21.126352+0000","last_became_peered":"2024-09-11T22:28:21.126352+0000","last_unstale":"2024-09-11T22:28:58.288756+0000","last_undegraded":"2024-09-11T22:28:58.288756+0000","last_fullsized":"2024-09-11T22:28:58.288756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:50.513073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293218+0000","last_change":"2024-09-11T22:28:30.184272+0000","last_active":"2024-09-11T22:28:58.293218+0000","last_peered":"2024-09-11T22:28:58.293218+0000","last_clean":"2024-09-11T22:28:58.293218+0000","last_became_active":"2024-09-11T22:28:30.182956+0000","last_became_peered":"2024-09-11T22:28:30.182956+0000","last_unstale":"2024-09-11T22:28:58.293218+0000","last_undegraded":"2024-09-11T22:28:58.293218+0000","last_fullsized":"2024-09-11T22:28:58.293218+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.773131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289208+0000","last_change":"2024-09-11T22:28:18.782833+0000","last_active":"2024-09-11T22:28:58.289208+0000","last_peered":"2024-09-11T22:28:58.289208+0000","last_clean":"2024-09-11T22:28:58.289208+0000","last_became_active":"2024-09-11T22:28:18.781202+0000","last_became_peered":"2024-09-11T22:28:18.781202+0000","last_unstale":"2024-09-11T22:28:58.289208+0000","last_undegraded":"2024-09-11T22:28:58.289208+0000","last_fullsized":"2024-09-11T22:28:58.289208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:47.389717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322590+0000","last_change":"2024-09-11T22:28:21.126106+0000","last_active":"2024-09-11T22:28:58.322590+0000","last_peered":"2024-09-11T22:28:58.322590+0000","last_clean":"2024-09-11T22:28:58.322590+0000","last_became_active":"2024-09-11T22:28:21.125760+0000","last_became_peered":"2024-09-11T22:28:21.125760+0000","last_unstale":"2024-09-11T22:28:58.322590+0000","last_undegraded":"2024-09-11T22:28:58.322590+0000","last_fullsized":"2024-09-11T22:28:58.322590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:18.500241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402798+0000","last_change":"2024-09-11T22:28:30.183343+0000","last_active":"2024-09-11T22:28:58.402798+0000","last_peered":"2024-09-11T22:28:58.402798+0000","last_clean":"2024-09-11T22:28:58.402798+0000","last_became_active":"2024-09-11T22:28:30.182811+0000","last_became_peered":"2024-09-11T22:28:30.182811+0000","last_unstale":"2024-09-11T22:28:58.402798+0000","last_undegraded":"2024-09-11T22:28:58.402798+0000","last_fullsized":"2024-09-11T22:28:58.402798+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:48:18.262267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.360354+0000","last_change":"2024-09-11T22:28:18.586872+0000","last_active":"2024-09-11T22:29:13.360354+0000","last_peered":"2024-09-11T22:29:13.360354+0000","last_clean":"2024-09-11T22:29:13.360354+0000","last_became_active":"2024-09-11T22:28:18.586516+0000","last_became_peered":"2024-09-11T22:28:18.586516+0000","last_unstale":"2024-09-11T22:29:13.360354+0000","last_undegraded":"2024-09-11T22:29:13.360354+0000","last_fullsized":"2024-09-11T22:29:13.360354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:07.479936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290649+0000","last_change":"2024-09-11T22:28:21.132488+0000","last_active":"2024-09-11T22:28:58.290649+0000","last_peered":"2024-09-11T22:28:58.290649+0000","last_clean":"2024-09-11T22:28:58.290649+0000","last_became_active":"2024-09-11T22:28:21.132153+0000","last_became_peered":"2024-09-11T22:28:21.132153+0000","last_unstale":"2024-09-11T22:28:58.290649+0000","last_undegraded":"2024-09-11T22:28:58.290649+0000","last_fullsized":"2024-09-11T22:28:58.290649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:43.791896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402969+0000","last_change":"2024-09-11T22:28:30.190272+0000","last_active":"2024-09-11T22:28:58.402969+0000","last_peered":"2024-09-11T22:28:58.402969+0000","last_clean":"2024-09-11T22:28:58.402969+0000","last_became_active":"2024-09-11T22:28:30.189912+0000","last_became_peered":"2024-09-11T22:28:30.189912+0000","last_unstale":"2024-09-11T22:28:58.402969+0000","last_undegraded":"2024-09-11T22:28:58.402969+0000","last_fullsized":"2024-09-11T22:28:58.402969+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:56.166963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.300107+0000","last_change":"2024-09-11T22:28:58.300107+0000","last_active":"2024-09-11T22:28:58.300107+0000","last_peered":"2024-09-11T22:28:58.300107+0000","last_clean":"2024-09-11T22:28:58.300107+0000","last_became_active":"2024-09-11T22:28:58.294806+0000","last_became_peered":"2024-09-11T22:28:58.294806+0000","last_unstale":"2024-09-11T22:28:58.300107+0000","last_undegraded":"2024-09-11T22:28:58.300107+0000","last_fullsized":"2024-09-11T22:28:58.300107+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:37.494929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288769+0000","last_change":"2024-09-11T22:28:21.128789+0000","last_active":"2024-09-11T22:28:58.288769+0000","last_peered":"2024-09-11T22:28:58.288769+0000","last_clean":"2024-09-11T22:28:58.288769+0000","last_became_active":"2024-09-11T22:28:21.128426+0000","last_became_peered":"2024-09-11T22:28:21.128426+0000","last_unstale":"2024-09-11T22:28:58.288769+0000","last_undegraded":"2024-09-11T22:28:58.288769+0000","last_fullsized":"2024-09-11T22:28:58.288769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:43.945247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402952+0000","last_change":"2024-09-11T22:28:30.190240+0000","last_active":"2024-09-11T22:28:58.402952+0000","last_peered":"2024-09-11T22:28:58.402952+0000","last_clean":"2024-09-11T22:28:58.402952+0000","last_became_active":"2024-09-11T22:28:30.189826+0000","last_became_peered":"2024-09-11T22:28:30.189826+0000","last_unstale":"2024-09-11T22:28:58.402952+0000","last_undegraded":"2024-09-11T22:28:58.402952+0000","last_fullsized":"2024-09-11T22:28:58.402952+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.040193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294035+0000","last_change":"2024-09-11T22:28:21.124389+0000","last_active":"2024-09-11T22:28:58.294035+0000","last_peered":"2024-09-11T22:28:58.294035+0000","last_clean":"2024-09-11T22:28:58.294035+0000","last_became_active":"2024-09-11T22:28:21.124058+0000","last_became_peered":"2024-09-11T22:28:21.124058+0000","last_unstale":"2024-09-11T22:28:58.294035+0000","last_undegraded":"2024-09-11T22:28:58.294035+0000","last_fullsized":"2024-09-11T22:28:58.294035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:02.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.354261+0000","last_change":"2024-09-11T22:28:58.304916+0000","last_active":"2024-09-11T22:29:12.354261+0000","last_peered":"2024-09-11T22:29:12.354261+0000","last_clean":"2024-09-11T22:29:12.354261+0000","last_became_active":"2024-09-11T22:28:58.296717+0000","last_became_peered":"2024-09-11T22:28:58.296717+0000","last_unstale":"2024-09-11T22:29:12.354261+0000","last_undegraded":"2024-09-11T22:29:12.354261+0000","last_fullsized":"2024-09-11T22:29:12.354261+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:30.044871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403390+0000","last_change":"2024-09-11T22:28:30.183135+0000","last_active":"2024-09-11T22:28:58.403390+0000","last_peered":"2024-09-11T22:28:58.403390+0000","last_clean":"2024-09-11T22:28:58.403390+0000","last_became_active":"2024-09-11T22:28:30.182768+0000","last_became_peered":"2024-09-11T22:28:30.182768+0000","last_unstale":"2024-09-11T22:28:58.403390+0000","last_undegraded":"2024-09-11T22:28:58.403390+0000","last_fullsized":"2024-09-11T22:28:58.403390+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:26.703807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288494+0000","last_change":"2024-09-11T22:28:21.128609+0000","last_active":"2024-09-11T22:28:58.288494+0000","last_peered":"2024-09-11T22:28:58.288494+0000","last_clean":"2024-09-11T22:28:58.288494+0000","last_became_active":"2024-09-11T22:28:21.128240+0000","last_became_peered":"2024-09-11T22:28:21.128240+0000","last_unstale":"2024-09-11T22:28:58.288494+0000","last_undegraded":"2024-09-11T22:28:58.288494+0000","last_fullsized":"2024-09-11T22:28:58.288494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:41.610223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293546+0000","last_change":"2024-09-11T22:28:18.588047+0000","last_active":"2024-09-11T22:28:58.293546+0000","last_peered":"2024-09-11T22:28:58.293546+0000","last_clean":"2024-09-11T22:28:58.293546+0000","last_became_active":"2024-09-11T22:28:18.587580+0000","last_became_peered":"2024-09-11T22:28:18.587580+0000","last_unstale":"2024-09-11T22:28:58.293546+0000","last_undegraded":"2024-09-11T22:28:58.293546+0000","last_fullsized":"2024-09-11T22:28:58.293546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:01.625014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403375+0000","last_change":"2024-09-11T22:28:30.194188+0000","last_active":"2024-09-11T22:28:58.403375+0000","last_peered":"2024-09-11T22:28:58.403375+0000","last_clean":"2024-09-11T22:28:58.403375+0000","last_became_active":"2024-09-11T22:28:30.193779+0000","last_became_peered":"2024-09-11T22:28:30.193779+0000","last_unstale":"2024-09-11T22:28:58.403375+0000","last_undegraded":"2024-09-11T22:28:58.403375+0000","last_fullsized":"2024-09-11T22:28:58.403375+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:37.328545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290728+0000","last_change":"2024-09-11T22:28:21.113112+0000","last_active":"2024-09-11T22:28:58.290728+0000","last_peered":"2024-09-11T22:28:58.290728+0000","last_clean":"2024-09-11T22:28:58.290728+0000","last_became_active":"2024-09-11T22:28:21.112644+0000","last_became_peered":"2024-09-11T22:28:21.112644+0000","last_unstale":"2024-09-11T22:28:58.290728+0000","last_undegraded":"2024-09-11T22:28:58.290728+0000","last_fullsized":"2024-09-11T22:28:58.290728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:47.520760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.353250+0000","last_change":"2024-09-11T22:28:18.587008+0000","last_active":"2024-09-11T22:29:12.353250+0000","last_peered":"2024-09-11T22:29:12.353250+0000","last_clean":"2024-09-11T22:29:12.353250+0000","last_became_active":"2024-09-11T22:28:18.586519+0000","last_became_peered":"2024-09-11T22:28:18.586519+0000","last_unstale":"2024-09-11T22:29:12.353250+0000","last_undegraded":"2024-09-11T22:29:12.353250+0000","last_fullsized":"2024-09-11T22:29:12.353250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:53.600253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403251+0000","last_change":"2024-09-11T22:28:30.182409+0000","last_active":"2024-09-11T22:28:58.403251+0000","last_peered":"2024-09-11T22:28:58.403251+0000","last_clean":"2024-09-11T22:28:58.403251+0000","last_became_active":"2024-09-11T22:28:30.181991+0000","last_became_peered":"2024-09-11T22:28:30.181991+0000","last_unstale":"2024-09-11T22:28:58.403251+0000","last_undegraded":"2024-09-11T22:28:58.403251+0000","last_fullsized":"2024-09-11T22:28:58.403251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:11.997540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.292952+0000","last_change":"2024-09-11T22:28:21.120079+0000","last_active":"2024-09-11T22:28:58.292952+0000","last_peered":"2024-09-11T22:28:58.292952+0000","last_clean":"2024-09-11T22:28:58.292952+0000","last_became_active":"2024-09-11T22:28:21.119691+0000","last_became_peered":"2024-09-11T22:28:21.119691+0000","last_unstale":"2024-09-11T22:28:58.292952+0000","last_undegraded":"2024-09-11T22:28:58.292952+0000","last_fullsized":"2024-09-11T22:28:58.292952+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:06.447839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.354670+0000","last_change":"2024-09-11T22:28:18.780774+0000","last_active":"2024-09-11T22:29:12.354670+0000","last_peered":"2024-09-11T22:29:12.354670+0000","last_clean":"2024-09-11T22:29:12.354670+0000","last_became_active":"2024-09-11T22:28:18.780460+0000","last_became_peered":"2024-09-11T22:28:18.780460+0000","last_unstale":"2024-09-11T22:29:12.354670+0000","last_undegraded":"2024-09-11T22:29:12.354670+0000","last_fullsized":"2024-09-11T22:29:12.354670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:03.157973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403725+0000","last_change":"2024-09-11T22:28:30.177658+0000","last_active":"2024-09-11T22:28:58.403725+0000","last_peered":"2024-09-11T22:28:58.403725+0000","last_clean":"2024-09-11T22:28:58.403725+0000","last_became_active":"2024-09-11T22:28:30.177237+0000","last_became_peered":"2024-09-11T22:28:30.177237+0000","last_unstale":"2024-09-11T22:28:58.403725+0000","last_undegraded":"2024-09-11T22:28:58.403725+0000","last_fullsized":"2024-09-11T22:28:58.403725+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:43.495545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322575+0000","last_change":"2024-09-11T22:28:21.127248+0000","last_active":"2024-09-11T22:28:58.322575+0000","last_peered":"2024-09-11T22:28:58.322575+0000","last_clean":"2024-09-11T22:28:58.322575+0000","last_became_active":"2024-09-11T22:28:21.126927+0000","last_became_peered":"2024-09-11T22:28:21.126927+0000","last_unstale":"2024-09-11T22:28:58.322575+0000","last_undegraded":"2024-09-11T22:28:58.322575+0000","last_fullsized":"2024-09-11T22:28:58.322575+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:22.219441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.352907+0000","last_change":"2024-09-11T22:28:18.728680+0000","last_active":"2024-09-11T22:29:12.352907+0000","last_peered":"2024-09-11T22:29:12.352907+0000","last_clean":"2024-09-11T22:29:12.352907+0000","last_became_active":"2024-09-11T22:28:18.728235+0000","last_became_peered":"2024-09-11T22:28:18.728235+0000","last_unstale":"2024-09-11T22:29:12.352907+0000","last_undegraded":"2024-09-11T22:29:12.352907+0000","last_fullsized":"2024-09-11T22:29:12.352907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:26.002304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293326+0000","last_change":"2024-09-11T22:28:30.179945+0000","last_active":"2024-09-11T22:28:58.293326+0000","last_peered":"2024-09-11T22:28:58.293326+0000","last_clean":"2024-09-11T22:28:58.293326+0000","last_became_active":"2024-09-11T22:28:30.179089+0000","last_became_peered":"2024-09-11T22:28:30.179089+0000","last_unstale":"2024-09-11T22:28:58.293326+0000","last_undegraded":"2024-09-11T22:28:58.293326+0000","last_fullsized":"2024-09-11T22:28:58.293326+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:34.126678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289337+0000","last_change":"2024-09-11T22:28:21.120411+0000","last_active":"2024-09-11T22:28:58.289337+0000","last_peered":"2024-09-11T22:28:58.289337+0000","last_clean":"2024-09-11T22:28:58.289337+0000","last_became_active":"2024-09-11T22:28:21.120048+0000","last_became_peered":"2024-09-11T22:28:21.120048+0000","last_unstale":"2024-09-11T22:28:58.289337+0000","last_undegraded":"2024-09-11T22:28:58.289337+0000","last_fullsized":"2024-09-11T22:28:58.289337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:07.194042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'11","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:28.136760+0000","last_change":"2024-09-11T22:28:18.581589+0000","last_active":"2024-09-11T22:29:28.136760+0000","last_peered":"2024-09-11T22:29:28.136760+0000","last_clean":"2024-09-11T22:29:28.136760+0000","last_became_active":"2024-09-11T22:28:18.581104+0000","last_became_peered":"2024-09-11T22:28:18.581104+0000","last_unstale":"2024-09-11T22:29:28.136760+0000","last_undegraded":"2024-09-11T22:29:28.136760+0000","last_fullsized":"2024-09-11T22:29:28.136760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:55.318466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288191+0000","last_change":"2024-09-11T22:28:30.188454+0000","last_active":"2024-09-11T22:28:58.288191+0000","last_peered":"2024-09-11T22:28:58.288191+0000","last_clean":"2024-09-11T22:28:58.288191+0000","last_became_active":"2024-09-11T22:28:30.188048+0000","last_became_peered":"2024-09-11T22:28:30.188048+0000","last_unstale":"2024-09-11T22:28:58.288191+0000","last_undegraded":"2024-09-11T22:28:58.288191+0000","last_fullsized":"2024-09-11T22:28:58.288191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:54.994664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288591+0000","last_change":"2024-09-11T22:28:21.122495+0000","last_active":"2024-09-11T22:28:58.288591+0000","last_peered":"2024-09-11T22:28:58.288591+0000","last_clean":"2024-09-11T22:28:58.288591+0000","last_became_active":"2024-09-11T22:28:21.122157+0000","last_became_peered":"2024-09-11T22:28:21.122157+0000","last_unstale":"2024-09-11T22:28:58.288591+0000","last_undegraded":"2024-09-11T22:28:58.288591+0000","last_fullsized":"2024-09-11T22:28:58.288591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.126632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.353156+0000","last_change":"2024-09-11T22:28:18.781729+0000","last_active":"2024-09-11T22:29:12.353156+0000","last_peered":"2024-09-11T22:29:12.353156+0000","last_clean":"2024-09-11T22:29:12.353156+0000","last_became_active":"2024-09-11T22:28:18.781391+0000","last_became_peered":"2024-09-11T22:28:18.781391+0000","last_unstale":"2024-09-11T22:29:12.353156+0000","last_undegraded":"2024-09-11T22:29:12.353156+0000","last_fullsized":"2024-09-11T22:29:12.353156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.711022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291615+0000","last_change":"2024-09-11T22:28:30.178873+0000","last_active":"2024-09-11T22:28:58.291615+0000","last_peered":"2024-09-11T22:28:58.291615+0000","last_clean":"2024-09-11T22:28:58.291615+0000","last_became_active":"2024-09-11T22:28:30.178479+0000","last_became_peered":"2024-09-11T22:28:30.178479+0000","last_unstale":"2024-09-11T22:28:58.291615+0000","last_undegraded":"2024-09-11T22:28:58.291615+0000","last_fullsized":"2024-09-11T22:28:58.291615+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:18.091351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290269+0000","last_change":"2024-09-11T22:28:21.132816+0000","last_active":"2024-09-11T22:28:58.290269+0000","last_peered":"2024-09-11T22:28:58.290269+0000","last_clean":"2024-09-11T22:28:58.290269+0000","last_became_active":"2024-09-11T22:28:21.132445+0000","last_became_peered":"2024-09-11T22:28:21.132445+0000","last_unstale":"2024-09-11T22:28:58.290269+0000","last_undegraded":"2024-09-11T22:28:58.290269+0000","last_fullsized":"2024-09-11T22:28:58.290269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:23.286982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402830+0000","last_change":"2024-09-11T22:28:18.782841+0000","last_active":"2024-09-11T22:28:58.402830+0000","last_peered":"2024-09-11T22:28:58.402830+0000","last_clean":"2024-09-11T22:28:58.402830+0000","last_became_active":"2024-09-11T22:28:18.782482+0000","last_became_peered":"2024-09-11T22:28:18.782482+0000","last_unstale":"2024-09-11T22:28:58.402830+0000","last_undegraded":"2024-09-11T22:28:58.402830+0000","last_fullsized":"2024-09-11T22:28:58.402830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:40.439534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293334+0000","last_change":"2024-09-11T22:28:30.181202+0000","last_active":"2024-09-11T22:28:58.293334+0000","last_peered":"2024-09-11T22:28:58.293334+0000","last_clean":"2024-09-11T22:28:58.293334+0000","last_became_active":"2024-09-11T22:28:30.180770+0000","last_became_peered":"2024-09-11T22:28:30.180770+0000","last_unstale":"2024-09-11T22:28:58.293334+0000","last_undegraded":"2024-09-11T22:28:58.293334+0000","last_fullsized":"2024-09-11T22:28:58.293334+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.019563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290218+0000","last_change":"2024-09-11T22:28:21.130663+0000","last_active":"2024-09-11T22:28:58.290218+0000","last_peered":"2024-09-11T22:28:58.290218+0000","last_clean":"2024-09-11T22:28:58.290218+0000","last_became_active":"2024-09-11T22:28:21.130299+0000","last_became_peered":"2024-09-11T22:28:21.130299+0000","last_unstale":"2024-09-11T22:28:58.290218+0000","last_undegraded":"2024-09-11T22:28:58.290218+0000","last_fullsized":"2024-09-11T22:28:58.290218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:47.888901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294224+0000","last_change":"2024-09-11T22:28:18.583456+0000","last_active":"2024-09-11T22:28:58.294224+0000","last_peered":"2024-09-11T22:28:58.294224+0000","last_clean":"2024-09-11T22:28:58.294224+0000","last_became_active":"2024-09-11T22:28:18.582547+0000","last_became_peered":"2024-09-11T22:28:18.582547+0000","last_unstale":"2024-09-11T22:28:58.294224+0000","last_undegraded":"2024-09-11T22:28:58.294224+0000","last_fullsized":"2024-09-11T22:28:58.294224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:16.128672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288337+0000","last_change":"2024-09-11T22:28:30.180057+0000","last_active":"2024-09-11T22:28:58.288337+0000","last_peered":"2024-09-11T22:28:58.288337+0000","last_clean":"2024-09-11T22:28:58.288337+0000","last_became_active":"2024-09-11T22:28:30.179653+0000","last_became_peered":"2024-09-11T22:28:30.179653+0000","last_unstale":"2024-09-11T22:28:58.288337+0000","last_undegraded":"2024-09-11T22:28:58.288337+0000","last_fullsized":"2024-09-11T22:28:58.288337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:08.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288078+0000","last_change":"2024-09-11T22:28:21.121130+0000","last_active":"2024-09-11T22:28:58.288078+0000","last_peered":"2024-09-11T22:28:58.288078+0000","last_clean":"2024-09-11T22:28:58.288078+0000","last_became_active":"2024-09-11T22:28:21.119673+0000","last_became_peered":"2024-09-11T22:28:21.119673+0000","last_unstale":"2024-09-11T22:28:58.288078+0000","last_undegraded":"2024-09-11T22:28:58.288078+0000","last_fullsized":"2024-09-11T22:28:58.288078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:48.095820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'4","reported_seq":61,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:31.388514+0000","last_change":"2024-09-11T22:28:18.781124+0000","last_active":"2024-09-11T22:29:31.388514+0000","last_peered":"2024-09-11T22:29:31.388514+0000","last_clean":"2024-09-11T22:29:31.388514+0000","last_became_active":"2024-09-11T22:28:18.780600+0000","last_became_peered":"2024-09-11T22:28:18.780600+0000","last_unstale":"2024-09-11T22:29:31.388514+0000","last_undegraded":"2024-09-11T22:29:31.388514+0000","last_fullsized":"2024-09-11T22:29:31.388514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.032623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288200+0000","last_change":"2024-09-11T22:28:30.180121+0000","last_active":"2024-09-11T22:28:58.288200+0000","last_peered":"2024-09-11T22:28:58.288200+0000","last_clean":"2024-09-11T22:28:58.288200+0000","last_became_active":"2024-09-11T22:28:30.179736+0000","last_became_peered":"2024-09-11T22:28:30.179736+0000","last_unstale":"2024-09-11T22:28:58.288200+0000","last_undegraded":"2024-09-11T22:28:58.288200+0000","last_fullsized":"2024-09-11T22:28:58.288200+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.199958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.287791+0000","last_change":"2024-09-11T22:28:21.111931+0000","last_active":"2024-09-11T22:28:58.287791+0000","last_peered":"2024-09-11T22:28:58.287791+0000","last_clean":"2024-09-11T22:28:58.287791+0000","last_became_active":"2024-09-11T22:28:21.111219+0000","last_became_peered":"2024-09-11T22:28:21.111219+0000","last_unstale":"2024-09-11T22:28:58.287791+0000","last_undegraded":"2024-09-11T22:28:58.287791+0000","last_fullsized":"2024-09-11T22:28:58.287791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:02.454748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.362193+0000","last_change":"2024-09-11T22:28:18.583841+0000","last_active":"2024-09-11T22:29:13.362193+0000","last_peered":"2024-09-11T22:29:13.362193+0000","last_clean":"2024-09-11T22:29:13.362193+0000","last_became_active":"2024-09-11T22:28:18.583459+0000","last_became_peered":"2024-09-11T22:28:18.583459+0000","last_unstale":"2024-09-11T22:29:13.362193+0000","last_undegraded":"2024-09-11T22:29:13.362193+0000","last_fullsized":"2024-09-11T22:29:13.362193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:05.174157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288686+0000","last_change":"2024-09-11T22:28:30.188646+0000","last_active":"2024-09-11T22:28:58.288686+0000","last_peered":"2024-09-11T22:28:58.288686+0000","last_clean":"2024-09-11T22:28:58.288686+0000","last_became_active":"2024-09-11T22:28:30.188243+0000","last_became_peered":"2024-09-11T22:28:30.188243+0000","last_unstale":"2024-09-11T22:28:58.288686+0000","last_undegraded":"2024-09-11T22:28:58.288686+0000","last_fullsized":"2024-09-11T22:28:58.288686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:46.794048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289850+0000","last_change":"2024-09-11T22:28:21.134979+0000","last_active":"2024-09-11T22:28:58.289850+0000","last_peered":"2024-09-11T22:28:58.289850+0000","last_clean":"2024-09-11T22:28:58.289850+0000","last_became_active":"2024-09-11T22:28:21.130803+0000","last_became_peered":"2024-09-11T22:28:21.130803+0000","last_unstale":"2024-09-11T22:28:58.289850+0000","last_undegraded":"2024-09-11T22:28:58.289850+0000","last_fullsized":"2024-09-11T22:28:58.289850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:04.385857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:14.363575+0000","last_change":"2024-09-11T22:28:18.583434+0000","last_active":"2024-09-11T22:29:14.363575+0000","last_peered":"2024-09-11T22:29:14.363575+0000","last_clean":"2024-09-11T22:29:14.363575+0000","last_became_active":"2024-09-11T22:28:18.583092+0000","last_became_peered":"2024-09-11T22:28:18.583092+0000","last_unstale":"2024-09-11T22:29:14.363575+0000","last_undegraded":"2024-09-11T22:29:14.363575+0000","last_fullsized":"2024-09-11T22:29:14.363575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:10.849520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294003+0000","last_change":"2024-09-11T22:27:00.252474+0000","last_active":"2024-09-11T22:28:58.294003+0000","last_peered":"2024-09-11T22:28:58.294003+0000","last_clean":"2024-09-11T22:28:58.294003+0000","last_became_active":"2024-09-11T22:27:00.252064+0000","last_became_peered":"2024-09-11T22:27:00.252064+0000","last_unstale":"2024-09-11T22:28:58.294003+0000","last_undegraded":"2024-09-11T22:28:58.294003+0000","last_fullsized":"2024-09-11T22:28:58.294003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:19.615362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:19.615362+0000","last_clean_scrub_stamp":"2024-09-11T22:23:19.615362+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:03.016822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294970+0000","last_change":"2024-09-11T22:28:30.181432+0000","last_active":"2024-09-11T22:28:58.294970+0000","last_peered":"2024-09-11T22:28:58.294970+0000","last_clean":"2024-09-11T22:28:58.294970+0000","last_became_active":"2024-09-11T22:28:30.180994+0000","last_became_peered":"2024-09-11T22:28:30.180994+0000","last_unstale":"2024-09-11T22:28:58.294970+0000","last_undegraded":"2024-09-11T22:28:58.294970+0000","last_fullsized":"2024-09-11T22:28:58.294970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:36.258723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.295023+0000","last_change":"2024-09-11T22:28:21.124641+0000","last_active":"2024-09-11T22:28:58.295023+0000","last_peered":"2024-09-11T22:28:58.295023+0000","last_clean":"2024-09-11T22:28:58.295023+0000","last_became_active":"2024-09-11T22:28:21.124266+0000","last_became_peered":"2024-09-11T22:28:21.124266+0000","last_unstale":"2024-09-11T22:28:58.295023+0000","last_undegraded":"2024-09-11T22:28:58.295023+0000","last_fullsized":"2024-09-11T22:28:58.295023+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:54.098515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.364049+0000","last_change":"2024-09-11T22:28:18.781028+0000","last_active":"2024-09-11T22:29:13.364049+0000","last_peered":"2024-09-11T22:29:13.364049+0000","last_clean":"2024-09-11T22:29:13.364049+0000","last_became_active":"2024-09-11T22:28:18.780566+0000","last_became_peered":"2024-09-11T22:28:18.780566+0000","last_unstale":"2024-09-11T22:29:13.364049+0000","last_undegraded":"2024-09-11T22:29:13.364049+0000","last_fullsized":"2024-09-11T22:29:13.364049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:14.760302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.297083+0000","last_change":"2024-09-11T22:28:58.297083+0000","last_active":"2024-09-11T22:28:58.297083+0000","last_peered":"2024-09-11T22:28:58.297083+0000","last_clean":"2024-09-11T22:28:58.297083+0000","last_became_active":"2024-09-11T22:28:58.296577+0000","last_became_peered":"2024-09-11T22:28:58.296577+0000","last_unstale":"2024-09-11T22:28:58.297083+0000","last_undegraded":"2024-09-11T22:28:58.297083+0000","last_fullsized":"2024-09-11T22:28:58.297083+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:42.592248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294357+0000","last_change":"2024-09-11T22:28:21.130748+0000","last_active":"2024-09-11T22:28:58.294357+0000","last_peered":"2024-09-11T22:28:58.294357+0000","last_clean":"2024-09-11T22:28:58.294357+0000","last_became_active":"2024-09-11T22:28:21.130397+0000","last_became_peered":"2024-09-11T22:28:21.130397+0000","last_unstale":"2024-09-11T22:28:58.294357+0000","last_undegraded":"2024-09-11T22:28:58.294357+0000","last_fullsized":"2024-09-11T22:28:58.294357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:09.683157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289007+0000","last_change":"2024-09-11T22:28:18.581826+0000","last_active":"2024-09-11T22:28:58.289007+0000","last_peered":"2024-09-11T22:28:58.289007+0000","last_clean":"2024-09-11T22:28:58.289007+0000","last_became_active":"2024-09-11T22:28:18.581485+0000","last_became_peered":"2024-09-11T22:28:18.581485+0000","last_unstale":"2024-09-11T22:28:58.289007+0000","last_undegraded":"2024-09-11T22:28:58.289007+0000","last_fullsized":"2024-09-11T22:28:58.289007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:10.930762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322174+0000","last_change":"2024-09-11T22:28:30.188296+0000","last_active":"2024-09-11T22:28:58.322174+0000","last_peered":"2024-09-11T22:28:58.322174+0000","last_clean":"2024-09-11T22:28:58.322174+0000","last_became_active":"2024-09-11T22:28:30.186935+0000","last_became_peered":"2024-09-11T22:28:30.186935+0000","last_unstale":"2024-09-11T22:28:58.322174+0000","last_undegraded":"2024-09-11T22:28:58.322174+0000","last_fullsized":"2024-09-11T22:28:58.322174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:05.918883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294518+0000","last_change":"2024-09-11T22:28:21.120482+0000","last_active":"2024-09-11T22:28:58.294518+0000","last_peered":"2024-09-11T22:28:58.294518+0000","last_clean":"2024-09-11T22:28:58.294518+0000","last_became_active":"2024-09-11T22:28:21.119896+0000","last_became_peered":"2024-09-11T22:28:21.119896+0000","last_unstale":"2024-09-11T22:28:58.294518+0000","last_undegraded":"2024-09-11T22:28:58.294518+0000","last_fullsized":"2024-09-11T22:28:58.294518+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:04.651745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.407709+0000","last_change":"2024-09-11T22:28:58.407709+0000","last_active":"2024-09-11T22:28:58.407709+0000","last_peered":"2024-09-11T22:28:58.407709+0000","last_clean":"2024-09-11T22:28:58.407709+0000","last_became_active":"2024-09-11T22:28:58.404756+0000","last_became_peered":"2024-09-11T22:28:58.404756+0000","last_unstale":"2024-09-11T22:28:58.407709+0000","last_undegraded":"2024-09-11T22:28:58.407709+0000","last_fullsized":"2024-09-11T22:28:58.407709+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.125354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.287962+0000","last_change":"2024-09-11T22:28:30.180575+0000","last_active":"2024-09-11T22:28:58.287962+0000","last_peered":"2024-09-11T22:28:58.287962+0000","last_clean":"2024-09-11T22:28:58.287962+0000","last_became_active":"2024-09-11T22:28:30.180057+0000","last_became_peered":"2024-09-11T22:28:30.180057+0000","last_unstale":"2024-09-11T22:28:58.287962+0000","last_undegraded":"2024-09-11T22:28:58.287962+0000","last_fullsized":"2024-09-11T22:28:58.287962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:18.130207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291864+0000","last_change":"2024-09-11T22:28:21.122167+0000","last_active":"2024-09-11T22:28:58.291864+0000","last_peered":"2024-09-11T22:28:58.291864+0000","last_clean":"2024-09-11T22:28:58.291864+0000","last_became_active":"2024-09-11T22:28:21.121777+0000","last_became_peered":"2024-09-11T22:28:21.121777+0000","last_unstale":"2024-09-11T22:28:58.291864+0000","last_undegraded":"2024-09-11T22:28:58.291864+0000","last_fullsized":"2024-09-11T22:28:58.291864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:42.316290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:14.357424+0000","last_change":"2024-09-11T22:28:18.583557+0000","last_active":"2024-09-11T22:29:14.357424+0000","last_peered":"2024-09-11T22:29:14.357424+0000","last_clean":"2024-09-11T22:29:14.357424+0000","last_became_active":"2024-09-11T22:28:18.583153+0000","last_became_peered":"2024-09-11T22:28:18.583153+0000","last_unstale":"2024-09-11T22:29:14.357424+0000","last_undegraded":"2024-09-11T22:29:14.357424+0000","last_fullsized":"2024-09-11T22:29:14.357424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:40.246846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288031+0000","last_change":"2024-09-11T22:28:30.184545+0000","last_active":"2024-09-11T22:28:58.288031+0000","last_peered":"2024-09-11T22:28:58.288031+0000","last_clean":"2024-09-11T22:28:58.288031+0000","last_became_active":"2024-09-11T22:28:30.184135+0000","last_became_peered":"2024-09-11T22:28:30.184135+0000","last_unstale":"2024-09-11T22:28:58.288031+0000","last_undegraded":"2024-09-11T22:28:58.288031+0000","last_fullsized":"2024-09-11T22:28:58.288031+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:11.088364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294752+0000","last_change":"2024-09-11T22:28:58.294752+0000","last_active":"2024-09-11T22:28:58.294752+0000","last_peered":"2024-09-11T22:28:58.294752+0000","last_clean":"2024-09-11T22:28:58.294752+0000","last_became_active":"2024-09-11T22:28:58.293124+0000","last_became_peered":"2024-09-11T22:28:58.293124+0000","last_unstale":"2024-09-11T22:28:58.294752+0000","last_undegraded":"2024-09-11T22:28:58.294752+0000","last_fullsized":"2024-09-11T22:28:58.294752+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:28.054316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.364308+0000","last_change":"2024-09-11T22:28:18.781320+0000","last_active":"2024-09-11T22:29:13.364308+0000","last_peered":"2024-09-11T22:29:13.364308+0000","last_clean":"2024-09-11T22:29:13.364308+0000","last_became_active":"2024-09-11T22:28:18.780987+0000","last_became_peered":"2024-09-11T22:28:18.780987+0000","last_unstale":"2024-09-11T22:29:13.364308+0000","last_undegraded":"2024-09-11T22:29:13.364308+0000","last_fullsized":"2024-09-11T22:29:13.364308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:03.717586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288328+0000","last_change":"2024-09-11T22:28:30.185048+0000","last_active":"2024-09-11T22:28:58.288328+0000","last_peered":"2024-09-11T22:28:58.288328+0000","last_clean":"2024-09-11T22:28:58.288328+0000","last_became_active":"2024-09-11T22:28:30.184652+0000","last_became_peered":"2024-09-11T22:28:30.184652+0000","last_unstale":"2024-09-11T22:28:58.288328+0000","last_undegraded":"2024-09-11T22:28:58.288328+0000","last_fullsized":"2024-09-11T22:28:58.288328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:29.449432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293898+0000","last_change":"2024-09-11T22:28:21.126875+0000","last_active":"2024-09-11T22:28:58.293898+0000","last_peered":"2024-09-11T22:28:58.293898+0000","last_clean":"2024-09-11T22:28:58.293898+0000","last_became_active":"2024-09-11T22:28:21.126549+0000","last_became_peered":"2024-09-11T22:28:21.126549+0000","last_unstale":"2024-09-11T22:28:58.293898+0000","last_undegraded":"2024-09-11T22:28:58.293898+0000","last_fullsized":"2024-09-11T22:28:58.293898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:16.410693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'4","reported_seq":64,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:31.388734+0000","last_change":"2024-09-11T22:28:18.586008+0000","last_active":"2024-09-11T22:29:31.388734+0000","last_peered":"2024-09-11T22:29:31.388734+0000","last_clean":"2024-09-11T22:29:31.388734+0000","last_became_active":"2024-09-11T22:28:18.585254+0000","last_became_peered":"2024-09-11T22:28:18.585254+0000","last_unstale":"2024-09-11T22:29:31.388734+0000","last_undegraded":"2024-09-11T22:29:31.388734+0000","last_fullsized":"2024-09-11T22:29:31.388734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:50.083339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.323956+0000","last_change":"2024-09-11T22:28:58.323573+0000","last_active":"2024-09-11T22:28:58.323956+0000","last_peered":"2024-09-11T22:28:58.323956+0000","last_clean":"2024-09-11T22:28:58.323956+0000","last_became_active":"2024-09-11T22:28:58.323233+0000","last_became_peered":"2024-09-11T22:28:58.323233+0000","last_unstale":"2024-09-11T22:28:58.323956+0000","last_undegraded":"2024-09-11T22:28:58.323956+0000","last_fullsized":"2024-09-11T22:28:58.323956+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:33.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294153+0000","last_change":"2024-09-11T22:28:21.133655+0000","last_active":"2024-09-11T22:28:58.294153+0000","last_peered":"2024-09-11T22:28:58.294153+0000","last_clean":"2024-09-11T22:28:58.294153+0000","last_became_active":"2024-09-11T22:28:21.133296+0000","last_became_peered":"2024-09-11T22:28:21.133296+0000","last_unstale":"2024-09-11T22:28:58.294153+0000","last_undegraded":"2024-09-11T22:28:58.294153+0000","last_fullsized":"2024-09-11T22:28:58.294153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:54.956883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.353855+0000","last_change":"2024-09-11T22:28:18.585001+0000","last_active":"2024-09-11T22:29:12.353855+0000","last_peered":"2024-09-11T22:29:12.353855+0000","last_clean":"2024-09-11T22:29:12.353855+0000","last_became_active":"2024-09-11T22:28:18.584570+0000","last_became_peered":"2024-09-11T22:28:18.584570+0000","last_unstale":"2024-09-11T22:29:12.353855+0000","last_undegraded":"2024-09-11T22:29:12.353855+0000","last_fullsized":"2024-09-11T22:29:12.353855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291224+0000","last_change":"2024-09-11T22:28:30.192923+0000","last_active":"2024-09-11T22:28:58.291224+0000","last_peered":"2024-09-11T22:28:58.291224+0000","last_clean":"2024-09-11T22:28:58.291224+0000","last_became_active":"2024-09-11T22:28:30.192600+0000","last_became_peered":"2024-09-11T22:28:30.192600+0000","last_unstale":"2024-09-11T22:28:58.291224+0000","last_undegraded":"2024-09-11T22:28:58.291224+0000","last_fullsized":"2024-09-11T22:28:58.291224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.287990+0000","last_change":"2024-09-11T22:28:21.131088+0000","last_active":"2024-09-11T22:28:58.287990+0000","last_peered":"2024-09-11T22:28:58.287990+0000","last_clean":"2024-09-11T22:28:58.287990+0000","last_became_active":"2024-09-11T22:28:21.127001+0000","last_became_peered":"2024-09-11T22:28:21.127001+0000","last_unstale":"2024-09-11T22:28:58.287990+0000","last_undegraded":"2024-09-11T22:28:58.287990+0000","last_fullsized":"2024-09-11T22:28:58.287990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:50.297619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.362578+0000","last_change":"2024-09-11T22:28:18.587245+0000","last_active":"2024-09-11T22:29:13.362578+0000","last_peered":"2024-09-11T22:29:13.362578+0000","last_clean":"2024-09-11T22:29:13.362578+0000","last_became_active":"2024-09-11T22:28:18.586873+0000","last_became_peered":"2024-09-11T22:28:18.586873+0000","last_unstale":"2024-09-11T22:29:13.362578+0000","last_undegraded":"2024-09-11T22:29:13.362578+0000","last_fullsized":"2024-09-11T22:29:13.362578+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:27.715781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288657+0000","last_change":"2024-09-11T22:28:30.183839+0000","last_active":"2024-09-11T22:28:58.288657+0000","last_peered":"2024-09-11T22:28:58.288657+0000","last_clean":"2024-09-11T22:28:58.288657+0000","last_became_active":"2024-09-11T22:28:30.183382+0000","last_became_peered":"2024-09-11T22:28:30.183382+0000","last_unstale":"2024-09-11T22:28:58.288657+0000","last_undegraded":"2024-09-11T22:28:58.288657+0000","last_fullsized":"2024-09-11T22:28:58.288657+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:31.144195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293886+0000","last_change":"2024-09-11T22:28:21.116932+0000","last_active":"2024-09-11T22:28:58.293886+0000","last_peered":"2024-09-11T22:28:58.293886+0000","last_clean":"2024-09-11T22:28:58.293886+0000","last_became_active":"2024-09-11T22:28:21.116285+0000","last_became_peered":"2024-09-11T22:28:21.116285+0000","last_unstale":"2024-09-11T22:28:58.293886+0000","last_undegraded":"2024-09-11T22:28:58.293886+0000","last_fullsized":"2024-09-11T22:28:58.293886+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:04.737879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'29","reported_seq":107,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:30.389674+0000","last_change":"2024-09-11T22:28:18.581616+0000","last_active":"2024-09-11T22:29:30.389674+0000","last_peered":"2024-09-11T22:29:30.389674+0000","last_clean":"2024-09-11T22:29:30.389674+0000","last_became_active":"2024-09-11T22:28:18.581218+0000","last_became_peered":"2024-09-11T22:28:18.581218+0000","last_unstale":"2024-09-11T22:29:30.389674+0000","last_undegraded":"2024-09-11T22:29:30.389674+0000","last_fullsized":"2024-09-11T22:29:30.389674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:10.351050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52413,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":71,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.297809+0000","last_change":"2024-09-11T22:28:58.297256+0000","last_active":"2024-09-11T22:28:58.297809+0000","last_peered":"2024-09-11T22:28:58.297809+0000","last_clean":"2024-09-11T22:28:58.297809+0000","last_became_active":"2024-09-11T22:28:58.296671+0000","last_became_peered":"2024-09-11T22:28:58.296671+0000","last_unstale":"2024-09-11T22:28:58.297809+0000","last_undegraded":"2024-09-11T22:28:58.297809+0000","last_fullsized":"2024-09-11T22:28:58.297809+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:31.240144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291031+0000","last_change":"2024-09-11T22:28:21.128792+0000","last_active":"2024-09-11T22:28:58.291031+0000","last_peered":"2024-09-11T22:28:58.291031+0000","last_clean":"2024-09-11T22:28:58.291031+0000","last_became_active":"2024-09-11T22:28:21.128429+0000","last_became_peered":"2024-09-11T22:28:21.128429+0000","last_unstale":"2024-09-11T22:28:58.291031+0000","last_undegraded":"2024-09-11T22:28:58.291031+0000","last_fullsized":"2024-09-11T22:28:58.291031+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:16.049877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.353341+0000","last_change":"2024-09-11T22:28:18.781827+0000","last_active":"2024-09-11T22:29:12.353341+0000","last_peered":"2024-09-11T22:29:12.353341+0000","last_clean":"2024-09-11T22:29:12.353341+0000","last_became_active":"2024-09-11T22:28:18.781453+0000","last_became_peered":"2024-09-11T22:28:18.781453+0000","last_unstale":"2024-09-11T22:29:12.353341+0000","last_undegraded":"2024-09-11T22:29:12.353341+0000","last_fullsized":"2024-09-11T22:29:12.353341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:37.901034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403280+0000","last_change":"2024-09-11T22:28:30.182457+0000","last_active":"2024-09-11T22:28:58.403280+0000","last_peered":"2024-09-11T22:28:58.403280+0000","last_clean":"2024-09-11T22:28:58.403280+0000","last_became_active":"2024-09-11T22:28:30.181834+0000","last_became_peered":"2024-09-11T22:28:30.181834+0000","last_unstale":"2024-09-11T22:28:58.403280+0000","last_undegraded":"2024-09-11T22:28:58.403280+0000","last_fullsized":"2024-09-11T22:28:58.403280+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:21.847470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322601+0000","last_change":"2024-09-11T22:28:21.121896+0000","last_active":"2024-09-11T22:28:58.322601+0000","last_peered":"2024-09-11T22:28:58.322601+0000","last_clean":"2024-09-11T22:28:58.322601+0000","last_became_active":"2024-09-11T22:28:21.120639+0000","last_became_peered":"2024-09-11T22:28:21.120639+0000","last_unstale":"2024-09-11T22:28:58.322601+0000","last_undegraded":"2024-09-11T22:28:58.322601+0000","last_fullsized":"2024-09-11T22:28:58.322601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:59:58.707107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:12.352998+0000","last_change":"2024-09-11T22:28:18.584577+0000","last_active":"2024-09-11T22:29:12.352998+0000","last_peered":"2024-09-11T22:29:12.352998+0000","last_clean":"2024-09-11T22:29:12.352998+0000","last_became_active":"2024-09-11T22:28:18.583642+0000","last_became_peered":"2024-09-11T22:28:18.583642+0000","last_unstale":"2024-09-11T22:29:12.352998+0000","last_undegraded":"2024-09-11T22:29:12.352998+0000","last_fullsized":"2024-09-11T22:29:12.352998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:09.685642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402362+0000","last_change":"2024-09-11T22:28:30.182767+0000","last_active":"2024-09-11T22:28:58.402362+0000","last_peered":"2024-09-11T22:28:58.402362+0000","last_clean":"2024-09-11T22:28:58.402362+0000","last_became_active":"2024-09-11T22:28:30.181902+0000","last_became_peered":"2024-09-11T22:28:30.181902+0000","last_unstale":"2024-09-11T22:28:58.402362+0000","last_undegraded":"2024-09-11T22:28:58.402362+0000","last_fullsized":"2024-09-11T22:28:58.402362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:49.618633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290420+0000","last_change":"2024-09-11T22:28:21.132388+0000","last_active":"2024-09-11T22:28:58.290420+0000","last_peered":"2024-09-11T22:28:58.290420+0000","last_clean":"2024-09-11T22:28:58.290420+0000","last_became_active":"2024-09-11T22:28:21.132053+0000","last_became_peered":"2024-09-11T22:28:21.132053+0000","last_unstale":"2024-09-11T22:28:58.290420+0000","last_undegraded":"2024-09-11T22:28:58.290420+0000","last_fullsized":"2024-09-11T22:28:58.290420+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:04.813600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'3","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:29.385553+0000","last_change":"2024-09-11T22:28:18.577057+0000","last_active":"2024-09-11T22:29:29.385553+0000","last_peered":"2024-09-11T22:29:29.385553+0000","last_clean":"2024-09-11T22:29:29.385553+0000","last_became_active":"2024-09-11T22:28:18.576678+0000","last_became_peered":"2024-09-11T22:28:18.576678+0000","last_unstale":"2024-09-11T22:29:29.385553+0000","last_undegraded":"2024-09-11T22:29:29.385553+0000","last_fullsized":"2024-09-11T22:29:29.385553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:04.425896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288679+0000","last_change":"2024-09-11T22:28:30.184139+0000","last_active":"2024-09-11T22:28:58.288679+0000","last_peered":"2024-09-11T22:28:58.288679+0000","last_clean":"2024-09-11T22:28:58.288679+0000","last_became_active":"2024-09-11T22:28:30.182817+0000","last_became_peered":"2024-09-11T22:28:30.182817+0000","last_unstale":"2024-09-11T22:28:58.288679+0000","last_undegraded":"2024-09-11T22:28:58.288679+0000","last_fullsized":"2024-09-11T22:28:58.288679+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:43.829873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322444+0000","last_change":"2024-09-11T22:28:30.182250+0000","last_active":"2024-09-11T22:28:58.322444+0000","last_peered":"2024-09-11T22:28:58.322444+0000","last_clean":"2024-09-11T22:28:58.322444+0000","last_became_active":"2024-09-11T22:28:30.178758+0000","last_became_peered":"2024-09-11T22:28:30.178758+0000","last_unstale":"2024-09-11T22:28:58.322444+0000","last_undegraded":"2024-09-11T22:28:58.322444+0000","last_fullsized":"2024-09-11T22:28:58.322444+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:25.120475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402505+0000","last_change":"2024-09-11T22:28:21.121208+0000","last_active":"2024-09-11T22:28:58.402505+0000","last_peered":"2024-09-11T22:28:58.402505+0000","last_clean":"2024-09-11T22:28:58.402505+0000","last_became_active":"2024-09-11T22:28:21.120904+0000","last_became_peered":"2024-09-11T22:28:21.120904+0000","last_unstale":"2024-09-11T22:28:58.402505+0000","last_undegraded":"2024-09-11T22:28:58.402505+0000","last_fullsized":"2024-09-11T22:28:58.402505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:36.696739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288246+0000","last_change":"2024-09-11T22:28:18.584471+0000","last_active":"2024-09-11T22:28:58.288246+0000","last_peered":"2024-09-11T22:28:58.288246+0000","last_clean":"2024-09-11T22:28:58.288246+0000","last_became_active":"2024-09-11T22:28:18.584124+0000","last_became_peered":"2024-09-11T22:28:18.584124+0000","last_unstale":"2024-09-11T22:28:58.288246+0000","last_undegraded":"2024-09-11T22:28:58.288246+0000","last_fullsized":"2024-09-11T22:28:58.288246+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:40.992385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403924+0000","last_change":"2024-09-11T22:28:58.403924+0000","last_active":"2024-09-11T22:28:58.403924+0000","last_peered":"2024-09-11T22:28:58.403924+0000","last_clean":"2024-09-11T22:28:58.403924+0000","last_became_active":"2024-09-11T22:28:58.403543+0000","last_became_peered":"2024-09-11T22:28:58.403543+0000","last_unstale":"2024-09-11T22:28:58.403924+0000","last_undegraded":"2024-09-11T22:28:58.403924+0000","last_fullsized":"2024-09-11T22:28:58.403924+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:16.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289204+0000","last_change":"2024-09-11T22:28:21.136111+0000","last_active":"2024-09-11T22:28:58.289204+0000","last_peered":"2024-09-11T22:28:58.289204+0000","last_clean":"2024-09-11T22:28:58.289204+0000","last_became_active":"2024-09-11T22:28:21.135576+0000","last_became_peered":"2024-09-11T22:28:21.135576+0000","last_unstale":"2024-09-11T22:28:58.289204+0000","last_undegraded":"2024-09-11T22:28:58.289204+0000","last_fullsized":"2024-09-11T22:28:58.289204+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:30.134734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.362105+0000","last_change":"2024-09-11T22:28:18.583388+0000","last_active":"2024-09-11T22:29:13.362105+0000","last_peered":"2024-09-11T22:29:13.362105+0000","last_clean":"2024-09-11T22:29:13.362105+0000","last_became_active":"2024-09-11T22:28:18.582215+0000","last_became_peered":"2024-09-11T22:28:18.582215+0000","last_unstale":"2024-09-11T22:29:13.362105+0000","last_undegraded":"2024-09-11T22:29:13.362105+0000","last_fullsized":"2024-09-11T22:29:13.362105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:56.816276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:13.360834+0000","last_change":"2024-09-11T22:28:18.581722+0000","last_active":"2024-09-11T22:29:13.360834+0000","last_peered":"2024-09-11T22:29:13.360834+0000","last_clean":"2024-09-11T22:29:13.360834+0000","last_became_active":"2024-09-11T22:28:18.580961+0000","last_became_peered":"2024-09-11T22:28:18.580961+0000","last_unstale":"2024-09-11T22:29:13.360834+0000","last_undegraded":"2024-09-11T22:29:13.360834+0000","last_fullsized":"2024-09-11T22:29:13.360834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:22.629114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288305+0000","last_change":"2024-09-11T22:28:21.122053+0000","last_active":"2024-09-11T22:28:58.288305+0000","last_peered":"2024-09-11T22:28:58.288305+0000","last_clean":"2024-09-11T22:28:58.288305+0000","last_became_active":"2024-09-11T22:28:21.121708+0000","last_became_peered":"2024-09-11T22:28:21.121708+0000","last_unstale":"2024-09-11T22:28:58.288305+0000","last_undegraded":"2024-09-11T22:28:58.288305+0000","last_fullsized":"2024-09-11T22:28:58.288305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:36.457640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293934+0000","last_change":"2024-09-11T22:28:30.194472+0000","last_active":"2024-09-11T22:28:58.293934+0000","last_peered":"2024-09-11T22:28:58.293934+0000","last_clean":"2024-09-11T22:28:58.293934+0000","last_became_active":"2024-09-11T22:28:30.193986+0000","last_became_peered":"2024-09-11T22:28:30.193986+0000","last_unstale":"2024-09-11T22:28:58.293934+0000","last_undegraded":"2024-09-11T22:28:58.293934+0000","last_fullsized":"2024-09-11T22:28:58.293934+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:27.608919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:29:30.387710+0000","last_change":"2024-09-11T22:28:18.588739+0000","last_active":"2024-09-11T22:29:30.387710+0000","last_peered":"2024-09-11T22:29:30.387710+0000","last_clean":"2024-09-11T22:29:30.387710+0000","last_became_active":"2024-09-11T22:28:18.586218+0000","last_became_peered":"2024-09-11T22:28:18.586218+0000","last_unstale":"2024-09-11T22:29:30.387710+0000","last_undegraded":"2024-09-11T22:29:30.387710+0000","last_fullsized":"2024-09-11T22:29:30.387710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:08.493132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293508+0000","last_change":"2024-09-11T22:28:21.122076+0000","last_active":"2024-09-11T22:28:58.293508+0000","last_peered":"2024-09-11T22:28:58.293508+0000","last_clean":"2024-09-11T22:28:58.293508+0000","last_became_active":"2024-09-11T22:28:21.121692+0000","last_became_peered":"2024-09-11T22:28:21.121692+0000","last_unstale":"2024-09-11T22:28:58.293508+0000","last_undegraded":"2024-09-11T22:28:58.293508+0000","last_fullsized":"2024-09-11T22:28:58.293508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:10.165221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294686+0000","last_change":"2024-09-11T22:28:30.179240+0000","last_active":"2024-09-11T22:28:58.294686+0000","last_peered":"2024-09-11T22:28:58.294686+0000","last_clean":"2024-09-11T22:28:58.294686+0000","last_became_active":"2024-09-11T22:28:30.178855+0000","last_became_peered":"2024-09-11T22:28:30.178855+0000","last_unstale":"2024-09-11T22:28:58.294686+0000","last_undegraded":"2024-09-11T22:28:58.294686+0000","last_fullsized":"2024-09-11T22:28:58.294686+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:19.671279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290718+0000","last_change":"2024-09-11T22:28:21.115166+0000","last_active":"2024-09-11T22:28:58.290718+0000","last_peered":"2024-09-11T22:28:58.290718+0000","last_clean":"2024-09-11T22:28:58.290718+0000","last_became_active":"2024-09-11T22:28:21.114840+0000","last_became_peered":"2024-09-11T22:28:21.114840+0000","last_unstale":"2024-09-11T22:28:58.290718+0000","last_undegraded":"2024-09-11T22:28:58.290718+0000","last_fullsized":"2024-09-11T22:28:58.290718+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:09.505715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293731+0000","last_change":"2024-09-11T22:28:21.119822+0000","last_active":"2024-09-11T22:28:58.293731+0000","last_peered":"2024-09-11T22:28:58.293731+0000","last_clean":"2024-09-11T22:28:58.293731+0000","last_became_active":"2024-09-11T22:28:21.119480+0000","last_became_peered":"2024-09-11T22:28:21.119480+0000","last_unstale":"2024-09-11T22:28:58.293731+0000","last_undegraded":"2024-09-11T22:28:58.293731+0000","last_fullsized":"2024-09-11T22:28:58.293731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:35.654943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293396+0000","last_change":"2024-09-11T22:28:21.123521+0000","last_active":"2024-09-11T22:28:58.293396+0000","last_peered":"2024-09-11T22:28:58.293396+0000","last_clean":"2024-09-11T22:28:58.293396+0000","last_became_active":"2024-09-11T22:28:21.123197+0000","last_became_peered":"2024-09-11T22:28:21.123197+0000","last_unstale":"2024-09-11T22:28:58.293396+0000","last_undegraded":"2024-09-11T22:28:58.293396+0000","last_fullsized":"2024-09-11T22:28:58.293396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.418987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322258+0000","last_change":"2024-09-11T22:28:21.117212+0000","last_active":"2024-09-11T22:28:58.322258+0000","last_peered":"2024-09-11T22:28:58.322258+0000","last_clean":"2024-09-11T22:28:58.322258+0000","last_became_active":"2024-09-11T22:28:21.112432+0000","last_became_peered":"2024-09-11T22:28:21.112432+0000","last_unstale":"2024-09-11T22:28:58.322258+0000","last_undegraded":"2024-09-11T22:28:58.322258+0000","last_fullsized":"2024-09-11T22:28:58.322258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:56.053471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288499+0000","last_change":"2024-09-11T22:28:21.115374+0000","last_active":"2024-09-11T22:28:58.288499+0000","last_peered":"2024-09-11T22:28:58.288499+0000","last_clean":"2024-09-11T22:28:58.288499+0000","last_became_active":"2024-09-11T22:28:21.114943+0000","last_became_peered":"2024-09-11T22:28:21.114943+0000","last_unstale":"2024-09-11T22:28:58.288499+0000","last_undegraded":"2024-09-11T22:28:58.288499+0000","last_fullsized":"2024-09-11T22:28:58.288499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:32.564226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291599+0000","last_change":"2024-09-11T22:28:21.122897+0000","last_active":"2024-09-11T22:28:58.291599+0000","last_peered":"2024-09-11T22:28:58.291599+0000","last_clean":"2024-09-11T22:28:58.291599+0000","last_became_active":"2024-09-11T22:28:21.122594+0000","last_became_peered":"2024-09-11T22:28:21.122594+0000","last_unstale":"2024-09-11T22:28:58.291599+0000","last_undegraded":"2024-09-11T22:28:58.291599+0000","last_fullsized":"2024-09-11T22:28:58.291599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:37.698479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.295550+0000","last_change":"2024-09-11T22:28:21.126252+0000","last_active":"2024-09-11T22:28:58.295550+0000","last_peered":"2024-09-11T22:28:58.295550+0000","last_clean":"2024-09-11T22:28:58.295550+0000","last_became_active":"2024-09-11T22:28:21.125935+0000","last_became_peered":"2024-09-11T22:28:21.125935+0000","last_unstale":"2024-09-11T22:28:58.295550+0000","last_undegraded":"2024-09-11T22:28:58.295550+0000","last_fullsized":"2024-09-11T22:28:58.295550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.451659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.297133+0000","last_change":"2024-09-11T22:28:58.297133+0000","last_active":"2024-09-11T22:28:58.297133+0000","last_peered":"2024-09-11T22:28:58.297133+0000","last_clean":"2024-09-11T22:28:58.297133+0000","last_became_active":"2024-09-11T22:28:58.296767+0000","last_became_peered":"2024-09-11T22:28:58.296767+0000","last_unstale":"2024-09-11T22:28:58.297133+0000","last_undegraded":"2024-09-11T22:28:58.297133+0000","last_fullsized":"2024-09-11T22:28:58.297133+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:28:49.660837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288053+0000","last_change":"2024-09-11T22:28:21.122293+0000","last_active":"2024-09-11T22:28:58.288053+0000","last_peered":"2024-09-11T22:28:58.288053+0000","last_clean":"2024-09-11T22:28:58.288053+0000","last_became_active":"2024-09-11T22:28:21.121930+0000","last_became_peered":"2024-09-11T22:28:21.121930+0000","last_unstale":"2024-09-11T22:28:58.288053+0000","last_undegraded":"2024-09-11T22:28:58.288053+0000","last_fullsized":"2024-09-11T22:28:58.288053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:43.231206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288858+0000","last_change":"2024-09-11T22:28:21.123949+0000","last_active":"2024-09-11T22:28:58.288858+0000","last_peered":"2024-09-11T22:28:58.288858+0000","last_clean":"2024-09-11T22:28:58.288858+0000","last_became_active":"2024-09-11T22:28:21.121894+0000","last_became_peered":"2024-09-11T22:28:21.121894+0000","last_unstale":"2024-09-11T22:28:58.288858+0000","last_undegraded":"2024-09-11T22:28:58.288858+0000","last_fullsized":"2024-09-11T22:28:58.288858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:56.227648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291238+0000","last_change":"2024-09-11T22:28:21.136287+0000","last_active":"2024-09-11T22:28:58.291238+0000","last_peered":"2024-09-11T22:28:58.291238+0000","last_clean":"2024-09-11T22:28:58.291238+0000","last_became_active":"2024-09-11T22:28:21.136000+0000","last_became_peered":"2024-09-11T22:28:21.136000+0000","last_unstale":"2024-09-11T22:28:58.291238+0000","last_undegraded":"2024-09-11T22:28:58.291238+0000","last_fullsized":"2024-09-11T22:28:58.291238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:32.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.288409+0000","last_change":"2024-09-11T22:28:21.117324+0000","last_active":"2024-09-11T22:28:58.288409+0000","last_peered":"2024-09-11T22:28:58.288409+0000","last_clean":"2024-09-11T22:28:58.288409+0000","last_became_active":"2024-09-11T22:28:21.116945+0000","last_became_peered":"2024-09-11T22:28:21.116945+0000","last_unstale":"2024-09-11T22:28:58.288409+0000","last_undegraded":"2024-09-11T22:28:58.288409+0000","last_fullsized":"2024-09-11T22:28:58.288409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.672745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291348+0000","last_change":"2024-09-11T22:28:21.117336+0000","last_active":"2024-09-11T22:28:58.291348+0000","last_peered":"2024-09-11T22:28:58.291348+0000","last_clean":"2024-09-11T22:28:58.291348+0000","last_became_active":"2024-09-11T22:28:21.117005+0000","last_became_peered":"2024-09-11T22:28:21.117005+0000","last_unstale":"2024-09-11T22:28:58.291348+0000","last_undegraded":"2024-09-11T22:28:58.291348+0000","last_fullsized":"2024-09-11T22:28:58.291348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:55.932442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294869+0000","last_change":"2024-09-11T22:28:21.132066+0000","last_active":"2024-09-11T22:28:58.294869+0000","last_peered":"2024-09-11T22:28:58.294869+0000","last_clean":"2024-09-11T22:28:58.294869+0000","last_became_active":"2024-09-11T22:28:21.131676+0000","last_became_peered":"2024-09-11T22:28:21.131676+0000","last_unstale":"2024-09-11T22:28:58.294869+0000","last_undegraded":"2024-09-11T22:28:58.294869+0000","last_fullsized":"2024-09-11T22:28:58.294869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:50.484049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.402915+0000","last_change":"2024-09-11T22:28:21.125532+0000","last_active":"2024-09-11T22:28:58.402915+0000","last_peered":"2024-09-11T22:28:58.402915+0000","last_clean":"2024-09-11T22:28:58.402915+0000","last_became_active":"2024-09-11T22:28:21.125182+0000","last_became_peered":"2024-09-11T22:28:21.125182+0000","last_unstale":"2024-09-11T22:28:58.402915+0000","last_undegraded":"2024-09-11T22:28:58.402915+0000","last_fullsized":"2024-09-11T22:28:58.402915+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:35.272900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.292241+0000","last_change":"2024-09-11T22:28:21.129029+0000","last_active":"2024-09-11T22:28:58.292241+0000","last_peered":"2024-09-11T22:28:58.292241+0000","last_clean":"2024-09-11T22:28:58.292241+0000","last_became_active":"2024-09-11T22:28:21.128690+0000","last_became_peered":"2024-09-11T22:28:21.128690+0000","last_unstale":"2024-09-11T22:28:58.292241+0000","last_undegraded":"2024-09-11T22:28:58.292241+0000","last_fullsized":"2024-09-11T22:28:58.292241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:57.723871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290546+0000","last_change":"2024-09-11T22:28:21.134491+0000","last_active":"2024-09-11T22:28:58.290546+0000","last_peered":"2024-09-11T22:28:58.290546+0000","last_clean":"2024-09-11T22:28:58.290546+0000","last_became_active":"2024-09-11T22:28:21.134142+0000","last_became_peered":"2024-09-11T22:28:21.134142+0000","last_unstale":"2024-09-11T22:28:58.290546+0000","last_undegraded":"2024-09-11T22:28:58.290546+0000","last_fullsized":"2024-09-11T22:28:58.290546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:16.960823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322092+0000","last_change":"2024-09-11T22:28:21.114033+0000","last_active":"2024-09-11T22:28:58.322092+0000","last_peered":"2024-09-11T22:28:58.322092+0000","last_clean":"2024-09-11T22:28:58.322092+0000","last_became_active":"2024-09-11T22:28:21.113689+0000","last_became_peered":"2024-09-11T22:28:21.113689+0000","last_unstale":"2024-09-11T22:28:58.322092+0000","last_undegraded":"2024-09-11T22:28:58.322092+0000","last_fullsized":"2024-09-11T22:28:58.322092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:16.199958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322149+0000","last_change":"2024-09-11T22:28:21.120938+0000","last_active":"2024-09-11T22:28:58.322149+0000","last_peered":"2024-09-11T22:28:58.322149+0000","last_clean":"2024-09-11T22:28:58.322149+0000","last_became_active":"2024-09-11T22:28:21.120410+0000","last_became_peered":"2024-09-11T22:28:21.120410+0000","last_unstale":"2024-09-11T22:28:58.322149+0000","last_undegraded":"2024-09-11T22:28:58.322149+0000","last_fullsized":"2024-09-11T22:28:58.322149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.745133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289049+0000","last_change":"2024-09-11T22:28:21.131506+0000","last_active":"2024-09-11T22:28:58.289049+0000","last_peered":"2024-09-11T22:28:58.289049+0000","last_clean":"2024-09-11T22:28:58.289049+0000","last_became_active":"2024-09-11T22:28:21.123877+0000","last_became_peered":"2024-09-11T22:28:21.123877+0000","last_unstale":"2024-09-11T22:28:58.289049+0000","last_undegraded":"2024-09-11T22:28:58.289049+0000","last_fullsized":"2024-09-11T22:28:58.289049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:12.399779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403519+0000","last_change":"2024-09-11T22:28:21.121211+0000","last_active":"2024-09-11T22:28:58.403519+0000","last_peered":"2024-09-11T22:28:58.403519+0000","last_clean":"2024-09-11T22:28:58.403519+0000","last_became_active":"2024-09-11T22:28:21.120900+0000","last_became_peered":"2024-09-11T22:28:21.120900+0000","last_unstale":"2024-09-11T22:28:58.403519+0000","last_undegraded":"2024-09-11T22:28:58.403519+0000","last_fullsized":"2024-09-11T22:28:58.403519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:22.052996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.294915+0000","last_change":"2024-09-11T22:28:21.125329+0000","last_active":"2024-09-11T22:28:58.294915+0000","last_peered":"2024-09-11T22:28:58.294915+0000","last_clean":"2024-09-11T22:28:58.294915+0000","last_became_active":"2024-09-11T22:28:21.124998+0000","last_became_peered":"2024-09-11T22:28:21.124998+0000","last_unstale":"2024-09-11T22:28:58.294915+0000","last_undegraded":"2024-09-11T22:28:58.294915+0000","last_fullsized":"2024-09-11T22:28:58.294915+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:46.559796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.291068+0000","last_change":"2024-09-11T22:28:21.123364+0000","last_active":"2024-09-11T22:28:58.291068+0000","last_peered":"2024-09-11T22:28:58.291068+0000","last_clean":"2024-09-11T22:28:58.291068+0000","last_became_active":"2024-09-11T22:28:21.123042+0000","last_became_peered":"2024-09-11T22:28:21.123042+0000","last_unstale":"2024-09-11T22:28:58.291068+0000","last_undegraded":"2024-09-11T22:28:58.291068+0000","last_fullsized":"2024-09-11T22:28:58.291068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:21.938986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290576+0000","last_change":"2024-09-11T22:28:21.131206+0000","last_active":"2024-09-11T22:28:58.290576+0000","last_peered":"2024-09-11T22:28:58.290576+0000","last_clean":"2024-09-11T22:28:58.290576+0000","last_became_active":"2024-09-11T22:28:21.130879+0000","last_became_peered":"2024-09-11T22:28:21.130879+0000","last_unstale":"2024-09-11T22:28:58.290576+0000","last_undegraded":"2024-09-11T22:28:58.290576+0000","last_fullsized":"2024-09-11T22:28:58.290576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:02.260645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.289281+0000","last_change":"2024-09-11T22:28:21.128349+0000","last_active":"2024-09-11T22:28:58.289281+0000","last_peered":"2024-09-11T22:28:58.289281+0000","last_clean":"2024-09-11T22:28:58.289281+0000","last_became_active":"2024-09-11T22:28:21.124628+0000","last_became_peered":"2024-09-11T22:28:21.124628+0000","last_unstale":"2024-09-11T22:28:58.289281+0000","last_undegraded":"2024-09-11T22:28:58.289281+0000","last_fullsized":"2024-09-11T22:28:58.289281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.623110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293890+0000","last_change":"2024-09-11T22:28:21.126140+0000","last_active":"2024-09-11T22:28:58.293890+0000","last_peered":"2024-09-11T22:28:58.293890+0000","last_clean":"2024-09-11T22:28:58.293890+0000","last_became_active":"2024-09-11T22:28:21.125782+0000","last_became_peered":"2024-09-11T22:28:21.125782+0000","last_unstale":"2024-09-11T22:28:58.293890+0000","last_undegraded":"2024-09-11T22:28:58.293890+0000","last_fullsized":"2024-09-11T22:28:58.293890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:10.328879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.290703+0000","last_change":"2024-09-11T22:28:21.124145+0000","last_active":"2024-09-11T22:28:58.290703+0000","last_peered":"2024-09-11T22:28:58.290703+0000","last_clean":"2024-09-11T22:28:58.290703+0000","last_became_active":"2024-09-11T22:28:21.123826+0000","last_became_peered":"2024-09-11T22:28:21.123826+0000","last_unstale":"2024-09-11T22:28:58.290703+0000","last_undegraded":"2024-09-11T22:28:58.290703+0000","last_fullsized":"2024-09-11T22:28:58.290703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:35.558812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.293206+0000","last_change":"2024-09-11T22:28:21.132106+0000","last_active":"2024-09-11T22:28:58.293206+0000","last_peered":"2024-09-11T22:28:58.293206+0000","last_clean":"2024-09-11T22:28:58.293206+0000","last_became_active":"2024-09-11T22:28:21.131755+0000","last_became_peered":"2024-09-11T22:28:21.131755+0000","last_unstale":"2024-09-11T22:28:58.293206+0000","last_undegraded":"2024-09-11T22:28:58.293206+0000","last_fullsized":"2024-09-11T22:28:58.293206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:20.910633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.403449+0000","last_change":"2024-09-11T22:28:21.122348+0000","last_active":"2024-09-11T22:28:58.403449+0000","last_peered":"2024-09-11T22:28:58.403449+0000","last_clean":"2024-09-11T22:28:58.403449+0000","last_became_active":"2024-09-11T22:28:21.121858+0000","last_became_peered":"2024-09-11T22:28:21.121858+0000","last_unstale":"2024-09-11T22:28:58.403449+0000","last_undegraded":"2024-09-11T22:28:58.403449+0000","last_fullsized":"2024-09-11T22:28:58.403449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:11.297623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322390+0000","last_change":"2024-09-11T22:28:21.125006+0000","last_active":"2024-09-11T22:28:58.322390+0000","last_peered":"2024-09-11T22:28:58.322390+0000","last_clean":"2024-09-11T22:28:58.322390+0000","last_became_active":"2024-09-11T22:28:21.124685+0000","last_became_peered":"2024-09-11T22:28:21.124685+0000","last_unstale":"2024-09-11T22:28:58.322390+0000","last_undegraded":"2024-09-11T22:28:58.322390+0000","last_fullsized":"2024-09-11T22:28:58.322390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:30.057740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.322452+0000","last_change":"2024-09-11T22:28:21.117285+0000","last_active":"2024-09-11T22:28:58.322452+0000","last_peered":"2024-09-11T22:28:58.322452+0000","last_clean":"2024-09-11T22:28:58.322452+0000","last_became_active":"2024-09-11T22:28:21.116982+0000","last_became_peered":"2024-09-11T22:28:21.116982+0000","last_unstale":"2024-09-11T22:28:58.322452+0000","last_undegraded":"2024-09-11T22:28:58.322452+0000","last_fullsized":"2024-09-11T22:28:58.322452+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:12.068737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-11T22:28:58.292146+0000","last_change":"2024-09-11T22:28:21.128020+0000","last_active":"2024-09-11T22:28:58.292146+0000","last_peered":"2024-09-11T22:28:58.292146+0000","last_clean":"2024-09-11T22:28:58.292146+0000","last_became_active":"2024-09-11T22:28:21.127665+0000","last_became_peered":"2024-09-11T22:28:21.127665+0000","last_unstale":"2024-09-11T22:28:58.292146+0000","last_undegraded":"2024-09-11T22:28:58.292146+0000","last_fullsized":"2024-09-11T22:28:58.292146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.422202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56809,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":164,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":170427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481821,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":527068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710753,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37044,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708108,"statfs":{"total":95995035648,"available":95957102592,"internally_reserved":0,"allocated":1740800,"data_stored":1167142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874279,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":531400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135915,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":527224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364849,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28656,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716496,"statfs":{"total":95995035648,"available":95965691904,"internally_reserved":0,"allocated":1671168,"data_stored":1123528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528375,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":522480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790012,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28664,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716488,"statfs":{"total":95995035648,"available":95965683712,"internally_reserved":0,"allocated":1679360,"data_stored":1118723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953538,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":527523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":522674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1138688,"data_stored":576546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":574803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":523868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":54156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:29:35.648 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T22:29:35.648 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T22:29:35.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T22:29:35.697 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:35 smithi040 ceph-mon[30787]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:35.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:35 smithi177 ceph-mon[35530]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:35.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:35 smithi146 ceph-mon[34996]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:29:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:36.670 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:36 smithi040 ceph-mon[30787]: pgmap v342: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-11T22:29:36.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.665+0000 7f9bad200640 1 -- 172.21.15.40:0/1453149214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 msgr2=0x7f9ba81053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:36.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.665+0000 7f9bad200640 1 --2- 172.21.15.40:0/1453149214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 0x7f9ba81053e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009900 tx=0x7f9b9402a3f0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.665+0000 7f9bad200640 1 -- 172.21.15.40:0/1453149214 shutdown_connections 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.665+0000 7f9bad200640 1 --2- 172.21.15.40:0/1453149214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba8105920 0x7f9ba810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.665+0000 7f9bad200640 1 --2- 172.21.15.40:0/1453149214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 0x7f9ba81053e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.665+0000 7f9bad200640 1 --2- 172.21.15.40:0/1453149214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba8103e00 0x7f9ba8104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.665+0000 7f9bad200640 1 -- 172.21.15.40:0/1453149214 >> 172.21.15.40:0/1453149214 conn(0x7f9ba80ff5b0 msgr2=0x7f9ba81019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.665+0000 7f9bad200640 1 -- 172.21.15.40:0/1453149214 shutdown_connections 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.665+0000 7f9bad200640 1 -- 172.21.15.40:0/1453149214 wait complete. 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.666+0000 7f9bad200640 1 Processor -- start 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.666+0000 7f9bad200640 1 -- start start 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.666+0000 7f9bad200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba8103e00 0x7f9ba819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.666+0000 7f9bad200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 0x7f9ba819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.666+0000 7f9bad200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba8105920 0x7f9ba81a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.666+0000 7f9bad200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba810fb00 con 0x7f9ba8104f60 2024-09-11T22:29:36.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.666+0000 7f9bad200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba810f980 con 0x7f9ba8105920 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.666+0000 7f9bad200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba810fc80 con 0x7f9ba8103e00 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 0x7f9ba819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 0x7f9ba819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41478/0 (socket says 172.21.15.40:41478) 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5400640 1 -- 172.21.15.40:0/1568244489 learned_addr learned my addr 172.21.15.40:0/1568244489 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5e00640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba8103e00 0x7f9ba819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba6800640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba8105920 0x7f9ba81a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5400640 1 -- 172.21.15.40:0/1568244489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba8103e00 msgr2=0x7f9ba819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5400640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba8103e00 0x7f9ba819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5400640 1 -- 172.21.15.40:0/1568244489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba8105920 msgr2=0x7f9ba81a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5400640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba8105920 0x7f9ba81a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5400640 1 -- 172.21.15.40:0/1568244489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba81a1d20 con 0x7f9ba8104f60 2024-09-11T22:29:36.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.667+0000 7f9ba5400640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 0x7f9ba819a630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9b94031440 tx=0x7f9b94032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.668+0000 7f9b9ea00640 1 -- 172.21.15.40:0/1568244489 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9403f030 con 0x7f9ba8104f60 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.668+0000 7f9b9ea00640 1 -- 172.21.15.40:0/1568244489 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b94003ce0 con 0x7f9ba8104f60 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.668+0000 7f9b9ea00640 1 -- 172.21.15.40:0/1568244489 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94035070 con 0x7f9ba8104f60 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.668+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba81a1fb0 con 0x7f9ba8104f60 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.668+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba81a2400 con 0x7f9ba8104f60 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.669+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba810b240 con 0x7f9ba8104f60 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.671+0000 7f9b9ea00640 1 -- 172.21.15.40:0/1568244489 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9b94042030 con 0x7f9ba8104f60 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.673+0000 7f9b9ea00640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b8c0a2cc0 0x7f9b8c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.673+0000 7f9b9ea00640 1 -- 172.21.15.40:0/1568244489 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f9b940ef5c0 con 0x7f9ba8104f60 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.674+0000 7f9ba5e00640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b8c0a2cc0 0x7f9b8c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.674+0000 7f9ba5e00640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b8c0a2cc0 0x7f9b8c0a5180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009bd0 tx=0x7f9b98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.678+0000 7f9b9ea00640 1 -- 172.21.15.40:0/1568244489 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b940bb9d0 con 0x7f9ba8104f60 2024-09-11T22:29:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:36 smithi177 ceph-mon[35530]: pgmap v342: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-11T22:29:36.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:36 smithi146 ceph-mon[34996]: pgmap v342: 129 pgs: 129 active+clean; 632 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-11T22:29:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.932+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f9ba802d7c0 con 0x7f9ba8104f60 2024-09-11T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.935+0000 7f9b9ea00640 1 -- 172.21.15.40:0/1568244489 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f9b940bfcd0 con 0x7f9ba8104f60 2024-09-11T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-09-11T22:29:36.936 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDQGeJmeXOvNxAAcVul5PErNWf3J+vh+DSy8w== 2024-09-11T22:29:36.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b8c0a2cc0 msgr2=0x7f9b8c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b8c0a2cc0 0x7f9b8c0a5180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009bd0 tx=0x7f9b98005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 msgr2=0x7f9ba819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 0x7f9ba819a630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9b94031440 tx=0x7f9b94032ce0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 shutdown_connections 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9b8c0a2cc0 0x7f9b8c0a5180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ba8105920 0x7f9ba81a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba8104f60 0x7f9ba819a630 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 --2- 172.21.15.40:0/1568244489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ba8103e00 0x7f9ba819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 >> 172.21.15.40:0/1568244489 conn(0x7f9ba80ff5b0 msgr2=0x7f9ba8108410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 shutdown_connections 2024-09-11T22:29:36.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:36.939+0000 7f9bad200640 1 -- 172.21.15.40:0/1568244489 wait complete. 2024-09-11T22:29:37.590 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:37 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1568244489' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T22:29:37.591 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:37 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1568244489' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T22:29:37.628 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:29:37.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T22:29:37.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T22:29:37.709 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T22:29:37.709 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T22:29:37.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T22:29:37.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:37 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1568244489' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T22:29:37.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:37 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1568244489' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T22:29:37.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:37 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1568244489' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T22:29:37.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:37 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1568244489' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T22:29:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.683+0000 7ff54d600640 1 -- 172.21.15.40:0/2648247404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff548101de0 msgr2=0x7ff5481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.683+0000 7ff54d600640 1 --2- 172.21.15.40:0/2648247404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff548101de0 0x7ff5481021c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff538009900 tx=0x7ff53802a410 comp rx=0 tx=0).stop 2024-09-11T22:29:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.683+0000 7ff54d600640 1 -- 172.21.15.40:0/2648247404 shutdown_connections 2024-09-11T22:29:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.683+0000 7ff54d600640 1 --2- 172.21.15.40:0/2648247404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff548106f10 0x7ff54810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.683+0000 7ff54d600640 1 --2- 172.21.15.40:0/2648247404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff548102790 0x7ff5481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.683+0000 7ff54d600640 1 --2- 172.21.15.40:0/2648247404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff548101de0 0x7ff5481021c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.683+0000 7ff54d600640 1 -- 172.21.15.40:0/2648247404 >> 172.21.15.40:0/2648247404 conn(0x7ff5480fd8c0 msgr2=0x7ff5480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.683+0000 7ff54d600640 1 -- 172.21.15.40:0/2648247404 shutdown_connections 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.683+0000 7ff54d600640 1 -- 172.21.15.40:0/2648247404 wait complete. 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.684+0000 7ff54d600640 1 Processor -- start 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.684+0000 7ff54d600640 1 -- start start 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff54d600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff548101de0 0x7ff54819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff54d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff548102790 0x7ff54819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff54d600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff548106f10 0x7ff54819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff54d600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff548111fc0 con 0x7ff548106f10 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff54d600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff548111e40 con 0x7ff548102790 2024-09-11T22:29:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff54d600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff548112140 con 0x7ff548101de0 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff546a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff548101de0 0x7ff54819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff547400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff548106f10 0x7ff54819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff546a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff548101de0 0x7ff54819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:33898/0 (socket says 172.21.15.40:33898) 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff546a00640 1 -- 172.21.15.40:0/3045020995 learned_addr learned my addr 172.21.15.40:0/3045020995 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.685+0000 7ff53e000640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff548102790 0x7ff54819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff546a00640 1 -- 172.21.15.40:0/3045020995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff548102790 msgr2=0x7ff54819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff546a00640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff548102790 0x7ff54819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff546a00640 1 -- 172.21.15.40:0/3045020995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff548106f10 msgr2=0x7ff54819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff546a00640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff548106f10 0x7ff54819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff546a00640 1 -- 172.21.15.40:0/3045020995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54819f5b0 con 0x7ff548101de0 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff546a00640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff548101de0 0x7ff54819a600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff538004770 tx=0x7ff538003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff53fe00640 1 -- 172.21.15.40:0/3045020995 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53803f070 con 0x7ff548101de0 2024-09-11T22:29:38.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff54819f840 con 0x7ff548101de0 2024-09-11T22:29:38.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff53fe00640 1 -- 172.21.15.40:0/3045020995 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff538031ca0 con 0x7ff548101de0 2024-09-11T22:29:38.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff53fe00640 1 -- 172.21.15.40:0/3045020995 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538035030 con 0x7ff548101de0 2024-09-11T22:29:38.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.686+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5481a7180 con 0x7ff548101de0 2024-09-11T22:29:38.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.687+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5481032c0 con 0x7ff548101de0 2024-09-11T22:29:38.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.689+0000 7ff53fe00640 1 -- 172.21.15.40:0/3045020995 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff538042070 con 0x7ff548101de0 2024-09-11T22:29:38.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.691+0000 7ff53fe00640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff52c0a2c10 0x7ff52c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.691+0000 7ff53fe00640 1 -- 172.21.15.40:0/3045020995 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7ff5380f01b0 con 0x7ff548101de0 2024-09-11T22:29:38.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.691+0000 7ff53e000640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff52c0a2c10 0x7ff52c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.692+0000 7ff53e000640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff52c0a2c10 0x7ff52c0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff5480ff6e0 tx=0x7ff53000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.693+0000 7ff53fe00640 1 -- 172.21.15.40:0/3045020995 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5380bc5c0 con 0x7ff548101de0 2024-09-11T22:29:38.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.927+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff5481a7350 con 0x7ff548101de0 2024-09-11T22:29:38.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.932+0000 7ff53fe00640 1 -- 172.21.15.40:0/3045020995 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263201 (secure 0 0 0) 0x7ff5380c08c0 con 0x7ff548101de0 2024-09-11T22:29:38.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:29:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff52c0a2c10 msgr2=0x7ff52c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff52c0a2c10 0x7ff52c0a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff5480ff6e0 tx=0x7ff53000b410 comp rx=0 tx=0).stop 2024-09-11T22:29:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff548101de0 msgr2=0x7ff54819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff548101de0 0x7ff54819a600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff538004770 tx=0x7ff538003c10 comp rx=0 tx=0).stop 2024-09-11T22:29:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 shutdown_connections 2024-09-11T22:29:38.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff52c0a2c10 0x7ff52c0a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff548106f10 0x7ff54819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff548102790 0x7ff54819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 --2- 172.21.15.40:0/3045020995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff548101de0 0x7ff54819a600 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 >> 172.21.15.40:0/3045020995 conn(0x7ff5480fd8c0 msgr2=0x7ff5480feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:38.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 shutdown_connections 2024-09-11T22:29:38.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:38.936+0000 7ff54d600640 1 -- 172.21.15.40:0/3045020995 wait complete. 2024-09-11T22:29:39.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:38 smithi040 ceph-mon[30787]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-11T22:29:39.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:38 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3045020995' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T22:29:39.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:38 smithi177 ceph-mon[35530]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-11T22:29:39.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:38 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3045020995' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T22:29:39.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:38 smithi146 ceph-mon[34996]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-11T22:29:39.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:38 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3045020995' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T22:29:39.941 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3905506167},{"type":"v1","addr":"172.21.15.40:6801","nonce":3905506167}]},"active_addr":"172.21.15.40:6801/3905506167","active_change":"2024-09-11T22:20:56.889394+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.40:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1863219122}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":4013177470}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1704917296}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3649124703}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1040017001}]}]} 2024-09-11T22:29:39.948 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T22:29:39.948 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T22:29:39.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:29:40.327 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:40.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.945+0000 7fccb6c00640 1 -- 172.21.15.40:0/2936072075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb0102b90 msgr2=0x7fccb0102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:40.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.945+0000 7fccb6c00640 1 --2- 172.21.15.40:0/2936072075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb0102b90 0x7fccb0102f70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009900 tx=0x7fcca402a480 comp rx=0 tx=0).stop 2024-09-11T22:29:40.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.945+0000 7fccb6c00640 1 -- 172.21.15.40:0/2936072075 shutdown_connections 2024-09-11T22:29:40.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.945+0000 7fccb6c00640 1 --2- 172.21.15.40:0/2936072075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb010bfc0 0x7fccb010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:40.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.945+0000 7fccb6c00640 1 --2- 172.21.15.40:0/2936072075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb01034b0 0x7fccb010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:40.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.945+0000 7fccb6c00640 1 --2- 172.21.15.40:0/2936072075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb0102b90 0x7fccb0102f70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:40.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.945+0000 7fccb6c00640 1 -- 172.21.15.40:0/2936072075 >> 172.21.15.40:0/2936072075 conn(0x7fccb00fc610 msgr2=0x7fccb00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:40.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.945+0000 7fccb6c00640 1 -- 172.21.15.40:0/2936072075 shutdown_connections 2024-09-11T22:29:40.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.945+0000 7fccb6c00640 1 -- 172.21.15.40:0/2936072075 wait complete. 2024-09-11T22:29:40.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.946+0000 7fccb6c00640 1 Processor -- start 2024-09-11T22:29:40.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb6c00640 1 -- start start 2024-09-11T22:29:40.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb6c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb0102b90 0x7fccb019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:40.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb6c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb01034b0 0x7fccb019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:40.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb6c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb010bfc0 0x7fccb019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb6c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0111e10 con 0x7fccb010bfc0 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb6c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0111c90 con 0x7fccb01034b0 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb6c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0111f90 con 0x7fccb0102b90 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb4e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb01034b0 0x7fccb019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb5800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb0102b90 0x7fccb019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb4e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb01034b0 0x7fccb019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:40830/0 (socket says 172.21.15.40:40830) 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb4e00640 1 -- 172.21.15.40:0/4094298316 learned_addr learned my addr 172.21.15.40:0/4094298316 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb5800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb0102b90 0x7fccb019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:33920/0 (socket says 172.21.15.40:33920) 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.947+0000 7fccb6200640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb010bfc0 0x7fccb019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.948+0000 7fccb4e00640 1 -- 172.21.15.40:0/4094298316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb0102b90 msgr2=0x7fccb019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.948+0000 7fccb4e00640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb0102b90 0x7fccb019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.948+0000 7fccb4e00640 1 -- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb010bfc0 msgr2=0x7fccb019ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:40.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.948+0000 7fccb4e00640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb010bfc0 0x7fccb019ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:40.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.948+0000 7fccb4e00640 1 -- 172.21.15.40:0/4094298316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb019f420 con 0x7fccb01034b0 2024-09-11T22:29:40.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.948+0000 7fccb5800640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb0102b90 0x7fccb019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:40.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.948+0000 7fccb4e00640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb01034b0 0x7fccb019a9b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00e9f0 tx=0x7fcc9c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:40.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.949+0000 7fccae000640 1 -- 172.21.15.40:0/4094298316 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00ccc0 con 0x7fccb01034b0 2024-09-11T22:29:40.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.949+0000 7fccae000640 1 -- 172.21.15.40:0/4094298316 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc9c00ce60 con 0x7fccb01034b0 2024-09-11T22:29:40.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.949+0000 7fccae000640 1 -- 172.21.15.40:0/4094298316 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c010690 con 0x7fccb01034b0 2024-09-11T22:29:40.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.949+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb019f710 con 0x7fccb01034b0 2024-09-11T22:29:40.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.949+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb01a6ff0 con 0x7fccb01034b0 2024-09-11T22:29:40.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.950+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb0102f70 con 0x7fccb01034b0 2024-09-11T22:29:40.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.952+0000 7fccae000640 1 -- 172.21.15.40:0/4094298316 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcc9c0046c0 con 0x7fccb01034b0 2024-09-11T22:29:40.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.953+0000 7fccae000640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcc980a2c90 0x7fcc980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:40.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.953+0000 7fccae000640 1 -- 172.21.15.40:0/4094298316 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7fcc9c0cf7e0 con 0x7fccb01034b0 2024-09-11T22:29:40.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.953+0000 7fccb5800640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcc980a2c90 0x7fcc980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:40.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.954+0000 7fccb5800640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcc980a2c90 0x7fcc980a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcca4000c00 tx=0x7fcca4031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:40.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:40.955+0000 7fccae000640 1 -- 172.21.15.40:0/4094298316 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc9c09c240 con 0x7fccb01034b0 2024-09-11T22:29:41.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.142+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccb01a72e0 con 0x7fccb01034b0 2024-09-11T22:29:41.143 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:40 smithi040 ceph-mon[30787]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T22:29:41.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.143+0000 7fccae000640 1 -- 172.21.15.40:0/4094298316 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24737 (secure 0 0 0) 0x7fcc9c09bb40 con 0x7fccb01034b0 2024-09-11T22:29:41.144 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:29:41.145 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":93,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:28:58.283874+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcc980a2c90 msgr2=0x7fcc980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcc980a2c90 0x7fcc980a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcca4000c00 tx=0x7fcca4031510 comp rx=0 tx=0).stop 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb01034b0 msgr2=0x7fccb019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb01034b0 0x7fccb019a9b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00e9f0 tx=0x7fcc9c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 shutdown_connections 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcc980a2c90 0x7fcc980a5150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccb010bfc0 0x7fccb019ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb01034b0 0x7fccb019a9b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 --2- 172.21.15.40:0/4094298316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb0102b90 0x7fccb019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.146+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 >> 172.21.15.40:0/4094298316 conn(0x7fccb00fc610 msgr2=0x7fccb00fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:41.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.147+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 shutdown_connections 2024-09-11T22:29:41.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:41.147+0000 7fccb6c00640 1 -- 172.21.15.40:0/4094298316 wait complete. 2024-09-11T22:29:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:40 smithi177 ceph-mon[35530]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T22:29:41.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:40 smithi146 ceph-mon[34996]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T22:29:41.958 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T22:29:41.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:29:42.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:41 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/4094298316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:42.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:41 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/4094298316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:42.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:41 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/4094298316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:42.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.909+0000 7f0e64800640 1 -- 172.21.15.40:0/3999853816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c112a30 msgr2=0x7f0e5c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.909+0000 7f0e64800640 1 --2- 172.21.15.40:0/3999853816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c112a30 0x7f0e5c114e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009ca0 tx=0x7f0e5802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.910+0000 7f0e64800640 1 -- 172.21.15.40:0/3999853816 shutdown_connections 2024-09-11T22:29:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.910+0000 7f0e64800640 1 --2- 172.21.15.40:0/3999853816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c112a30 0x7f0e5c114e20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.910+0000 7f0e64800640 1 --2- 172.21.15.40:0/3999853816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5c077040 0x7f0e5c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.910+0000 7f0e64800640 1 --2- 172.21.15.40:0/3999853816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5c076720 0x7f0e5c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.910+0000 7f0e64800640 1 -- 172.21.15.40:0/3999853816 >> 172.21.15.40:0/3999853816 conn(0x7f0e5c0ffa90 msgr2=0x7f0e5c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.910+0000 7f0e64800640 1 -- 172.21.15.40:0/3999853816 shutdown_connections 2024-09-11T22:29:42.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.910+0000 7f0e64800640 1 -- 172.21.15.40:0/3999853816 wait complete. 2024-09-11T22:29:42.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e64800640 1 Processor -- start 2024-09-11T22:29:42.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e64800640 1 -- start start 2024-09-11T22:29:42.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e64800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5c076720 0x7f0e5c1a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e64800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c077040 0x7f0e5c1a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e64800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5c112a30 0x7f0e5c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e64800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c1185d0 con 0x7f0e5c112a30 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e64800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c118450 con 0x7f0e5c076720 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e64800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c118750 con 0x7f0e5c077040 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e62800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5c112a30 0x7f0e5c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e61400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c077040 0x7f0e5c1a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e61400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c077040 0x7f0e5c1a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:45638/0 (socket says 172.21.15.40:45638) 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.911+0000 7f0e61400640 1 -- 172.21.15.40:0/701949214 learned_addr learned my addr 172.21.15.40:0/701949214 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e61e00640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5c076720 0x7f0e5c1a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e61400640 1 -- 172.21.15.40:0/701949214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5c076720 msgr2=0x7f0e5c1a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e61400640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5c076720 0x7f0e5c1a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e61400640 1 -- 172.21.15.40:0/701949214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5c112a30 msgr2=0x7f0e5c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:42.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e61400640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5c112a30 0x7f0e5c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e61400640 1 -- 172.21.15.40:0/701949214 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c19efd0 con 0x7f0e5c077040 2024-09-11T22:29:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e61e00640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5c076720 0x7f0e5c1a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e61400640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c077040 0x7f0e5c1a4c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00ea60 tx=0x7f0e4c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e56a00640 1 -- 172.21.15.40:0/701949214 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00cde0 con 0x7f0e5c077040 2024-09-11T22:29:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e56a00640 1 -- 172.21.15.40:0/701949214 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e4c0035f0 con 0x7f0e5c077040 2024-09-11T22:29:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.912+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5c19f2c0 con 0x7f0e5c077040 2024-09-11T22:29:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.913+0000 7f0e56a00640 1 -- 172.21.15.40:0/701949214 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c010670 con 0x7f0e5c077040 2024-09-11T22:29:42.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.913+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5c1ab5b0 con 0x7f0e5c077040 2024-09-11T22:29:42.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.914+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5c076b00 con 0x7f0e5c077040 2024-09-11T22:29:42.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.915+0000 7f0e56a00640 1 -- 172.21.15.40:0/701949214 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0e4c0037a0 con 0x7f0e5c077040 2024-09-11T22:29:42.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.917+0000 7f0e56a00640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0e440a2c90 0x7f0e440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:42.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.917+0000 7f0e56a00640 1 -- 172.21.15.40:0/701949214 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f0e4c0cf7c0 con 0x7f0e5c077040 2024-09-11T22:29:42.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.917+0000 7f0e61e00640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0e440a2c90 0x7f0e440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:42.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.918+0000 7f0e61e00640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0e440a2c90 0x7f0e440a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c19f9e0 tx=0x7f0e50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:42.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:42.919+0000 7f0e56a00640 1 -- 172.21.15.40:0/701949214 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e4c09c220 con 0x7f0e5c077040 2024-09-11T22:29:43.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.111+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e5c10dc20 con 0x7f0e5c077040 2024-09-11T22:29:43.112 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:42 smithi040 ceph-mon[30787]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-11T22:29:43.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.113+0000 7f0e56a00640 1 -- 172.21.15.40:0/701949214 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24737 (secure 0 0 0) 0x7f0e4c09bb20 con 0x7f0e5c077040 2024-09-11T22:29:43.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:29:43.114 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":93,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:28:58.283874+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.115+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0e440a2c90 msgr2=0x7f0e440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.115+0000 7f0e64800640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0e440a2c90 0x7f0e440a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c19f9e0 tx=0x7f0e50005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.115+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c077040 msgr2=0x7f0e5c1a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.115+0000 7f0e64800640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c077040 0x7f0e5c1a4c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00ea60 tx=0x7f0e4c00ef20 comp rx=0 tx=0).stop 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.116+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 shutdown_connections 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.116+0000 7f0e64800640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f0e440a2c90 0x7f0e440a5150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.116+0000 7f0e64800640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e5c112a30 0x7f0e5c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.116+0000 7f0e64800640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c077040 0x7f0e5c1a4c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.116+0000 7f0e64800640 1 --2- 172.21.15.40:0/701949214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5c076720 0x7f0e5c1a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:43.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.116+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 >> 172.21.15.40:0/701949214 conn(0x7f0e5c0ffa90 msgr2=0x7f0e5c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:43.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.116+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 shutdown_connections 2024-09-11T22:29:43.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:43.116+0000 7f0e64800640 1 -- 172.21.15.40:0/701949214 wait complete. 2024-09-11T22:29:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:42 smithi177 ceph-mon[35530]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-11T22:29:43.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:42 smithi146 ceph-mon[34996]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-11T22:29:43.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T22:29:43.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T22:29:43.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T22:29:43.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T22:29:43.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T22:29:43.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T22:29:43.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T22:29:43.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T22:29:43.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T22:29:43.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T22:29:43.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T22:29:43.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T22:29:44.056 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:43 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/701949214' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:44.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:43 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/701949214' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:44.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:43 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/701949214' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:29:44.925 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:44.944 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:44.957 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:44.980 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:44.980 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:44.980 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:45.006 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:45.081 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:45.090 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:44 smithi040 ceph-mon[30787]: pgmap v346: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-11T22:29:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:44 smithi177 ceph-mon[35530]: pgmap v346: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-11T22:29:45.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:44 smithi146 ceph-mon[34996]: pgmap v346: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-11T22:29:46.190 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:45 smithi040 ceph-mon[30787]: pgmap v347: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-11T22:29:46.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.200+0000 7f2f9d400640 1 -- 172.21.15.40:0/270216984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f98074620 msgr2=0x7f2f98074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.200+0000 7f2f9d400640 1 --2- 172.21.15.40:0/270216984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f98074620 0x7f2f98074a00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009900 tx=0x7f2f8802a480 comp rx=0 tx=0).stop 2024-09-11T22:29:46.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.200+0000 7f2f9d400640 1 -- 172.21.15.40:0/270216984 shutdown_connections 2024-09-11T22:29:46.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.200+0000 7f2f9d400640 1 --2- 172.21.15.40:0/270216984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9810e210 0x7f2f98110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.200+0000 7f2f9d400640 1 --2- 172.21.15.40:0/270216984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f98074f40 0x7f2f9810dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.200+0000 7f2f9d400640 1 --2- 172.21.15.40:0/270216984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f98074620 0x7f2f98074a00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.200+0000 7f2f9d400640 1 -- 172.21.15.40:0/270216984 >> 172.21.15.40:0/270216984 conn(0x7f2f980fd710 msgr2=0x7f2f980ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.200+0000 7f2f9d400640 1 -- 172.21.15.40:0/270216984 shutdown_connections 2024-09-11T22:29:46.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.200+0000 7f2f9d400640 1 -- 172.21.15.40:0/270216984 wait complete. 2024-09-11T22:29:46.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.201+0000 7f2f9d400640 1 Processor -- start 2024-09-11T22:29:46.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.201+0000 7f2f9d400640 1 -- start start 2024-09-11T22:29:46.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f9d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f98074620 0x7f2f9819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f9d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f98074f40 0x7f2f9819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f9d400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9810e210 0x7f2f9819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f9d400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f98113fd0 con 0x7f2f98074620 2024-09-11T22:29:46.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f9d400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f98113e50 con 0x7f2f98074f40 2024-09-11T22:29:46.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f9d400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f98114150 con 0x7f2f9810e210 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f97e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f98074620 0x7f2f9819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f97e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f98074620 0x7f2f9819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55620/0 (socket says 172.21.15.40:55620) 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f97e00640 1 -- 172.21.15.40:0/1555332655 learned_addr learned my addr 172.21.15.40:0/1555332655 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f97400640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f98074f40 0x7f2f9819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.202+0000 7f2f9ca00640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9810e210 0x7f2f9819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f97e00640 1 -- 172.21.15.40:0/1555332655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9810e210 msgr2=0x7f2f9819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f97e00640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9810e210 0x7f2f9819edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f97e00640 1 -- 172.21.15.40:0/1555332655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f98074f40 msgr2=0x7f2f9819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f97e00640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f98074f40 0x7f2f9819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f97e00640 1 -- 172.21.15.40:0/1555332655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9819f4b0 con 0x7f2f98074620 2024-09-11T22:29:46.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f97400640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f98074f40 0x7f2f9819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:46.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f97e00640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f98074620 0x7f2f9819a500 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2f88004770 tx=0x7f2f88003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f94c00640 1 -- 172.21.15.40:0/1555332655 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8803f070 con 0x7f2f98074620 2024-09-11T22:29:46.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f94c00640 1 -- 172.21.15.40:0/1555332655 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f88031ca0 con 0x7f2f98074620 2024-09-11T22:29:46.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f94c00640 1 -- 172.21.15.40:0/1555332655 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88035030 con 0x7f2f98074620 2024-09-11T22:29:46.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.203+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9819f740 con 0x7f2f98074620 2024-09-11T22:29:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.204+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9819fbd0 con 0x7f2f98074620 2024-09-11T22:29:46.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.205+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f98062900 con 0x7f2f98074620 2024-09-11T22:29:46.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.207+0000 7f2f94c00640 1 -- 172.21.15.40:0/1555332655 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2f88042070 con 0x7f2f98074620 2024-09-11T22:29:46.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.208+0000 7f2f94c00640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f7c0a2c90 0x7f2f7c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.208+0000 7f2f94c00640 1 -- 172.21.15.40:0/1555332655 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f2f880efff0 con 0x7f2f98074620 2024-09-11T22:29:46.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.208+0000 7f2f97400640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f7c0a2c90 0x7f2f7c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.208+0000 7f2f94c00640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] conn(0x7f2f7c0adde0 0x7f2f7c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.208+0000 7f2f94c00640 1 -- 172.21.15.40:0/1555332655 --> [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f88032e50 con 0x7f2f7c0adde0 2024-09-11T22:29:46.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.208+0000 7f2f94c00640 1 -- 172.21.15.40:0/1555332655 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f2f880f03a0 con 0x7f2f98074620 2024-09-11T22:29:46.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.209+0000 7f2f9ca00640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] conn(0x7f2f7c0adde0 0x7f2f7c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.209+0000 7f2f97400640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f7c0a2c90 0x7f2f7c0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f9810f620 tx=0x7f2f8400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.209+0000 7f2f9ca00640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] conn(0x7f2f7c0adde0 0x7f2f7c0b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.210+0000 7f2f94c00640 1 -- 172.21.15.40:0/1555332655 <== osd.3 v2:172.21.15.40:6810/3405850528 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f88032e50 con 0x7f2f7c0adde0 2024-09-11T22:29:46.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.225+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 --> [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f98062dd0 con 0x7f2f7c0adde0 2024-09-11T22:29:46.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.225+0000 7f2f94c00640 1 -- 172.21.15.40:0/1555332655 <== osd.3 v2:172.21.15.40:6810/3405850528 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2f98062dd0 con 0x7f2f7c0adde0 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] conn(0x7f2f7c0adde0 msgr2=0x7f2f7c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] conn(0x7f2f7c0adde0 0x7f2f7c0b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f7c0a2c90 msgr2=0x7f2f7c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f7c0a2c90 0x7f2f7c0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2f9810f620 tx=0x7f2f8400b390 comp rx=0 tx=0).stop 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f98074620 msgr2=0x7f2f9819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 --2- 172.21.15.40:0/1555332655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f98074620 0x7f2f9819a500 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2f88004770 tx=0x7f2f88003c10 comp rx=0 tx=0).stop 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9ca00640 1 -- 172.21.15.40:0/1555332655 reap_dead start 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 shutdown_connections 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 >> 172.21.15.40:0/1555332655 conn(0x7f2f980fd710 msgr2=0x7f2f980fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 shutdown_connections 2024-09-11T22:29:46.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.226+0000 7f2f9d400640 1 -- 172.21.15.40:0/1555332655 wait complete. 2024-09-11T22:29:46.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:45 smithi177 ceph-mon[35530]: pgmap v347: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-11T22:29:46.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.093+0000 7efd6fe00640 1 -- 172.21.15.40:0/3848169505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd70102370 msgr2=0x7efd7010e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.093+0000 7efd6fe00640 1 --2- 172.21.15.40:0/3848169505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd70102370 0x7efd7010e8a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efd68009cd0 tx=0x7efd6802a8f0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.093+0000 7efd6fe00640 1 -- 172.21.15.40:0/3848169505 shutdown_connections 2024-09-11T22:29:46.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.093+0000 7efd6fe00640 1 --2- 172.21.15.40:0/3848169505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd70102370 0x7efd7010e8a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.093+0000 7efd6fe00640 1 --2- 172.21.15.40:0/3848169505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd701019d0 0x7efd70101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.093+0000 7efd6fe00640 1 --2- 172.21.15.40:0/3848169505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd701079d0 0x7efd70107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.093+0000 7efd6fe00640 1 -- 172.21.15.40:0/3848169505 >> 172.21.15.40:0/3848169505 conn(0x7efd700fd710 msgr2=0x7efd700ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.094+0000 7efd6fe00640 1 -- 172.21.15.40:0/3848169505 shutdown_connections 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.094+0000 7efd6fe00640 1 -- 172.21.15.40:0/3848169505 wait complete. 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.095+0000 7efd6fe00640 1 Processor -- start 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.095+0000 7efd6fe00640 1 -- start start 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd701019d0 0x7efd701982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd70102370 0x7efd70198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd701079d0 0x7efd7019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6fe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efd70111e20 con 0x7efd701079d0 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd70111ca0 con 0x7efd70102370 2024-09-11T22:29:46.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6fe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd70111fa0 con 0x7efd701019d0 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd701079d0 0x7efd7019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd701019d0 0x7efd701982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd701079d0 0x7efd7019cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55598/0 (socket says 172.21.15.40:55598) 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6f400640 1 -- 172.21.15.40:0/3477554840 learned_addr learned my addr 172.21.15.40:0/3477554840 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.096+0000 7efd6e000640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd70102370 0x7efd70198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.097+0000 7efd6ea00640 1 -- 172.21.15.40:0/3477554840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd70102370 msgr2=0x7efd70198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.097+0000 7efd6ea00640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd70102370 0x7efd70198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.097+0000 7efd6ea00640 1 -- 172.21.15.40:0/3477554840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd701079d0 msgr2=0x7efd7019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.097+0000 7efd6ea00640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd701079d0 0x7efd7019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.097+0000 7efd6ea00640 1 -- 172.21.15.40:0/3477554840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7019d270 con 0x7efd701019d0 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.097+0000 7efd6ea00640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd701019d0 0x7efd701982c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efd6000e9f0 tx=0x7efd6000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.098+0000 7efd67400640 1 -- 172.21.15.40:0/3477554840 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6000cd80 con 0x7efd701019d0 2024-09-11T22:29:46.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.098+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7019d560 con 0x7efd701019d0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.098+0000 7efd67400640 1 -- 172.21.15.40:0/3477554840 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd600035f0 con 0x7efd701019d0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.098+0000 7efd67400640 1 -- 172.21.15.40:0/3477554840 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60010670 con 0x7efd701019d0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.098+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd701a4e40 con 0x7efd701019d0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.099+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd70062900 con 0x7efd701019d0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.101+0000 7efd67400640 1 -- 172.21.15.40:0/3477554840 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efd600037a0 con 0x7efd701019d0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.102+0000 7efd67400640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efd540a2c10 0x7efd540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.102+0000 7efd67400640 1 -- 172.21.15.40:0/3477554840 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7efd600cf910 con 0x7efd701019d0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.102+0000 7efd6e000640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efd540a2c10 0x7efd540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.102+0000 7efd67400640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] conn(0x7efd540add60 0x7efd540b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.102+0000 7efd67400640 1 -- 172.21.15.40:0/3477554840 --> [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd6001aec0 con 0x7efd540add60 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.102+0000 7efd67400640 1 -- 172.21.15.40:0/3477554840 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7efd600cfcc0 con 0x7efd701019d0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.103+0000 7efd6f400640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] conn(0x7efd540add60 0x7efd540b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.103+0000 7efd6e000640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efd540a2c10 0x7efd540a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd70106fd0 tx=0x7efd5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.103+0000 7efd6f400640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] conn(0x7efd540add60 0x7efd540b0200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:46.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.104+0000 7efd67400640 1 -- 172.21.15.40:0/3477554840 <== osd.8 v2:172.21.15.177:6816/323204474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd6001aec0 con 0x7efd540add60 2024-09-11T22:29:46.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.119+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 --> [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd70062d00 con 0x7efd540add60 2024-09-11T22:29:46.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.119+0000 7efd67400640 1 -- 172.21.15.40:0/3477554840 <== osd.8 v2:172.21.15.177:6816/323204474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efd70062d00 con 0x7efd540add60 2024-09-11T22:29:46.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 >> [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] conn(0x7efd540add60 msgr2=0x7efd540b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] conn(0x7efd540add60 0x7efd540b0200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efd540a2c10 msgr2=0x7efd540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efd540a2c10 0x7efd540a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd70106fd0 tx=0x7efd5c005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:46.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd701019d0 msgr2=0x7efd701982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:46.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 --2- 172.21.15.40:0/3477554840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd701019d0 0x7efd701982c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efd6000e9f0 tx=0x7efd6000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:46.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6f400640 1 -- 172.21.15.40:0/3477554840 reap_dead start 2024-09-11T22:29:46.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 shutdown_connections 2024-09-11T22:29:46.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 >> 172.21.15.40:0/3477554840 conn(0x7efd700fd710 msgr2=0x7efd700feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:46.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 shutdown_connections 2024-09-11T22:29:46.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:46.120+0000 7efd6fe00640 1 -- 172.21.15.40:0/3477554840 wait complete. 2024-09-11T22:29:46.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:45 smithi146 ceph-mon[34996]: pgmap v347: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-11T22:29:47.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.110+0000 7fd595000640 1 -- 172.21.15.40:0/1478902178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5901079c0 msgr2=0x7fd590107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:47.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.110+0000 7fd595000640 1 --2- 172.21.15.40:0/1478902178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5901079c0 0x7fd590107da0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd580009930 tx=0x7fd58002a420 comp rx=0 tx=0).stop 2024-09-11T22:29:47.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.110+0000 7fd595000640 1 -- 172.21.15.40:0/1478902178 shutdown_connections 2024-09-11T22:29:47.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.110+0000 7fd595000640 1 --2- 172.21.15.40:0/1478902178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd590102360 0x7fd59010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:47.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.110+0000 7fd595000640 1 --2- 172.21.15.40:0/1478902178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5901019c0 0x7fd590101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:47.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.110+0000 7fd595000640 1 --2- 172.21.15.40:0/1478902178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5901079c0 0x7fd590107da0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:47.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.110+0000 7fd595000640 1 -- 172.21.15.40:0/1478902178 >> 172.21.15.40:0/1478902178 conn(0x7fd5900fd740 msgr2=0x7fd5900ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:47.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.110+0000 7fd595000640 1 -- 172.21.15.40:0/1478902178 shutdown_connections 2024-09-11T22:29:47.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.110+0000 7fd595000640 1 -- 172.21.15.40:0/1478902178 wait complete. 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.112+0000 7fd595000640 1 Processor -- start 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.112+0000 7fd595000640 1 -- start start 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd595000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5901019c0 0x7fd59019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd595000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd590102360 0x7fd59019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd595000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5901079c0 0x7fd59019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd595000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd590111dd0 con 0x7fd5901079c0 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd595000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd590111c50 con 0x7fd5901019c0 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd595000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd590111f50 con 0x7fd590102360 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd58f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5901019c0 0x7fd59019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd58fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5901079c0 0x7fd59019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:47.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd58f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5901019c0 0x7fd59019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:33224/0 (socket says 172.21.15.40:33224) 2024-09-11T22:29:47.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd58ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd590102360 0x7fd59019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:47.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.113+0000 7fd58f400640 1 -- 172.21.15.40:0/2033712238 learned_addr learned my addr 172.21.15.40:0/2033712238 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:47.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.114+0000 7fd58ea00640 1 -- 172.21.15.40:0/2033712238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5901019c0 msgr2=0x7fd59019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.114+0000 7fd58ea00640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5901019c0 0x7fd59019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.114+0000 7fd58ea00640 1 -- 172.21.15.40:0/2033712238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5901079c0 msgr2=0x7fd59019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.114+0000 7fd58ea00640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5901079c0 0x7fd59019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.114+0000 7fd58ea00640 1 -- 172.21.15.40:0/2033712238 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59019f460 con 0x7fd590102360 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.114+0000 7fd58fe00640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5901079c0 0x7fd59019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.114+0000 7fd58ea00640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd590102360 0x7fd59019a9f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005fd0 tx=0x7fd57c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.114+0000 7fd587e00640 1 -- 172.21.15.40:0/2033712238 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c009c30 con 0x7fd590102360 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.115+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59019f750 con 0x7fd590102360 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.115+0000 7fd587e00640 1 -- 172.21.15.40:0/2033712238 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c009dd0 con 0x7fd590102360 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.115+0000 7fd587e00640 1 -- 172.21.15.40:0/2033712238 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c010460 con 0x7fd590102360 2024-09-11T22:29:47.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.115+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5901a7030 con 0x7fd590102360 2024-09-11T22:29:47.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.116+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5900fe8d0 con 0x7fd590102360 2024-09-11T22:29:47.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.118+0000 7fd587e00640 1 -- 172.21.15.40:0/2033712238 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd57c003ef0 con 0x7fd590102360 2024-09-11T22:29:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.119+0000 7fd587e00640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd5740a2c10 0x7fd5740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.120+0000 7fd587e00640 1 -- 172.21.15.40:0/2033712238 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7fd57c0cf080 con 0x7fd590102360 2024-09-11T22:29:47.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.120+0000 7fd58f400640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd5740a2c10 0x7fd5740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:47.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.120+0000 7fd587e00640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] conn(0x7fd5740add60 0x7fd5740b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:47.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.120+0000 7fd587e00640 1 -- 172.21.15.40:0/2033712238 --> [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5740b08d0 con 0x7fd5740add60 2024-09-11T22:29:47.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.120+0000 7fd587e00640 1 -- 172.21.15.40:0/2033712238 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fd57c0d6050 con 0x7fd590102360 2024-09-11T22:29:47.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.120+0000 7fd58fe00640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] conn(0x7fd5740add60 0x7fd5740b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:47.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.121+0000 7fd58f400640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd5740a2c10 0x7fd5740a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5800096c0 tx=0x7fd580005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.121+0000 7fd58fe00640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] conn(0x7fd5740add60 0x7fd5740b0200 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:47.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.122+0000 7fd587e00640 1 -- 172.21.15.40:0/2033712238 <== osd.2 v2:172.21.15.177:6800/3950599839 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5740b08d0 con 0x7fd5740add60 2024-09-11T22:29:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.136+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 --> [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd590103100 con 0x7fd5740add60 2024-09-11T22:29:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.137+0000 7fd587e00640 1 -- 172.21.15.40:0/2033712238 <== osd.2 v2:172.21.15.177:6800/3950599839 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd590103100 con 0x7fd5740add60 2024-09-11T22:29:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.137+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 >> [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] conn(0x7fd5740add60 msgr2=0x7fd5740b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.137+0000 7fd595000640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] conn(0x7fd5740add60 0x7fd5740b0200 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.137+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd5740a2c10 msgr2=0x7fd5740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.137+0000 7fd595000640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd5740a2c10 0x7fd5740a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd5800096c0 tx=0x7fd580005b50 comp rx=0 tx=0).stop 2024-09-11T22:29:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.137+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd590102360 msgr2=0x7fd59019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.137+0000 7fd595000640 1 --2- 172.21.15.40:0/2033712238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd590102360 0x7fd59019a9f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005fd0 tx=0x7fd57c00dde0 comp rx=0 tx=0).stop 2024-09-11T22:29:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.138+0000 7fd58fe00640 1 -- 172.21.15.40:0/2033712238 reap_dead start 2024-09-11T22:29:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.138+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 shutdown_connections 2024-09-11T22:29:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.138+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 >> 172.21.15.40:0/2033712238 conn(0x7fd5900fd740 msgr2=0x7fd5900fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.138+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 shutdown_connections 2024-09-11T22:29:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:47.138+0000 7fd595000640 1 -- 172.21.15.40:0/2033712238 wait complete. 2024-09-11T22:29:47.581 INFO:teuthology.orchestra.run.smithi040.stdout:244813135919 2024-09-11T22:29:47.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T22:29:48.090 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:48 smithi040 ceph-mon[30787]: pgmap v348: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.202+0000 7efc3e000640 1 -- 172.21.15.40:0/2282711935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc38101de0 msgr2=0x7efc381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.202+0000 7efc3e000640 1 --2- 172.21.15.40:0/2282711935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc38101de0 0x7efc381021c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efc28009900 tx=0x7efc2802a410 comp rx=0 tx=0).stop 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.203+0000 7efc3e000640 1 -- 172.21.15.40:0/2282711935 shutdown_connections 2024-09-11T22:29:48.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.203+0000 7efc3e000640 1 --2- 172.21.15.40:0/2282711935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc38106f10 0x7efc3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.203+0000 7efc3e000640 1 --2- 172.21.15.40:0/2282711935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc38102790 0x7efc381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.203+0000 7efc3e000640 1 --2- 172.21.15.40:0/2282711935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc38101de0 0x7efc381021c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.203+0000 7efc3e000640 1 -- 172.21.15.40:0/2282711935 >> 172.21.15.40:0/2282711935 conn(0x7efc380fd8c0 msgr2=0x7efc380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.203+0000 7efc3e000640 1 -- 172.21.15.40:0/2282711935 shutdown_connections 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.203+0000 7efc3e000640 1 -- 172.21.15.40:0/2282711935 wait complete. 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc3e000640 1 Processor -- start 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc3e000640 1 -- start start 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc3e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc38101de0 0x7efc3819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc3e000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc38102790 0x7efc3819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc3e000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc38106f10 0x7efc3819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc3e000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efc38111f30 con 0x7efc38102790 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc3e000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efc38111db0 con 0x7efc38106f10 2024-09-11T22:29:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc3e000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efc381120b0 con 0x7efc38101de0 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc38102790 0x7efc3819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc38102790 0x7efc3819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55656/0 (socket says 172.21.15.40:55656) 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc2fe00640 1 -- 172.21.15.40:0/3988535946 learned_addr learned my addr 172.21.15.40:0/3988535946 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.204+0000 7efc37400640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc38101de0 0x7efc3819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc37e00640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc38106f10 0x7efc3819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc2fe00640 1 -- 172.21.15.40:0/3988535946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc38101de0 msgr2=0x7efc3819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc2fe00640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc38101de0 0x7efc3819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc2fe00640 1 -- 172.21.15.40:0/3988535946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc38106f10 msgr2=0x7efc3819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc2fe00640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc38106f10 0x7efc3819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc2fe00640 1 -- 172.21.15.40:0/3988535946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3819f620 con 0x7efc38102790 2024-09-11T22:29:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc37e00640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc38106f10 0x7efc3819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc2fe00640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc38102790 0x7efc3819abb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc2000d950 tx=0x7efc2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc34c00640 1 -- 172.21.15.40:0/3988535946 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20017030 con 0x7efc38102790 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3819f910 con 0x7efc38102790 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc34c00640 1 -- 172.21.15.40:0/3988535946 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc20004020 con 0x7efc38102790 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.205+0000 7efc34c00640 1 -- 172.21.15.40:0/3988535946 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc200047a0 con 0x7efc38102790 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.206+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc381a71f0 con 0x7efc38102790 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.206+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc38075780 con 0x7efc38102790 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.208+0000 7efc34c00640 1 -- 172.21.15.40:0/3988535946 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efc200041d0 con 0x7efc38102790 2024-09-11T22:29:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.210+0000 7efc34c00640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efc1c0a2c10 0x7efc1c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.210+0000 7efc34c00640 1 -- 172.21.15.40:0/3988535946 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7efc200cf630 con 0x7efc38102790 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.210+0000 7efc37400640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efc1c0a2c10 0x7efc1c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.210+0000 7efc34c00640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] conn(0x7efc1c0add60 0x7efc1c0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.210+0000 7efc34c00640 1 -- 172.21.15.40:0/3988535946 --> [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc1c0b08d0 con 0x7efc1c0add60 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.210+0000 7efc34c00640 1 -- 172.21.15.40:0/3988535946 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7efc200cf9e0 con 0x7efc38102790 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.211+0000 7efc37e00640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] conn(0x7efc1c0add60 0x7efc1c0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.211+0000 7efc37400640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efc1c0a2c10 0x7efc1c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc28009230 tx=0x7efc280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.211+0000 7efc37e00640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] conn(0x7efc1c0add60 0x7efc1c0b0200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.212+0000 7efc34c00640 1 -- 172.21.15.40:0/3988535946 <== osd.1 v2:172.21.15.146:6800/2916155681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc1c0b08d0 con 0x7efc1c0add60 2024-09-11T22:29:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.226+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 --> [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efc381032c0 con 0x7efc1c0add60 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.227+0000 7efc34c00640 1 -- 172.21.15.40:0/3988535946 <== osd.1 v2:172.21.15.146:6800/2916155681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efc381032c0 con 0x7efc1c0add60 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.227+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 >> [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] conn(0x7efc1c0add60 msgr2=0x7efc1c0b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc3e000640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] conn(0x7efc1c0add60 0x7efc1c0b0200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efc1c0a2c10 msgr2=0x7efc1c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc3e000640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efc1c0a2c10 0x7efc1c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc28009230 tx=0x7efc280058d0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc38102790 msgr2=0x7efc3819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc3e000640 1 --2- 172.21.15.40:0/3988535946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc38102790 0x7efc3819abb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc2000d950 tx=0x7efc2000de10 comp rx=0 tx=0).stop 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc37e00640 1 -- 172.21.15.40:0/3988535946 reap_dead start 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 shutdown_connections 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 >> 172.21.15.40:0/3988535946 conn(0x7efc380fd8c0 msgr2=0x7efc380febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 shutdown_connections 2024-09-11T22:29:48.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:48.228+0000 7efc3e000640 1 -- 172.21.15.40:0/3988535946 wait complete. 2024-09-11T22:29:48.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:48 smithi146 ceph-mon[34996]: pgmap v348: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T22:29:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.816+0000 7f76fe400640 1 -- 172.21.15.40:0/3010121294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f8104010 msgr2=0x7f76f81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.816+0000 7f76fe400640 1 --2- 172.21.15.40:0/3010121294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f8104010 0x7f76f81043f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009900 tx=0x7f76e802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.816+0000 7f76fe400640 1 -- 172.21.15.40:0/3010121294 shutdown_connections 2024-09-11T22:29:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.816+0000 7f76fe400640 1 --2- 172.21.15.40:0/3010121294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76f8109140 0x7f76f8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.816+0000 7f76fe400640 1 --2- 172.21.15.40:0/3010121294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f81049c0 0x7f76f8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.816+0000 7f76fe400640 1 --2- 172.21.15.40:0/3010121294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f8104010 0x7f76f81043f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.816+0000 7f76fe400640 1 -- 172.21.15.40:0/3010121294 >> 172.21.15.40:0/3010121294 conn(0x7f76f80ffa50 msgr2=0x7f76f8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.816+0000 7f76fe400640 1 -- 172.21.15.40:0/3010121294 shutdown_connections 2024-09-11T22:29:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.816+0000 7f76fe400640 1 -- 172.21.15.40:0/3010121294 wait complete. 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.817+0000 7f76fe400640 1 Processor -- start 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.817+0000 7f76fe400640 1 -- start start 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76fe400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76f8104010 0x7f76f819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76fe400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f81049c0 0x7f76f819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76fe400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f8109140 0x7f76f819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76fe400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f76f8114160 con 0x7f76f8104010 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76fe400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f76f8113fe0 con 0x7f76f81049c0 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76fe400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81142e0 con 0x7f76f8109140 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76f7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76f8104010 0x7f76f819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76f7400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76f8104010 0x7f76f819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55582/0 (socket says 172.21.15.40:55582) 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76f7400640 1 -- 172.21.15.40:0/1332569081 learned_addr learned my addr 172.21.15.40:0/1332569081 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:48.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76efe00640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f81049c0 0x7f76f819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76f7e00640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f8109140 0x7f76f819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76efe00640 1 -- 172.21.15.40:0/1332569081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f8109140 msgr2=0x7f76f819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76efe00640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f8109140 0x7f76f819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76efe00640 1 -- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76f8104010 msgr2=0x7f76f819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76efe00640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76f8104010 0x7f76f819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76efe00640 1 -- 172.21.15.40:0/1332569081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f819f610 con 0x7f76f81049c0 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.818+0000 7f76f7400640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76f8104010 0x7f76f819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.819+0000 7f76efe00640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f81049c0 0x7f76f819aba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f76e000e9f0 tx=0x7f76e000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.819+0000 7f76f4c00640 1 -- 172.21.15.40:0/1332569081 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e000ccc0 con 0x7f76f81049c0 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.819+0000 7f76f4c00640 1 -- 172.21.15.40:0/1332569081 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e0005020 con 0x7f76f81049c0 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.819+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f819f900 con 0x7f76f81049c0 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.819+0000 7f76f4c00640 1 -- 172.21.15.40:0/1332569081 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0004a00 con 0x7f76f81049c0 2024-09-11T22:29:48.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.819+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f81a71e0 con 0x7f76f81049c0 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.820+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76f8062980 con 0x7f76f81049c0 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.822+0000 7f76f4c00640 1 -- 172.21.15.40:0/1332569081 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f76e00051d0 con 0x7f76f81049c0 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.824+0000 7f76f4c00640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f76dc0a2c90 0x7f76dc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.824+0000 7f76f4c00640 1 -- 172.21.15.40:0/1332569081 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f76e00cf730 con 0x7f76f81049c0 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.824+0000 7f76f7400640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f76dc0a2c90 0x7f76dc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.824+0000 7f76f4c00640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] conn(0x7f76dc0adde0 0x7f76dc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.824+0000 7f76f4c00640 1 -- 172.21.15.40:0/1332569081 --> [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76dc0b0950 con 0x7f76dc0adde0 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.824+0000 7f76f4c00640 1 -- 172.21.15.40:0/1332569081 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f76e00cfae0 con 0x7f76f81049c0 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.824+0000 7f76f7e00640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] conn(0x7f76dc0adde0 0x7f76dc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.825+0000 7f76f7400640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f76dc0a2c90 0x7f76dc0a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76e80096c0 tx=0x7f76e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.825+0000 7f76f7e00640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] conn(0x7f76dc0adde0 0x7f76dc0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:48.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.826+0000 7f76f4c00640 1 -- 172.21.15.40:0/1332569081 <== osd.6 v2:172.21.15.40:6818/3328210363 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76dc0b0950 con 0x7f76dc0adde0 2024-09-11T22:29:48.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.840+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 --> [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f76f8062e00 con 0x7f76dc0adde0 2024-09-11T22:29:48.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76f4c00640 1 -- 172.21.15.40:0/1332569081 <== osd.6 v2:172.21.15.40:6818/3328210363 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f76f8062e00 con 0x7f76dc0adde0 2024-09-11T22:29:48.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] conn(0x7f76dc0adde0 msgr2=0x7f76dc0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76fe400640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] conn(0x7f76dc0adde0 0x7f76dc0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f76dc0a2c90 msgr2=0x7f76dc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76fe400640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f76dc0a2c90 0x7f76dc0a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76e80096c0 tx=0x7f76e8005a20 comp rx=0 tx=0).stop 2024-09-11T22:29:48.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f81049c0 msgr2=0x7f76f819aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:48.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76fe400640 1 --2- 172.21.15.40:0/1332569081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76f81049c0 0x7f76f819aba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f76e000e9f0 tx=0x7f76e000edf0 comp rx=0 tx=0).stop 2024-09-11T22:29:48.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76f7e00640 1 -- 172.21.15.40:0/1332569081 reap_dead start 2024-09-11T22:29:48.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 shutdown_connections 2024-09-11T22:29:48.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.841+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 >> 172.21.15.40:0/1332569081 conn(0x7f76f80ffa50 msgr2=0x7f76f8100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:48.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.842+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 shutdown_connections 2024-09-11T22:29:48.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:45.842+0000 7f76fe400640 1 -- 172.21.15.40:0/1332569081 wait complete. 2024-09-11T22:29:48.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:48 smithi177 ceph-mon[35530]: pgmap v348: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T22:29:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:48.946 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:50.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:50 smithi146 ceph-mon[34996]: pgmap v349: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T22:29:50.349 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:50 smithi040 ceph-mon[30787]: pgmap v349: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T22:29:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:50 smithi177 ceph-mon[35530]: pgmap v349: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.348+0000 7f44bd000640 1 -- 172.21.15.40:0/3770457663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b8104010 msgr2=0x7f44b81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.348+0000 7f44bd000640 1 --2- 172.21.15.40:0/3770457663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b8104010 0x7f44b81043f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009900 tx=0x7f44a802a410 comp rx=0 tx=0).stop 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.348+0000 7f44bd000640 1 -- 172.21.15.40:0/3770457663 shutdown_connections 2024-09-11T22:29:50.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.348+0000 7f44bd000640 1 --2- 172.21.15.40:0/3770457663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b8109140 0x7f44b8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.348+0000 7f44bd000640 1 --2- 172.21.15.40:0/3770457663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b81049c0 0x7f44b8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.348+0000 7f44bd000640 1 --2- 172.21.15.40:0/3770457663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b8104010 0x7f44b81043f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.348+0000 7f44bd000640 1 -- 172.21.15.40:0/3770457663 >> 172.21.15.40:0/3770457663 conn(0x7f44b80ffa50 msgr2=0x7f44b8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.348+0000 7f44bd000640 1 -- 172.21.15.40:0/3770457663 shutdown_connections 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.348+0000 7f44bd000640 1 -- 172.21.15.40:0/3770457663 wait complete. 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.349+0000 7f44bd000640 1 Processor -- start 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.349+0000 7f44bd000640 1 -- start start 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44bd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b8104010 0x7f44b819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44bd000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b81049c0 0x7f44b819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44bd000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b8109140 0x7f44b819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44bd000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44b8114190 con 0x7f44b81049c0 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44bd000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f44b8114010 con 0x7f44b8104010 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44bd000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f44b8114310 con 0x7f44b8109140 2024-09-11T22:29:50.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44b5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b81049c0 0x7f44b819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44b5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b8104010 0x7f44b819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44b5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b8104010 0x7f44b819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:33286/0 (socket says 172.21.15.40:33286) 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44b5e00640 1 -- 172.21.15.40:0/4165618312 learned_addr learned my addr 172.21.15.40:0/4165618312 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44b5400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b81049c0 0x7f44b819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55688/0 (socket says 172.21.15.40:55688) 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.350+0000 7f44b6800640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b8109140 0x7f44b819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44b5400640 1 -- 172.21.15.40:0/4165618312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b8109140 msgr2=0x7f44b819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44b5400640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b8109140 0x7f44b819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44b5400640 1 -- 172.21.15.40:0/4165618312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b8104010 msgr2=0x7f44b819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44b5400640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44b8104010 0x7f44b819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44b5400640 1 -- 172.21.15.40:0/4165618312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b819f620 con 0x7f44b81049c0 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44b5400640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b81049c0 0x7f44b819abb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f44a400e9f0 tx=0x7f44a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44aea00640 1 -- 172.21.15.40:0/4165618312 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a400ccc0 con 0x7f44b81049c0 2024-09-11T22:29:50.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44aea00640 1 -- 172.21.15.40:0/4165618312 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44a4010910 con 0x7f44b81049c0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b819f910 con 0x7f44b81049c0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44aea00640 1 -- 172.21.15.40:0/4165618312 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4018960 con 0x7f44b81049c0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.351+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b81a71f0 con 0x7f44b81049c0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.352+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44b8062980 con 0x7f44b81049c0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.354+0000 7f44aea00640 1 -- 172.21.15.40:0/4165618312 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f44a4010ac0 con 0x7f44b81049c0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.356+0000 7f44aea00640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f449c0a2c90 0x7f449c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.356+0000 7f44aea00640 1 -- 172.21.15.40:0/4165618312 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f44a40d0090 con 0x7f44b81049c0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.356+0000 7f44b5e00640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f449c0a2c90 0x7f449c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.356+0000 7f44aea00640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] conn(0x7f449c0adde0 0x7f449c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.356+0000 7f44aea00640 1 -- 172.21.15.40:0/4165618312 --> [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44a4028ea0 con 0x7f449c0adde0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.356+0000 7f44aea00640 1 -- 172.21.15.40:0/4165618312 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f44a40d0440 con 0x7f44b81049c0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.357+0000 7f44b5e00640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f449c0a2c90 0x7f449c0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f44a80096c0 tx=0x7f44a80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.357+0000 7f44b6800640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] conn(0x7f449c0adde0 0x7f449c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.358+0000 7f44b6800640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] conn(0x7f449c0adde0 0x7f449c0b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.358+0000 7f44aea00640 1 -- 172.21.15.40:0/4165618312 <== osd.4 v2:172.21.15.146:6808/1955239185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f44a4028ea0 con 0x7f449c0adde0 2024-09-11T22:29:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.373+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 --> [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44b8062d80 con 0x7f449c0adde0 2024-09-11T22:29:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.373+0000 7f44aea00640 1 -- 172.21.15.40:0/4165618312 <== osd.4 v2:172.21.15.146:6808/1955239185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f44b8062d80 con 0x7f449c0adde0 2024-09-11T22:29:50.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 >> [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] conn(0x7f449c0adde0 msgr2=0x7f449c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] conn(0x7f449c0adde0 0x7f449c0b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f449c0a2c90 msgr2=0x7f449c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f449c0a2c90 0x7f449c0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f44a80096c0 tx=0x7f44a80046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b81049c0 msgr2=0x7f44b819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 --2- 172.21.15.40:0/4165618312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44b81049c0 0x7f44b819abb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f44a400e9f0 tx=0x7f44a400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44b6800640 1 -- 172.21.15.40:0/4165618312 reap_dead start 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 shutdown_connections 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 >> 172.21.15.40:0/4165618312 conn(0x7f44b80ffa50 msgr2=0x7f44b8100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 shutdown_connections 2024-09-11T22:29:50.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:50.374+0000 7f44bd000640 1 -- 172.21.15.40:0/4165618312 wait complete. 2024-09-11T22:29:51.425 INFO:teuthology.orchestra.run.smithi040.stdout:55834574934 2024-09-11T22:29:51.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T22:29:51.711 INFO:teuthology.orchestra.run.smithi040.stdout:77309411407 2024-09-11T22:29:51.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T22:29:51.880 INFO:teuthology.orchestra.run.smithi040.stdout:107374182475 2024-09-11T22:29:51.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T22:29:52.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:52 smithi040 ceph-mon[30787]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T22:29:52.218 INFO:teuthology.orchestra.run.smithi040.stdout:193273528378 2024-09-11T22:29:52.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T22:29:52.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:52 smithi146 ceph-mon[34996]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T22:29:52.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:52 smithi177 ceph-mon[35530]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T22:29:53.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.255+0000 7fe3dec00640 1 -- 172.21.15.40:0/2585494961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81049b0 msgr2=0x7fe3d8108a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.255+0000 7fe3dec00640 1 --2- 172.21.15.40:0/2585494961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81049b0 0x7fe3d8108a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009860 tx=0x7fe3c402a340 comp rx=0 tx=0).stop 2024-09-11T22:29:53.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.256+0000 7fe3dec00640 1 -- 172.21.15.40:0/2585494961 shutdown_connections 2024-09-11T22:29:53.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.256+0000 7fe3dec00640 1 --2- 172.21.15.40:0/2585494961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3d8109130 0x7fe3d8110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.256+0000 7fe3dec00640 1 --2- 172.21.15.40:0/2585494961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81049b0 0x7fe3d8108a00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.256+0000 7fe3dec00640 1 --2- 172.21.15.40:0/2585494961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d8104000 0x7fe3d81043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.256+0000 7fe3dec00640 1 -- 172.21.15.40:0/2585494961 >> 172.21.15.40:0/2585494961 conn(0x7fe3d80ffa20 msgr2=0x7fe3d8101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.256+0000 7fe3dec00640 1 -- 172.21.15.40:0/2585494961 shutdown_connections 2024-09-11T22:29:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.256+0000 7fe3dec00640 1 -- 172.21.15.40:0/2585494961 wait complete. 2024-09-11T22:29:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.257+0000 7fe3dec00640 1 Processor -- start 2024-09-11T22:29:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.257+0000 7fe3dec00640 1 -- start start 2024-09-11T22:29:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.257+0000 7fe3dec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3d8104000 0x7fe3d819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.257+0000 7fe3dec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81049b0 0x7fe3d819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.257+0000 7fe3dec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d8109130 0x7fe3d819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.257+0000 7fe3dec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d8114150 con 0x7fe3d8109130 2024-09-11T22:29:53.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.257+0000 7fe3dec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d8113fd0 con 0x7fe3d81049b0 2024-09-11T22:29:53.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.257+0000 7fe3dec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d81142d0 con 0x7fe3d8104000 2024-09-11T22:29:53.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3dcc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d8109130 0x7fe3d819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3dcc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d8109130 0x7fe3d819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50112/0 (socket says 172.21.15.40:50112) 2024-09-11T22:29:53.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3dcc00640 1 -- 172.21.15.40:0/550427715 learned_addr learned my addr 172.21.15.40:0/550427715 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3d7e00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3d8104000 0x7fe3d819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3d7400640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81049b0 0x7fe3d819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3dcc00640 1 -- 172.21.15.40:0/550427715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3d8104000 msgr2=0x7fe3d819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3dcc00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3d8104000 0x7fe3d819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3dcc00640 1 -- 172.21.15.40:0/550427715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81049b0 msgr2=0x7fe3d819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3dcc00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81049b0 0x7fe3d819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.258+0000 7fe3dcc00640 1 -- 172.21.15.40:0/550427715 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d819f610 con 0x7fe3d8109130 2024-09-11T22:29:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.259+0000 7fe3dcc00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d8109130 0x7fe3d819ef30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000eb10 tx=0x7fe3d000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.259+0000 7fe3d4c00640 1 -- 172.21.15.40:0/550427715 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0004b20 con 0x7fe3d8109130 2024-09-11T22:29:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.259+0000 7fe3d4c00640 1 -- 172.21.15.40:0/550427715 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3d0004cc0 con 0x7fe3d8109130 2024-09-11T22:29:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.259+0000 7fe3d4c00640 1 -- 172.21.15.40:0/550427715 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0010760 con 0x7fe3d8109130 2024-09-11T22:29:53.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.259+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d819f900 con 0x7fe3d8109130 2024-09-11T22:29:53.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.259+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d81a71e0 con 0x7fe3d8109130 2024-09-11T22:29:53.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.260+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe3d8062980 con 0x7fe3d8109130 2024-09-11T22:29:53.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.262+0000 7fe3d4c00640 1 -- 172.21.15.40:0/550427715 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe3d0005000 con 0x7fe3d8109130 2024-09-11T22:29:53.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.263+0000 7fe3d4c00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe3bc0a2c90 0x7fe3bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.264+0000 7fe3d4c00640 1 -- 172.21.15.40:0/550427715 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7fe3d00d04a0 con 0x7fe3d8109130 2024-09-11T22:29:53.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.264+0000 7fe3d7e00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe3bc0a2c90 0x7fe3bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.264+0000 7fe3d4c00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] conn(0x7fe3bc0adde0 0x7fe3bc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.264+0000 7fe3d4c00640 1 -- 172.21.15.40:0/550427715 --> [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3d001aec0 con 0x7fe3bc0adde0 2024-09-11T22:29:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.264+0000 7fe3d4c00640 1 -- 172.21.15.40:0/550427715 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fe3d00d0850 con 0x7fe3d8109130 2024-09-11T22:29:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.264+0000 7fe3d7400640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] conn(0x7fe3bc0adde0 0x7fe3bc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.264+0000 7fe3d7e00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe3bc0a2c90 0x7fe3bc0a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009530 tx=0x7fe3c8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.265+0000 7fe3d7400640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] conn(0x7fe3bc0adde0 0x7fe3bc0b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.266+0000 7fe3d4c00640 1 -- 172.21.15.40:0/550427715 <== osd.7 v2:172.21.15.146:6816/3017121713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3d001aec0 con 0x7fe3bc0adde0 2024-09-11T22:29:53.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.281+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 --> [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe3d8062e50 con 0x7fe3bc0adde0 2024-09-11T22:29:53.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3d4c00640 1 -- 172.21.15.40:0/550427715 <== osd.7 v2:172.21.15.146:6816/3017121713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe3d8062e50 con 0x7fe3bc0adde0 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 >> [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] conn(0x7fe3bc0adde0 msgr2=0x7fe3bc0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3dec00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] conn(0x7fe3bc0adde0 0x7fe3bc0b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe3bc0a2c90 msgr2=0x7fe3bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3dec00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fe3bc0a2c90 0x7fe3bc0a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009530 tx=0x7fe3c8009260 comp rx=0 tx=0).stop 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d8109130 msgr2=0x7fe3d819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3dec00640 1 --2- 172.21.15.40:0/550427715 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d8109130 0x7fe3d819ef30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000eb10 tx=0x7fe3d000c2d0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3dcc00640 1 -- 172.21.15.40:0/550427715 reap_dead start 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 shutdown_connections 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.282+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 >> 172.21.15.40:0/550427715 conn(0x7fe3d80ffa20 msgr2=0x7fe3d8100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.283+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 shutdown_connections 2024-09-11T22:29:53.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.283+0000 7fe3dec00640 1 -- 172.21.15.40:0/550427715 wait complete. 2024-09-11T22:29:53.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.710+0000 7f2245400640 1 -- 172.21.15.40:0/1550195095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2240102360 msgr2=0x7f224010e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.710+0000 7f2245400640 1 --2- 172.21.15.40:0/1550195095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2240102360 0x7f224010e890 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2238009cd0 tx=0x7f223802a8e0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.710+0000 7f2245400640 1 -- 172.21.15.40:0/1550195095 shutdown_connections 2024-09-11T22:29:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.710+0000 7f2245400640 1 --2- 172.21.15.40:0/1550195095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2240102360 0x7f224010e890 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.710+0000 7f2245400640 1 --2- 172.21.15.40:0/1550195095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22401019c0 0x7f2240101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.710+0000 7f2245400640 1 --2- 172.21.15.40:0/1550195095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22401079c0 0x7f2240107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.710+0000 7f2245400640 1 -- 172.21.15.40:0/1550195095 >> 172.21.15.40:0/1550195095 conn(0x7f22400fd740 msgr2=0x7f22400ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.711+0000 7f2245400640 1 -- 172.21.15.40:0/1550195095 shutdown_connections 2024-09-11T22:29:53.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.711+0000 7f2245400640 1 -- 172.21.15.40:0/1550195095 wait complete. 2024-09-11T22:29:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.711+0000 7f2245400640 1 Processor -- start 2024-09-11T22:29:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f2245400640 1 -- start start 2024-09-11T22:29:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f2245400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22401019c0 0x7f22400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f2245400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240102360 0x7f2240074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f2245400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22401079c0 0x7f2240074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f2245400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2240111e10 con 0x7f22401079c0 2024-09-11T22:29:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f2245400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2240111c90 con 0x7f22401019c0 2024-09-11T22:29:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f2245400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2240111f90 con 0x7f2240102360 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f223f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240102360 0x7f2240074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f2244a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22401079c0 0x7f2240074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f223f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240102360 0x7f2240074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:45742/0 (socket says 172.21.15.40:45742) 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f223f400640 1 -- 172.21.15.40:0/1320151638 learned_addr learned my addr 172.21.15.40:0/1320151638 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.712+0000 7f223fe00640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22401019c0 0x7f22400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f223f400640 1 -- 172.21.15.40:0/1320151638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22401019c0 msgr2=0x7f22400744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f223f400640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22401019c0 0x7f22400744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f223f400640 1 -- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22401079c0 msgr2=0x7f2240074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f223f400640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22401079c0 0x7f2240074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f223f400640 1 -- 172.21.15.40:0/1320151638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22401a6750 con 0x7f2240102360 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f223f400640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240102360 0x7f2240074a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f222c00e9f0 tx=0x7f222c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f223cc00640 1 -- 172.21.15.40:0/1320151638 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c00cd80 con 0x7f2240102360 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f223cc00640 1 -- 172.21.15.40:0/1320151638 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f222c005500 con 0x7f2240102360 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22401a6a40 con 0x7f2240102360 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.713+0000 7f223cc00640 1 -- 172.21.15.40:0/1320151638 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c010690 con 0x7f2240102360 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.714+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22401a6f30 con 0x7f2240102360 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.714+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22400fe860 con 0x7f2240102360 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.717+0000 7f223cc00640 1 -- 172.21.15.40:0/1320151638 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f222c0046c0 con 0x7f2240102360 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.719+0000 7f223cc00640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f22240a2c10 0x7f22240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.719+0000 7f223cc00640 1 -- 172.21.15.40:0/1320151638 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f222c0cfdb0 con 0x7f2240102360 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.719+0000 7f223fe00640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f22240a2c10 0x7f22240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.719+0000 7f223cc00640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] conn(0x7f22240add60 0x7f22240b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.719+0000 7f223cc00640 1 -- 172.21.15.40:0/1320151638 --> [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f222c005350 con 0x7f22240add60 2024-09-11T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.719+0000 7f223cc00640 1 -- 172.21.15.40:0/1320151638 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f222c0d0160 con 0x7f2240102360 2024-09-11T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.720+0000 7f2244a00640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] conn(0x7f22240add60 0x7f22240b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.720+0000 7f223fe00640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f22240a2c10 0x7f22240a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2230009b50 tx=0x7f2230005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.720+0000 7f2244a00640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] conn(0x7f22240add60 0x7f22240b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.721+0000 7f223cc00640 1 -- 172.21.15.40:0/1320151638 <== osd.9 v2:172.21.15.40:6826/4209555544 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f222c005350 con 0x7f22240add60 2024-09-11T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.736+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 --> [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2240103100 con 0x7f22240add60 2024-09-11T22:29:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.736+0000 7f223cc00640 1 -- 172.21.15.40:0/1320151638 <== osd.9 v2:172.21.15.40:6826/4209555544 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2240103100 con 0x7f22240add60 2024-09-11T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] conn(0x7f22240add60 msgr2=0x7f22240b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] conn(0x7f22240add60 0x7f22240b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f22240a2c10 msgr2=0x7f22240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f22240a2c10 0x7f22240a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2230009b50 tx=0x7f2230005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240102360 msgr2=0x7f2240074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 --2- 172.21.15.40:0/1320151638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2240102360 0x7f2240074a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f222c00e9f0 tx=0x7f222c00edf0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2244a00640 1 -- 172.21.15.40:0/1320151638 reap_dead start 2024-09-11T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 shutdown_connections 2024-09-11T22:29:53.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 >> 172.21.15.40:0/1320151638 conn(0x7f22400fd740 msgr2=0x7f22400fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 shutdown_connections 2024-09-11T22:29:53.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:49.737+0000 7f2245400640 1 -- 172.21.15.40:0/1320151638 wait complete. 2024-09-11T22:29:54.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:54 smithi146 ceph-mon[34996]: pgmap v351: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-11T22:29:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.154+0000 7f2e37e00640 1 -- 172.21.15.40:0/3378263121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e381079d0 msgr2=0x7f2e38107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.154+0000 7f2e37e00640 1 --2- 172.21.15.40:0/3378263121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e381079d0 0x7f2e38107db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009930 tx=0x7f2e2802a420 comp rx=0 tx=0).stop 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.154+0000 7f2e37e00640 1 -- 172.21.15.40:0/3378263121 shutdown_connections 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.154+0000 7f2e37e00640 1 --2- 172.21.15.40:0/3378263121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e38102370 0x7f2e3810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.154+0000 7f2e37e00640 1 --2- 172.21.15.40:0/3378263121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e381019d0 0x7f2e38101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.154+0000 7f2e37e00640 1 --2- 172.21.15.40:0/3378263121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e381079d0 0x7f2e38107db0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.154+0000 7f2e37e00640 1 -- 172.21.15.40:0/3378263121 >> 172.21.15.40:0/3378263121 conn(0x7f2e380fd710 msgr2=0x7f2e380ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.154+0000 7f2e37e00640 1 -- 172.21.15.40:0/3378263121 shutdown_connections 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.154+0000 7f2e37e00640 1 -- 172.21.15.40:0/3378263121 wait complete. 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.155+0000 7f2e37e00640 1 Processor -- start 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e37e00640 1 -- start start 2024-09-11T22:29:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e381019d0 0x7f2e3819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e38102370 0x7f2e3819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e381079d0 0x7f2e3819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e37e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2e38111dd0 con 0x7f2e381079d0 2024-09-11T22:29:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e37e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2e38111c50 con 0x7f2e381019d0 2024-09-11T22:29:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e37e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e38111f50 con 0x7f2e38102370 2024-09-11T22:29:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e36a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e381019d0 0x7f2e3819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e37400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e381079d0 0x7f2e3819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e36000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e38102370 0x7f2e3819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e36000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e38102370 0x7f2e3819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:58740/0 (socket says 172.21.15.40:58740) 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e37400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e381079d0 0x7f2e3819ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50084/0 (socket says 172.21.15.40:50084) 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e36000640 1 -- 172.21.15.40:0/1007538326 learned_addr learned my addr 172.21.15.40:0/1007538326 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.156+0000 7f2e36a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e381019d0 0x7f2e3819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:45078/0 (socket says 172.21.15.40:45078) 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.157+0000 7f2e36000640 1 -- 172.21.15.40:0/1007538326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e381019d0 msgr2=0x7f2e3819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.157+0000 7f2e36000640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e381019d0 0x7f2e3819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.157+0000 7f2e36000640 1 -- 172.21.15.40:0/1007538326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e381079d0 msgr2=0x7f2e3819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.157+0000 7f2e36000640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e381079d0 0x7f2e3819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.157+0000 7f2e36000640 1 -- 172.21.15.40:0/1007538326 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3819f440 con 0x7f2e38102370 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.157+0000 7f2e36000640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e38102370 0x7f2e3819a9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400e9f0 tx=0x7f2e2400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.157+0000 7f2e2f400640 1 -- 172.21.15.40:0/1007538326 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400cd80 con 0x7f2e38102370 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.158+0000 7f2e2f400640 1 -- 172.21.15.40:0/1007538326 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e24010910 con 0x7f2e38102370 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.158+0000 7f2e2f400640 1 -- 172.21.15.40:0/1007538326 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24018990 con 0x7f2e38102370 2024-09-11T22:29:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.158+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3819f730 con 0x7f2e38102370 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.158+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e381a7010 con 0x7f2e38102370 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.159+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e380ff020 con 0x7f2e38102370 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.161+0000 7f2e2f400640 1 -- 172.21.15.40:0/1007538326 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2e24010ac0 con 0x7f2e38102370 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.162+0000 7f2e2f400640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e1c0a2c10 0x7f2e1c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.162+0000 7f2e2f400640 1 -- 172.21.15.40:0/1007538326 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f2e240cf880 con 0x7f2e38102370 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.162+0000 7f2e36a00640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e1c0a2c10 0x7f2e1c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.162+0000 7f2e2f400640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] conn(0x7f2e1c0add60 0x7f2e1c0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.162+0000 7f2e2f400640 1 -- 172.21.15.40:0/1007538326 --> [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e24012ec0 con 0x7f2e1c0add60 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.162+0000 7f2e2f400640 1 -- 172.21.15.40:0/1007538326 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f2e240d42a0 con 0x7f2e38102370 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.163+0000 7f2e37400640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] conn(0x7f2e1c0add60 0x7f2e1c0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.163+0000 7f2e36a00640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e1c0a2c10 0x7f2e1c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009900 tx=0x7f2e280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.164+0000 7f2e37400640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] conn(0x7f2e1c0add60 0x7f2e1c0b0200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.165+0000 7f2e2f400640 1 -- 172.21.15.40:0/1007538326 <== osd.10 v2:172.21.15.146:6824/3331275182 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e24012ec0 con 0x7f2e1c0add60 2024-09-11T22:29:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.195+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 --> [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2e38103110 con 0x7f2e1c0add60 2024-09-11T22:29:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.195+0000 7f2e2f400640 1 -- 172.21.15.40:0/1007538326 <== osd.10 v2:172.21.15.146:6824/3331275182 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2e38103110 con 0x7f2e1c0add60 2024-09-11T22:29:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 >> [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] conn(0x7f2e1c0add60 msgr2=0x7f2e1c0b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] conn(0x7f2e1c0add60 0x7f2e1c0b0200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e1c0a2c10 msgr2=0x7f2e1c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:54.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e1c0a2c10 0x7f2e1c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009900 tx=0x7f2e280058d0 comp rx=0 tx=0).stop 2024-09-11T22:29:54.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e38102370 msgr2=0x7f2e3819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:54.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 --2- 172.21.15.40:0/1007538326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e38102370 0x7f2e3819a9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400e9f0 tx=0x7f2e2400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:54.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37400640 1 -- 172.21.15.40:0/1007538326 reap_dead start 2024-09-11T22:29:54.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 shutdown_connections 2024-09-11T22:29:54.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 >> 172.21.15.40:0/1007538326 conn(0x7f2e380fd710 msgr2=0x7f2e3810d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:54.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 shutdown_connections 2024-09-11T22:29:54.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:53.196+0000 7f2e37e00640 1 -- 172.21.15.40:0/1007538326 wait complete. 2024-09-11T22:29:54.377 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:54 smithi040 ceph-mon[30787]: pgmap v351: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-11T22:29:54.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:54 smithi177 ceph-mon[35530]: pgmap v351: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-11T22:29:55.061 INFO:teuthology.orchestra.run.smithi040.stdout:214748364854 2024-09-11T22:29:55.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T22:29:55.377 INFO:teuthology.orchestra.run.smithi040.stdout:137438953542 2024-09-11T22:29:55.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T22:29:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.581+0000 7fcb89600640 1 -- 172.21.15.40:0/112033671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84112a50 msgr2=0x7fcb84114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.581+0000 7fcb89600640 1 --2- 172.21.15.40:0/112033671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84112a50 0x7fcb84114e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009900 tx=0x7fcb7402a3f0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.581+0000 7fcb89600640 1 -- 172.21.15.40:0/112033671 shutdown_connections 2024-09-11T22:29:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.581+0000 7fcb89600640 1 --2- 172.21.15.40:0/112033671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84112a50 0x7fcb84114e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.581+0000 7fcb89600640 1 --2- 172.21.15.40:0/112033671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb84077040 0x7fcb84112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.581+0000 7fcb89600640 1 --2- 172.21.15.40:0/112033671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb84076720 0x7fcb84076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.581+0000 7fcb89600640 1 -- 172.21.15.40:0/112033671 >> 172.21.15.40:0/112033671 conn(0x7fcb840ffa50 msgr2=0x7fcb84101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.581+0000 7fcb89600640 1 -- 172.21.15.40:0/112033671 shutdown_connections 2024-09-11T22:29:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.581+0000 7fcb89600640 1 -- 172.21.15.40:0/112033671 wait complete. 2024-09-11T22:29:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.583+0000 7fcb89600640 1 Processor -- start 2024-09-11T22:29:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.583+0000 7fcb89600640 1 -- start start 2024-09-11T22:29:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.583+0000 7fcb89600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84076720 0x7fcb841a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.583+0000 7fcb89600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb84077040 0x7fcb841a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb89600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb84112a50 0x7fcb8419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb89600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcb841185e0 con 0x7fcb84112a50 2024-09-11T22:29:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb89600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcb84118460 con 0x7fcb84077040 2024-09-11T22:29:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb89600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb84118760 con 0x7fcb84076720 2024-09-11T22:29:55.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb82000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb84077040 0x7fcb841a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb82000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb84077040 0x7fcb841a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:45138/0 (socket says 172.21.15.40:45138) 2024-09-11T22:29:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb82000640 1 -- 172.21.15.40:0/3353159807 learned_addr learned my addr 172.21.15.40:0/3353159807 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb83400640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb84112a50 0x7fcb8419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb82a00640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84076720 0x7fcb841a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb82000640 1 -- 172.21.15.40:0/3353159807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84076720 msgr2=0x7fcb841a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb82000640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb84076720 0x7fcb841a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb82000640 1 -- 172.21.15.40:0/3353159807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb84112a50 msgr2=0x7fcb8419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb82000640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb84112a50 0x7fcb8419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.584+0000 7fcb82000640 1 -- 172.21.15.40:0/3353159807 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8419efa0 con 0x7fcb84077040 2024-09-11T22:29:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.585+0000 7fcb82000640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb84077040 0x7fcb841a4bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00e9f0 tx=0x7fcb6c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:55.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.585+0000 7fcb7b400640 1 -- 172.21.15.40:0/3353159807 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c00cd80 con 0x7fcb84077040 2024-09-11T22:29:55.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.585+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8419f290 con 0x7fcb84077040 2024-09-11T22:29:55.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.586+0000 7fcb7b400640 1 -- 172.21.15.40:0/3353159807 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb6c010910 con 0x7fcb84077040 2024-09-11T22:29:55.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.586+0000 7fcb7b400640 1 -- 172.21.15.40:0/3353159807 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c0188f0 con 0x7fcb84077040 2024-09-11T22:29:55.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.586+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb841ab580 con 0x7fcb84077040 2024-09-11T22:29:55.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.587+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb84114a10 con 0x7fcb84077040 2024-09-11T22:29:55.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.589+0000 7fcb7b400640 1 -- 172.21.15.40:0/3353159807 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcb6c010ac0 con 0x7fcb84077040 2024-09-11T22:29:55.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.590+0000 7fcb7b400640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb680a2c90 0x7fcb680a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.590+0000 7fcb7b400640 1 -- 172.21.15.40:0/3353159807 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7fcb6c0cf8f0 con 0x7fcb84077040 2024-09-11T22:29:55.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.591+0000 7fcb82a00640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb680a2c90 0x7fcb680a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.591+0000 7fcb7b400640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] conn(0x7fcb680adde0 0x7fcb680b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.591+0000 7fcb7b400640 1 -- 172.21.15.40:0/3353159807 --> [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb6c012ec0 con 0x7fcb680adde0 2024-09-11T22:29:55.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.591+0000 7fcb7b400640 1 -- 172.21.15.40:0/3353159807 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fcb6c0d42a0 con 0x7fcb84077040 2024-09-11T22:29:55.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.592+0000 7fcb83400640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] conn(0x7fcb680adde0 0x7fcb680b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.592+0000 7fcb82a00640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb680a2c90 0x7fcb680a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcb8419f9b0 tx=0x7fcb7c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:55.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.592+0000 7fcb83400640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] conn(0x7fcb680adde0 0x7fcb680b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:55.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.593+0000 7fcb7b400640 1 -- 172.21.15.40:0/3353159807 <== osd.5 v2:172.21.15.177:6808/4157148249 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb6c012ec0 con 0x7fcb680adde0 2024-09-11T22:29:55.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.609+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 --> [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcb84077e60 con 0x7fcb680adde0 2024-09-11T22:29:55.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.610+0000 7fcb7b400640 1 -- 172.21.15.40:0/3353159807 <== osd.5 v2:172.21.15.177:6808/4157148249 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcb84077e60 con 0x7fcb680adde0 2024-09-11T22:29:55.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.610+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 >> [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] conn(0x7fcb680adde0 msgr2=0x7fcb680b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.610+0000 7fcb89600640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] conn(0x7fcb680adde0 0x7fcb680b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.610+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb680a2c90 msgr2=0x7fcb680a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.610+0000 7fcb89600640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcb680a2c90 0x7fcb680a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcb8419f9b0 tx=0x7fcb7c009500 comp rx=0 tx=0).stop 2024-09-11T22:29:55.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.610+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb84077040 msgr2=0x7fcb841a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.610+0000 7fcb89600640 1 --2- 172.21.15.40:0/3353159807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb84077040 0x7fcb841a4bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00e9f0 tx=0x7fcb6c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.610+0000 7fcb83400640 1 -- 172.21.15.40:0/3353159807 reap_dead start 2024-09-11T22:29:55.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.611+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 shutdown_connections 2024-09-11T22:29:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.611+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 >> 172.21.15.40:0/3353159807 conn(0x7fcb840ffa50 msgr2=0x7fcb84101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.611+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 shutdown_connections 2024-09-11T22:29:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:55.611+0000 7fcb89600640 1 -- 172.21.15.40:0/3353159807 wait complete. 2024-09-11T22:29:55.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.273+0000 7f8ef7c00640 1 -- 172.21.15.40:0/530430082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef0102de0 msgr2=0x7f8ef01031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.273+0000 7f8ef7c00640 1 --2- 172.21.15.40:0/530430082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef0102de0 0x7f8ef01031c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009900 tx=0x7f8ee402a480 comp rx=0 tx=0).stop 2024-09-11T22:29:55.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.273+0000 7f8ef7c00640 1 -- 172.21.15.40:0/530430082 shutdown_connections 2024-09-11T22:29:55.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.273+0000 7f8ef7c00640 1 --2- 172.21.15.40:0/530430082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ef010c180 0x7f8ef010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.273+0000 7f8ef7c00640 1 --2- 172.21.15.40:0/530430082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef0103700 0x7f8ef010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.273+0000 7f8ef7c00640 1 --2- 172.21.15.40:0/530430082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef0102de0 0x7f8ef01031c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.273+0000 7f8ef7c00640 1 -- 172.21.15.40:0/530430082 >> 172.21.15.40:0/530430082 conn(0x7f8ef00fc7a0 msgr2=0x7f8ef00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:55.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.274+0000 7f8ef7c00640 1 -- 172.21.15.40:0/530430082 shutdown_connections 2024-09-11T22:29:55.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.274+0000 7f8ef7c00640 1 -- 172.21.15.40:0/530430082 wait complete. 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.274+0000 7f8ef7c00640 1 Processor -- start 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef7c00640 1 -- start start 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef7c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef0102de0 0x7f8ef0100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef7c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ef0103700 0x7f8ef0100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef7c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef010c180 0x7f8ef01014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef7c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0111f70 con 0x7f8ef0102de0 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef7c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0111df0 con 0x7f8ef010c180 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef7c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef01120f0 con 0x7f8ef0103700 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef0102de0 0x7f8ef0100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef5200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef0102de0 0x7f8ef0100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50134/0 (socket says 172.21.15.40:50134) 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8ef5200640 1 -- 172.21.15.40:0/2697116140 learned_addr learned my addr 172.21.15.40:0/2697116140 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:55.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.275+0000 7f8eefe00640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ef0103700 0x7f8ef0100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.276+0000 7f8ef5c00640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef010c180 0x7f8ef01014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.276+0000 7f8ef5200640 1 -- 172.21.15.40:0/2697116140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ef0103700 msgr2=0x7f8ef0100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.276+0000 7f8ef5200640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ef0103700 0x7f8ef0100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.276+0000 7f8ef5200640 1 -- 172.21.15.40:0/2697116140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef010c180 msgr2=0x7f8ef01014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.276+0000 7f8ef5200640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef010c180 0x7f8ef01014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.276+0000 7f8ef5200640 1 -- 172.21.15.40:0/2697116140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef01a6940 con 0x7f8ef0102de0 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.276+0000 7f8ef5200640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef0102de0 0x7f8ef0100a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4006010 tx=0x7f8ee40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.276+0000 7f8eed600640 1 -- 172.21.15.40:0/2697116140 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee403f030 con 0x7f8ef0102de0 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.277+0000 7f8eed600640 1 -- 172.21.15.40:0/2697116140 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ee4003ce0 con 0x7f8ef0102de0 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.277+0000 7f8eed600640 1 -- 172.21.15.40:0/2697116140 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4035070 con 0x7f8ef0102de0 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.277+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef01a6bd0 con 0x7f8ef0102de0 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.277+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef01a7100 con 0x7f8ef0102de0 2024-09-11T22:29:55.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.277+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ef00628c0 con 0x7f8ef0102de0 2024-09-11T22:29:55.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.279+0000 7f8eed600640 1 -- 172.21.15.40:0/2697116140 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8ee4042030 con 0x7f8ef0102de0 2024-09-11T22:29:55.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.281+0000 7f8eed600640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f8ed80a2c90 0x7f8ed80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.281+0000 7f8eed600640 1 -- 172.21.15.40:0/2697116140 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9071+0+0 (secure 0 0 0) 0x7f8ee40f0090 con 0x7f8ef0102de0 2024-09-11T22:29:55.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.281+0000 7f8eefe00640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f8ed80a2c90 0x7f8ed80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.281+0000 7f8eed600640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] conn(0x7f8ed80adde0 0x7f8ed80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:55.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.281+0000 7f8eed600640 1 -- 172.21.15.40:0/2697116140 --> [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ee4001d30 con 0x7f8ed80adde0 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.281+0000 7f8eed600640 1 -- 172.21.15.40:0/2697116140 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f8ee40f0440 con 0x7f8ef0102de0 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.282+0000 7f8ef5c00640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] conn(0x7f8ed80adde0 0x7f8ed80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.282+0000 7f8eefe00640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f8ed80a2c90 0x7f8ed80a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ef01024d0 tx=0x7f8edc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.282+0000 7f8ef5c00640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] conn(0x7f8ed80adde0 0x7f8ed80b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.283+0000 7f8eed600640 1 -- 172.21.15.40:0/2697116140 <== osd.0 v2:172.21.15.40:6802/3907265678 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ee4001d30 con 0x7f8ed80adde0 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.297+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 --> [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ef0062cc0 con 0x7f8ed80adde0 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.298+0000 7f8eed600640 1 -- 172.21.15.40:0/2697116140 <== osd.0 v2:172.21.15.40:6802/3907265678 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ef0062cc0 con 0x7f8ed80adde0 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.298+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] conn(0x7f8ed80adde0 msgr2=0x7f8ed80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.298+0000 7f8ef7c00640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] conn(0x7f8ed80adde0 0x7f8ed80b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.298+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f8ed80a2c90 msgr2=0x7f8ed80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.298+0000 7f8ef7c00640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f8ed80a2c90 0x7f8ed80a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8ef01024d0 tx=0x7f8edc00b410 comp rx=0 tx=0).stop 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.298+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef0102de0 msgr2=0x7f8ef0100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:55.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.298+0000 7f8ef7c00640 1 --2- 172.21.15.40:0/2697116140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ef0102de0 0x7f8ef0100a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4006010 tx=0x7f8ee40042f0 comp rx=0 tx=0).stop 2024-09-11T22:29:55.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.298+0000 7f8ef5c00640 1 -- 172.21.15.40:0/2697116140 reap_dead start 2024-09-11T22:29:55.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.299+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 shutdown_connections 2024-09-11T22:29:55.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.299+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 >> 172.21.15.40:0/2697116140 conn(0x7f8ef00fc7a0 msgr2=0x7f8ef00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:55.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.299+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 shutdown_connections 2024-09-11T22:29:55.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:54.299+0000 7f8ef7c00640 1 -- 172.21.15.40:0/2697116140 wait complete. 2024-09-11T22:29:56.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:56 smithi146 ceph-mon[34996]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T22:29:56.467 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:56 smithi040 ceph-mon[30787]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T22:29:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:56 smithi177 ceph-mon[35530]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T22:29:56.721 INFO:teuthology.orchestra.run.smithi040.stdout:300647710758 2024-09-11T22:29:56.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T22:29:57.247 INFO:teuthology.orchestra.run.smithi040.stdout:279172874283 2024-09-11T22:29:57.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T22:29:58.078 INFO:teuthology.orchestra.run.smithi040.stdout:158913790017 2024-09-11T22:29:58.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T22:29:58.310 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:58 smithi040 ceph-mon[30787]: pgmap v353: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:29:58.311 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-11T22:29:58.311 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6, 5, 9]}]: dispatch 2024-09-11T22:29:58.311 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:58 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-11T22:29:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.327+0000 7f1c37400640 1 -- 172.21.15.40:0/2265823885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c30074e30 msgr2=0x7f1c3010df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.327+0000 7f1c37400640 1 --2- 172.21.15.40:0/2265823885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c30074e30 0x7f1c3010df10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009900 tx=0x7f1c1c02a480 comp rx=0 tx=0).stop 2024-09-11T22:29:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.327+0000 7f1c37400640 1 -- 172.21.15.40:0/2265823885 shutdown_connections 2024-09-11T22:29:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.327+0000 7f1c37400640 1 --2- 172.21.15.40:0/2265823885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3010e450 0x7f1c30110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.327+0000 7f1c37400640 1 --2- 172.21.15.40:0/2265823885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c30074e30 0x7f1c3010df10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.327+0000 7f1c37400640 1 --2- 172.21.15.40:0/2265823885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c30074510 0x7f1c300748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.328+0000 7f1c37400640 1 -- 172.21.15.40:0/2265823885 >> 172.21.15.40:0/2265823885 conn(0x7f1c300fd8b0 msgr2=0x7f1c300ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.328+0000 7f1c37400640 1 -- 172.21.15.40:0/2265823885 shutdown_connections 2024-09-11T22:29:58.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.328+0000 7f1c37400640 1 -- 172.21.15.40:0/2265823885 wait complete. 2024-09-11T22:29:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.329+0000 7f1c37400640 1 Processor -- start 2024-09-11T22:29:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.329+0000 7f1c37400640 1 -- start start 2024-09-11T22:29:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.330+0000 7f1c37400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c30074510 0x7f1c3019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.330+0000 7f1c37400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c30074e30 0x7f1c3019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:58.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.330+0000 7f1c37400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c3010e450 0x7f1c3019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.330+0000 7f1c37400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c30114170 con 0x7f1c30074510 2024-09-11T22:29:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.330+0000 7f1c37400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c30113ff0 con 0x7f1c30074e30 2024-09-11T22:29:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.330+0000 7f1c37400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1c301142f0 con 0x7f1c3010e450 2024-09-11T22:29:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.330+0000 7f1c2fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c30074e30 0x7f1c3019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.330+0000 7f1c2fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c30074e30 0x7f1c3019ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:45162/0 (socket says 172.21.15.40:45162) 2024-09-11T22:29:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.330+0000 7f1c2fe00640 1 -- 172.21.15.40:0/2472647618 learned_addr learned my addr 172.21.15.40:0/2472647618 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.331+0000 7f1c34a00640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c30074510 0x7f1c3019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:58.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.331+0000 7f1c35400640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c3010e450 0x7f1c3019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:58.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.331+0000 7f1c34a00640 1 -- 172.21.15.40:0/2472647618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c3010e450 msgr2=0x7f1c3019f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:58.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.331+0000 7f1c34a00640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c3010e450 0x7f1c3019f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:58.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.331+0000 7f1c34a00640 1 -- 172.21.15.40:0/2472647618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c30074e30 msgr2=0x7f1c3019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:58.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.331+0000 7f1c34a00640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c30074e30 0x7f1c3019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:58.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.331+0000 7f1c34a00640 1 -- 172.21.15.40:0/2472647618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3019f700 con 0x7f1c30074510 2024-09-11T22:29:58.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.332+0000 7f1c34a00640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c30074510 0x7f1c3019a750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400e9f0 tx=0x7f1c2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:58.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.332+0000 7f1c2d600640 1 -- 172.21.15.40:0/2472647618 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400ccc0 con 0x7f1c30074510 2024-09-11T22:29:58.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.332+0000 7f1c2d600640 1 -- 172.21.15.40:0/2472647618 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c24005020 con 0x7f1c30074510 2024-09-11T22:29:58.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.332+0000 7f1c2d600640 1 -- 172.21.15.40:0/2472647618 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c240049e0 con 0x7f1c30074510 2024-09-11T22:29:58.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:58 smithi146 ceph-mon[34996]: pgmap v353: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:29:58.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-11T22:29:58.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6, 5, 9]}]: dispatch 2024-09-11T22:29:58.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:58 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-11T22:29:58.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.333+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3019f9f0 con 0x7f1c30074510 2024-09-11T22:29:58.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.333+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c301a72d0 con 0x7f1c30074510 2024-09-11T22:29:58.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.334+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c30062900 con 0x7f1c30074510 2024-09-11T22:29:58.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.336+0000 7f1c2d600640 1 -- 172.21.15.40:0/2472647618 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1c24005560 con 0x7f1c30074510 2024-09-11T22:29:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.338+0000 7f1c2d600640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1c180a2c10 0x7f1c180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.339+0000 7f1c2d600640 1 -- 172.21.15.40:0/2472647618 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9137+0+0 (secure 0 0 0) 0x7f1c240cf540 con 0x7f1c30074510 2024-09-11T22:29:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.339+0000 7f1c2fe00640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1c180a2c10 0x7f1c180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.339+0000 7f1c2d600640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] conn(0x7f1c180ade60 0x7f1c180b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:58.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.339+0000 7f1c2d600640 1 -- 172.21.15.40:0/2472647618 --> [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c24015e80 con 0x7f1c180ade60 2024-09-11T22:29:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.339+0000 7f1c2d600640 1 -- 172.21.15.40:0/2472647618 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f1c240d6050 con 0x7f1c30074510 2024-09-11T22:29:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.340+0000 7f1c35400640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] conn(0x7f1c180ade60 0x7f1c180b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:58.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.340+0000 7f1c2fe00640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1c180a2c10 0x7f1c180a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c031550 tx=0x7f1c1c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:58.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.341+0000 7f1c35400640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] conn(0x7f1c180ade60 0x7f1c180b0300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:58.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.342+0000 7f1c2d600640 1 -- 172.21.15.40:0/2472647618 <== osd.11 v2:172.21.15.177:6824/153711058 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c24015e80 con 0x7f1c180ade60 2024-09-11T22:29:58.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.357+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 --> [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c30062d80 con 0x7f1c180ade60 2024-09-11T22:29:58.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c2d600640 1 -- 172.21.15.40:0/2472647618 <== osd.11 v2:172.21.15.177:6824/153711058 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1c30062d80 con 0x7f1c180ade60 2024-09-11T22:29:58.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 >> [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] conn(0x7f1c180ade60 msgr2=0x7f1c180b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:58.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c37400640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] conn(0x7f1c180ade60 0x7f1c180b0300 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:58.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1c180a2c10 msgr2=0x7f1c180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:58.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c37400640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1c180a2c10 0x7f1c180a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c031550 tx=0x7f1c1c005a20 comp rx=0 tx=0).stop 2024-09-11T22:29:58.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c30074510 msgr2=0x7f1c3019a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:58.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c37400640 1 --2- 172.21.15.40:0/2472647618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c30074510 0x7f1c3019a750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400e9f0 tx=0x7f1c2400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:29:58.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c35400640 1 -- 172.21.15.40:0/2472647618 reap_dead start 2024-09-11T22:29:58.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 shutdown_connections 2024-09-11T22:29:58.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.358+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 >> 172.21.15.40:0/2472647618 conn(0x7f1c300fd8b0 msgr2=0x7f1c300ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:58.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.359+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 shutdown_connections 2024-09-11T22:29:58.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:58.359+0000 7f1c37400640 1 -- 172.21.15.40:0/2472647618 wait complete. 2024-09-11T22:29:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:58 smithi177 ceph-mon[35530]: pgmap v353: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:29:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-11T22:29:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6, 5, 9]}]: dispatch 2024-09-11T22:29:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:58 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-11T22:29:58.693 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:58.728 INFO:teuthology.orchestra.run.smithi040.stdout:34359738459 2024-09-11T22:29:58.729 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T22:29:58.920 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:58.980 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:58.988 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:59.031 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:29:59.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-11T22:29:59.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6, 5, 9]}]': finished 2024-09-11T22:29:59.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:59 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-11T22:29:59.371 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:29:59 smithi040 ceph-mon[30787]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T22:29:59.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:59 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-11T22:29:59.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:59 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6, 5, 9]}]': finished 2024-09-11T22:29:59.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:59 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-11T22:29:59.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:29:59 smithi177 ceph-mon[35530]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T22:29:59.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:59 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-11T22:29:59.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:59 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6, 5, 9]}]': finished 2024-09-11T22:29:59.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:59 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-11T22:29:59.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:29:59 smithi146 ceph-mon[34996]: osdmap e94: 12 total, 12 up, 12 in 2024-09-11T22:29:59.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.730+0000 7fcbe6e00640 1 -- 172.21.15.40:0/4194561533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 msgr2=0x7fcbe01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:59.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.730+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/4194561533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 0x7fcbe01067f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc009900 tx=0x7fcbcc02a3f0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.731+0000 7fcbe6e00640 1 -- 172.21.15.40:0/4194561533 shutdown_connections 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.731+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/4194561533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbe0106f20 0x7fcbe010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.731+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/4194561533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 0x7fcbe01067f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.731+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/4194561533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbe0101df0 0x7fcbe01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.731+0000 7fcbe6e00640 1 -- 172.21.15.40:0/4194561533 >> 172.21.15.40:0/4194561533 conn(0x7fcbe00fd8b0 msgr2=0x7fcbe00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.731+0000 7fcbe6e00640 1 -- 172.21.15.40:0/4194561533 shutdown_connections 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.731+0000 7fcbe6e00640 1 -- 172.21.15.40:0/4194561533 wait complete. 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.731+0000 7fcbe6e00640 1 Processor -- start 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbe6e00640 1 -- start start 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbe6e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbe0101df0 0x7fcbe019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbe6e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 0x7fcbe019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:59.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbe6e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbe0106f20 0x7fcbe019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbe6e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0111f80 con 0x7fcbe01027a0 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbe6e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0111e00 con 0x7fcbe0101df0 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbe6e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0112100 con 0x7fcbe0106f20 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbdf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 0x7fcbe019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbdf400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 0x7fcbe019ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50172/0 (socket says 172.21.15.40:50172) 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbdf400640 1 -- 172.21.15.40:0/735602347 learned_addr learned my addr 172.21.15.40:0/735602347 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbe4e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbe0106f20 0x7fcbe019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.732+0000 7fcbdfe00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbe0101df0 0x7fcbe019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.733+0000 7fcbe4e00640 1 -- 172.21.15.40:0/735602347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbe0101df0 msgr2=0x7fcbe019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.733+0000 7fcbe4e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbe0101df0 0x7fcbe019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.733+0000 7fcbe4e00640 1 -- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 msgr2=0x7fcbe019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:59.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.733+0000 7fcbe4e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 0x7fcbe019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.733+0000 7fcbe4e00640 1 -- 172.21.15.40:0/735602347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe019f580 con 0x7fcbe0106f20 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.733+0000 7fcbdf400640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 0x7fcbe019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.733+0000 7fcbe4e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbe0106f20 0x7fcbe019eea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009fd0 tx=0x7fcbd800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.733+0000 7fcbdcc00640 1 -- 172.21.15.40:0/735602347 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd800ce20 con 0x7fcbe0106f20 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.734+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe019f870 con 0x7fcbe0106f20 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.734+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe01a7150 con 0x7fcbe0106f20 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.734+0000 7fcbdcc00640 1 -- 172.21.15.40:0/735602347 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbd8005020 con 0x7fcbe0106f20 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.734+0000 7fcbdcc00640 1 -- 172.21.15.40:0/735602347 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8010720 con 0x7fcbe0106f20 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.735+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc0005290 con 0x7fcbe0106f20 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.737+0000 7fcbdcc00640 1 -- 172.21.15.40:0/735602347 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcbd8004a40 con 0x7fcbe0106f20 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.738+0000 7fcbdcc00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcbc40a2c90 0x7fcbc40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.738+0000 7fcbdcc00640 1 -- 172.21.15.40:0/735602347 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fcbd80cfa60 con 0x7fcbe0106f20 2024-09-11T22:29:59.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.738+0000 7fcbdfe00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcbc40a2c90 0x7fcbc40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:59.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.739+0000 7fcbdfe00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcbc40a2c90 0x7fcbc40a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009bd0 tx=0x7fcbd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:59.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.740+0000 7fcbdcc00640 1 -- 172.21.15.40:0/735602347 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbd809c500 con 0x7fcbe0106f20 2024-09-11T22:29:59.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.936+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcbc0005850 con 0x7fcbe0106f20 2024-09-11T22:29:59.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.937+0000 7fcbdcc00640 1 -- 172.21.15.40:0/735602347 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcbd809be00 con 0x7fcbe0106f20 2024-09-11T22:29:59.937 INFO:teuthology.orchestra.run.smithi040.stdout:55834574936 2024-09-11T22:29:59.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcbc40a2c90 msgr2=0x7fcbc40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcbc40a2c90 0x7fcbc40a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009bd0 tx=0x7fcbd0005f90 comp rx=0 tx=0).stop 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbe0106f20 msgr2=0x7fcbe019eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbe0106f20 0x7fcbe019eea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009fd0 tx=0x7fcbd800ef10 comp rx=0 tx=0).stop 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 shutdown_connections 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcbc40a2c90 0x7fcbc40a5150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbe0106f20 0x7fcbe019eea0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe01027a0 0x7fcbe019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 --2- 172.21.15.40:0/735602347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbe0101df0 0x7fcbe019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 >> 172.21.15.40:0/735602347 conn(0x7fcbe00fd8b0 msgr2=0x7fcbe00fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:59.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 shutdown_connections 2024-09-11T22:29:59.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:29:59.939+0000 7fcbe6e00640 1 -- 172.21.15.40:0/735602347 wait complete. 2024-09-11T22:30:00.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:00 smithi040 ceph-mon[30787]: pgmap v355: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T22:30:00.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:00 smithi040 ceph-mon[30787]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T22:30:00.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:00 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/735602347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T22:30:00.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:00 smithi040 ceph-mon[30787]: overall HEALTH_OK 2024-09-11T22:30:00.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:00 smithi177 ceph-mon[35530]: pgmap v355: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T22:30:00.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:00 smithi177 ceph-mon[35530]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T22:30:00.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:00 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/735602347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T22:30:00.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:00 smithi177 ceph-mon[35530]: overall HEALTH_OK 2024-09-11T22:30:00.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:00 smithi146 ceph-mon[34996]: pgmap v355: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T22:30:00.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:00 smithi146 ceph-mon[34996]: osdmap e95: 12 total, 12 up, 12 in 2024-09-11T22:30:00.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:00 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/735602347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T22:30:00.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:00 smithi146 ceph-mon[34996]: overall HEALTH_OK 2024-09-11T22:30:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.783+0000 7f6b0ca00640 1 -- 172.21.15.40:0/63970469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 msgr2=0x7f6b081089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.783+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/63970469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 0x7f6b081089f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009900 tx=0x7f6af402a410 comp rx=0 tx=0).stop 2024-09-11T22:30:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.783+0000 7f6b0ca00640 1 -- 172.21.15.40:0/63970469 shutdown_connections 2024-09-11T22:30:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.783+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/63970469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08109120 0x7f6b08110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.783+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/63970469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 0x7f6b081089f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.783+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/63970469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b08103ff0 0x7f6b081043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.783+0000 7f6b0ca00640 1 -- 172.21.15.40:0/63970469 >> 172.21.15.40:0/63970469 conn(0x7f6b080ffa90 msgr2=0x7f6b08101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.784+0000 7f6b0ca00640 1 -- 172.21.15.40:0/63970469 shutdown_connections 2024-09-11T22:30:00.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.784+0000 7f6b0ca00640 1 -- 172.21.15.40:0/63970469 wait complete. 2024-09-11T22:30:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.785+0000 7f6b0ca00640 1 Processor -- start 2024-09-11T22:30:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.785+0000 7f6b0ca00640 1 -- start start 2024-09-11T22:30:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.785+0000 7f6b0ca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08103ff0 0x7f6b0819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.785+0000 7f6b0ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 0x7f6b0819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.785+0000 7f6b0ca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b08109120 0x7f6b0819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.785+0000 7f6b0ca00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6b08114190 con 0x7f6b081049a0 2024-09-11T22:30:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.785+0000 7f6b0ca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b08114010 con 0x7f6b08103ff0 2024-09-11T22:30:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.785+0000 7f6b0ca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6b08114310 con 0x7f6b08109120 2024-09-11T22:30:00.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.785+0000 7f6b05400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 0x7f6b0819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 0x7f6b0819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50194/0 (socket says 172.21.15.40:50194) 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05400640 1 -- 172.21.15.40:0/705452131 learned_addr learned my addr 172.21.15.40:0/705452131 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05e00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08103ff0 0x7f6b0819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b06800640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b08109120 0x7f6b0819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05400640 1 -- 172.21.15.40:0/705452131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b08109120 msgr2=0x7f6b0819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05400640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b08109120 0x7f6b0819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05400640 1 -- 172.21.15.40:0/705452131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08103ff0 msgr2=0x7f6b0819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05400640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08103ff0 0x7f6b0819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05400640 1 -- 172.21.15.40:0/705452131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0819f620 con 0x7f6b081049a0 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05e00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08103ff0 0x7f6b0819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.786+0000 7f6b05400640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 0x7f6b0819abb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6af4004770 tx=0x7f6af4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:00.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.787+0000 7f6afea00640 1 -- 172.21.15.40:0/705452131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af403f070 con 0x7f6b081049a0 2024-09-11T22:30:00.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.787+0000 7f6afea00640 1 -- 172.21.15.40:0/705452131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6af4031ca0 con 0x7f6b081049a0 2024-09-11T22:30:00.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.787+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0819f8b0 con 0x7f6b081049a0 2024-09-11T22:30:00.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.787+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b081a71f0 con 0x7f6b081049a0 2024-09-11T22:30:00.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.787+0000 7f6afea00640 1 -- 172.21.15.40:0/705452131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4035030 con 0x7f6b081049a0 2024-09-11T22:30:00.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.788+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b081043d0 con 0x7f6b081049a0 2024-09-11T22:30:00.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.790+0000 7f6afea00640 1 -- 172.21.15.40:0/705452131 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6af4042070 con 0x7f6b081049a0 2024-09-11T22:30:00.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.791+0000 7f6afea00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6aec0a2c10 0x7f6aec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:00.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.792+0000 7f6afea00640 1 -- 172.21.15.40:0/705452131 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f6af40f0200 con 0x7f6b081049a0 2024-09-11T22:30:00.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.792+0000 7f6b05e00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6aec0a2c10 0x7f6aec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:00.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.792+0000 7f6b05e00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6aec0a2c10 0x7f6aec0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009fc0 tx=0x7f6af8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:00.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.793+0000 7f6afea00640 1 -- 172.21.15.40:0/705452131 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6af40bc5c0 con 0x7f6b081049a0 2024-09-11T22:30:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.977+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6b0810c390 con 0x7f6b081049a0 2024-09-11T22:30:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.978+0000 7f6afea00640 1 -- 172.21.15.40:0/705452131 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6af40c08c0 con 0x7f6b081049a0 2024-09-11T22:30:00.979 INFO:teuthology.orchestra.run.smithi040.stdout:107374182477 2024-09-11T22:30:00.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6aec0a2c10 msgr2=0x7f6aec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:00.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6aec0a2c10 0x7f6aec0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009fc0 tx=0x7f6af8005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:00.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 msgr2=0x7f6b0819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 0x7f6b0819abb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6af4004770 tx=0x7f6af4003c10 comp rx=0 tx=0).stop 2024-09-11T22:30:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 shutdown_connections 2024-09-11T22:30:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6aec0a2c10 0x7f6aec0a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b08109120 0x7f6b0819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b081049a0 0x7f6b0819abb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 --2- 172.21.15.40:0/705452131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08103ff0 0x7f6b0819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 >> 172.21.15.40:0/705452131 conn(0x7f6b080ffa90 msgr2=0x7f6b08100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 shutdown_connections 2024-09-11T22:30:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:00.980+0000 7f6b0ca00640 1 -- 172.21.15.40:0/705452131 wait complete. 2024-09-11T22:30:01.015 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:01.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:01 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/705452131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T22:30:01.251 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:01.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:01 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/705452131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T22:30:01.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:01 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/705452131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T22:30:01.894 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182475 got 107374182477 for osd.3 2024-09-11T22:30:01.894 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:02.120 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:02 smithi040 ceph-mon[30787]: pgmap v357: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-11T22:30:02.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:02 smithi177 ceph-mon[35530]: pgmap v357: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-11T22:30:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.573+0000 7f536dc00640 1 -- 172.21.15.40:0/1632935864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 msgr2=0x7f536810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.573+0000 7f536dc00640 1 --2- 172.21.15.40:0/1632935864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 0x7f536810e890 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5360009cd0 tx=0x7f536002a8f0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.573+0000 7f536dc00640 1 -- 172.21.15.40:0/1632935864 shutdown_connections 2024-09-11T22:30:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.573+0000 7f536dc00640 1 --2- 172.21.15.40:0/1632935864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 0x7f536810e890 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.573+0000 7f536dc00640 1 --2- 172.21.15.40:0/1632935864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53681019c0 0x7f5368101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.573+0000 7f536dc00640 1 --2- 172.21.15.40:0/1632935864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53681079c0 0x7f5368107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.573+0000 7f536dc00640 1 -- 172.21.15.40:0/1632935864 >> 172.21.15.40:0/1632935864 conn(0x7f53680fd740 msgr2=0x7f53680ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.573+0000 7f536dc00640 1 -- 172.21.15.40:0/1632935864 shutdown_connections 2024-09-11T22:30:02.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.573+0000 7f536dc00640 1 -- 172.21.15.40:0/1632935864 wait complete. 2024-09-11T22:30:02.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.574+0000 7f536dc00640 1 Processor -- start 2024-09-11T22:30:02.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.574+0000 7f536dc00640 1 -- start start 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f536dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53681019c0 0x7f536819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f536dc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 0x7f536819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f536dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53681079c0 0x7f536819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f536dc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5368111e10 con 0x7f5368102360 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f536dc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5368111c90 con 0x7f53681019c0 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f536dc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5368111f90 con 0x7f53681079c0 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f5367400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 0x7f536819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f5367400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 0x7f536819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39410/0 (socket says 172.21.15.40:39410) 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f5367400640 1 -- 172.21.15.40:0/183592113 learned_addr learned my addr 172.21.15.40:0/183592113 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f5367e00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53681019c0 0x7f536819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f536d200640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53681079c0 0x7f536819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f5367400640 1 -- 172.21.15.40:0/183592113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53681079c0 msgr2=0x7f536819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f5367400640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53681079c0 0x7f536819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f5367400640 1 -- 172.21.15.40:0/183592113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53681019c0 msgr2=0x7f536819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f5367400640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53681019c0 0x7f536819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.575+0000 7f5367400640 1 -- 172.21.15.40:0/183592113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536819f420 con 0x7f5368102360 2024-09-11T22:30:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.576+0000 7f5367400640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 0x7f536819a9b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f535400d950 tx=0x7f535400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.576+0000 7f5364c00640 1 -- 172.21.15.40:0/183592113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354017070 con 0x7f5368102360 2024-09-11T22:30:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.576+0000 7f5364c00640 1 -- 172.21.15.40:0/183592113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5354009c30 con 0x7f5368102360 2024-09-11T22:30:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.576+0000 7f5364c00640 1 -- 172.21.15.40:0/183592113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535400f6b0 con 0x7f5368102360 2024-09-11T22:30:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.576+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536819f710 con 0x7f5368102360 2024-09-11T22:30:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.576+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53681a6ff0 con 0x7f5368102360 2024-09-11T22:30:02.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.578+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5368101e20 con 0x7f5368102360 2024-09-11T22:30:02.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.580+0000 7f5364c00640 1 -- 172.21.15.40:0/183592113 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f53540109d0 con 0x7f5368102360 2024-09-11T22:30:02.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:02 smithi146 ceph-mon[34996]: pgmap v357: 129 pgs: 129 active+clean; 643 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-11T22:30:02.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.582+0000 7f5364c00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f534c0a2c90 0x7f534c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:02.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.583+0000 7f5364c00640 1 -- 172.21.15.40:0/183592113 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f53540cf0d0 con 0x7f5368102360 2024-09-11T22:30:02.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.583+0000 7f5367e00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f534c0a2c90 0x7f534c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:02.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.583+0000 7f5367e00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f534c0a2c90 0x7f534c0a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5358009b50 tx=0x7f5358005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:02.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.585+0000 7f5364c00640 1 -- 172.21.15.40:0/183592113 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5354009de0 con 0x7f5368102360 2024-09-11T22:30:02.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.773+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f53681a7290 con 0x7f5368102360 2024-09-11T22:30:02.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.774+0000 7f5364c00640 1 -- 172.21.15.40:0/183592113 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f535409b510 con 0x7f5368102360 2024-09-11T22:30:02.776 INFO:teuthology.orchestra.run.smithi040.stdout:244813135922 2024-09-11T22:30:02.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f534c0a2c90 msgr2=0x7f534c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f534c0a2c90 0x7f534c0a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5358009b50 tx=0x7f5358005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 msgr2=0x7f536819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 0x7f536819a9b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f535400d950 tx=0x7f535400de10 comp rx=0 tx=0).stop 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 shutdown_connections 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f534c0a2c90 0x7f534c0a5150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53681079c0 0x7f536819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5368102360 0x7f536819a9b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 --2- 172.21.15.40:0/183592113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53681019c0 0x7f536819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 >> 172.21.15.40:0/183592113 conn(0x7f53680fd740 msgr2=0x7f536810cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 shutdown_connections 2024-09-11T22:30:02.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:02.776+0000 7f536dc00640 1 -- 172.21.15.40:0/183592113 wait complete. 2024-09-11T22:30:03.295 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:03 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/183592113' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T22:30:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.407+0000 7faafba00640 1 -- 172.21.15.40:0/1005029038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf41049a0 msgr2=0x7faaf41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.407+0000 7faafba00640 1 --2- 172.21.15.40:0/1005029038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf41049a0 0x7faaf41089f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faae0009900 tx=0x7faae002a410 comp rx=0 tx=0).stop 2024-09-11T22:30:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.407+0000 7faafba00640 1 -- 172.21.15.40:0/1005029038 shutdown_connections 2024-09-11T22:30:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.407+0000 7faafba00640 1 --2- 172.21.15.40:0/1005029038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf4109120 0x7faaf4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.407+0000 7faafba00640 1 --2- 172.21.15.40:0/1005029038 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf41049a0 0x7faaf41089f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.407+0000 7faafba00640 1 --2- 172.21.15.40:0/1005029038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf4103ff0 0x7faaf41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.407+0000 7faafba00640 1 -- 172.21.15.40:0/1005029038 >> 172.21.15.40:0/1005029038 conn(0x7faaf40ffa90 msgr2=0x7faaf4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:03.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.407+0000 7faafba00640 1 -- 172.21.15.40:0/1005029038 shutdown_connections 2024-09-11T22:30:03.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.407+0000 7faafba00640 1 -- 172.21.15.40:0/1005029038 wait complete. 2024-09-11T22:30:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.408+0000 7faafba00640 1 Processor -- start 2024-09-11T22:30:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.408+0000 7faafba00640 1 -- start start 2024-09-11T22:30:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faafba00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4103ff0 0x7faaf419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faafba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf41049a0 0x7faaf419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faafba00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf4109120 0x7faaf419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faafba00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faaf4114170 con 0x7faaf4103ff0 2024-09-11T22:30:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faafba00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faaf4113ff0 con 0x7faaf4109120 2024-09-11T22:30:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faafba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faaf41142f0 con 0x7faaf41049a0 2024-09-11T22:30:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faaf9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4103ff0 0x7faaf419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faaf9000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4103ff0 0x7faaf419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39424/0 (socket says 172.21.15.40:39424) 2024-09-11T22:30:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faaf9000640 1 -- 172.21.15.40:0/2733545677 learned_addr learned my addr 172.21.15.40:0/2733545677 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faaf9a00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf4109120 0x7faaf419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.409+0000 7faaf3e00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf41049a0 0x7faaf419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faaf9000640 1 -- 172.21.15.40:0/2733545677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf41049a0 msgr2=0x7faaf419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faaf9000640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf41049a0 0x7faaf419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faaf9000640 1 -- 172.21.15.40:0/2733545677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf4109120 msgr2=0x7faaf419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faaf9000640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf4109120 0x7faaf419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faaf9000640 1 -- 172.21.15.40:0/2733545677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf419f5e0 con 0x7faaf4103ff0 2024-09-11T22:30:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faaf9000640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4103ff0 0x7faaf419a630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faae800e9f0 tx=0x7faae800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faaf1600640 1 -- 172.21.15.40:0/2733545677 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae800cd80 con 0x7faaf4103ff0 2024-09-11T22:30:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faaf1600640 1 -- 172.21.15.40:0/2733545677 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faae8010910 con 0x7faaf4103ff0 2024-09-11T22:30:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf419f8d0 con 0x7faaf4103ff0 2024-09-11T22:30:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faaf1600640 1 -- 172.21.15.40:0/2733545677 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8018990 con 0x7faaf4103ff0 2024-09-11T22:30:03.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.410+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf41a71b0 con 0x7faaf4103ff0 2024-09-11T22:30:03.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.412+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf41043d0 con 0x7faaf4103ff0 2024-09-11T22:30:03.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.413+0000 7faaf1600640 1 -- 172.21.15.40:0/2733545677 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faae8010ac0 con 0x7faaf4103ff0 2024-09-11T22:30:03.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.414+0000 7faaf1600640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faadc0a2c10 0x7faadc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.415+0000 7faaf1600640 1 -- 172.21.15.40:0/2733545677 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7faae80cf870 con 0x7faaf4103ff0 2024-09-11T22:30:03.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.415+0000 7faaf3e00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faadc0a2c10 0x7faadc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.416+0000 7faaf3e00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faadc0a2c10 0x7faadc0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faae0000c00 tx=0x7faae0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:03.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.418+0000 7faaf1600640 1 -- 172.21.15.40:0/2733545677 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faae809bc90 con 0x7faaf4103ff0 2024-09-11T22:30:03.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:03 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/183592113' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T22:30:03.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:03 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/183592113' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T22:30:03.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.608+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7faaf419b990 con 0x7faaf4103ff0 2024-09-11T22:30:03.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.609+0000 7faaf1600640 1 -- 172.21.15.40:0/2733545677 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faae809ff90 con 0x7faaf4103ff0 2024-09-11T22:30:03.610 INFO:teuthology.orchestra.run.smithi040.stdout:158913790019 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faadc0a2c10 msgr2=0x7faadc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faadc0a2c10 0x7faadc0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faae0000c00 tx=0x7faae0005b50 comp rx=0 tx=0).stop 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4103ff0 msgr2=0x7faaf419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4103ff0 0x7faaf419a630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faae800e9f0 tx=0x7faae800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 shutdown_connections 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faadc0a2c10 0x7faadc0a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf4109120 0x7faaf419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faaf41049a0 0x7faaf419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 --2- 172.21.15.40:0/2733545677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faaf4103ff0 0x7faaf419a630 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 >> 172.21.15.40:0/2733545677 conn(0x7faaf40ffa90 msgr2=0x7faaf4100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 shutdown_connections 2024-09-11T22:30:03.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.611+0000 7faafba00640 1 -- 172.21.15.40:0/2733545677 wait complete. 2024-09-11T22:30:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.688+0000 7f23cd800640 1 -- 172.21.15.40:0/3729491618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c8108f60 msgr2=0x7f23c8110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.688+0000 7f23cd800640 1 --2- 172.21.15.40:0/3729491618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c8108f60 0x7f23c8110ae0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009ca0 tx=0x7f23c002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.688+0000 7f23cd800640 1 -- 172.21.15.40:0/3729491618 shutdown_connections 2024-09-11T22:30:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.688+0000 7f23cd800640 1 --2- 172.21.15.40:0/3729491618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c8108f60 0x7f23c8110ae0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.688+0000 7f23cd800640 1 --2- 172.21.15.40:0/3729491618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c81047e0 0x7f23c8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.688+0000 7f23cd800640 1 --2- 172.21.15.40:0/3729491618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23c8103e30 0x7f23c8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.688+0000 7f23cd800640 1 -- 172.21.15.40:0/3729491618 >> 172.21.15.40:0/3729491618 conn(0x7f23c80ff8d0 msgr2=0x7f23c8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.688+0000 7f23cd800640 1 -- 172.21.15.40:0/3729491618 shutdown_connections 2024-09-11T22:30:03.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.688+0000 7f23cd800640 1 -- 172.21.15.40:0/3729491618 wait complete. 2024-09-11T22:30:03.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.689+0000 7f23cd800640 1 Processor -- start 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.689+0000 7f23cd800640 1 -- start start 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23cd800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c8103e30 0x7f23c819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23cd800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23c81047e0 0x7f23c819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23cd800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c8108f60 0x7f23c819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23cd800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f23c8114010 con 0x7f23c8108f60 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23cd800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23c8113e90 con 0x7f23c8103e30 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23cd800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f23c8114190 con 0x7f23c81047e0 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23cce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c8108f60 0x7f23c819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23bfe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23c81047e0 0x7f23c819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23bfe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23c81047e0 0x7f23c819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:47410/0 (socket says 172.21.15.40:47410) 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23bfe00640 1 -- 172.21.15.40:0/2809952188 learned_addr learned my addr 172.21.15.40:0/2809952188 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.690+0000 7f23c7e00640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c8103e30 0x7f23c819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23cce00640 1 -- 172.21.15.40:0/2809952188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23c81047e0 msgr2=0x7f23c819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23cce00640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23c81047e0 0x7f23c819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23cce00640 1 -- 172.21.15.40:0/2809952188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c8103e30 msgr2=0x7f23c819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23cce00640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c8103e30 0x7f23c819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23cce00640 1 -- 172.21.15.40:0/2809952188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c819f3e0 con 0x7f23c8108f60 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23c7e00640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c8103e30 0x7f23c819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23cce00640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c8108f60 0x7f23c819ed00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f23c0005e30 tx=0x7f23c0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23c5600640 1 -- 172.21.15.40:0/2809952188 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c0031650 con 0x7f23c8108f60 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23c5600640 1 -- 172.21.15.40:0/2809952188 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c00317f0 con 0x7f23c8108f60 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23c5600640 1 -- 172.21.15.40:0/2809952188 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c002f990 con 0x7f23c8108f60 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.691+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c819f670 con 0x7f23c8108f60 2024-09-11T22:30:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.692+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c81a6fb0 con 0x7f23c8108f60 2024-09-11T22:30:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.693+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c8104210 con 0x7f23c8108f60 2024-09-11T22:30:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.694+0000 7f23c5600640 1 -- 172.21.15.40:0/2809952188 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f23c002fb30 con 0x7f23c8108f60 2024-09-11T22:30:03.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.696+0000 7f23c5600640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f23ac0a2c90 0x7f23ac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:03.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.696+0000 7f23c5600640 1 -- 172.21.15.40:0/2809952188 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f23c00f0740 con 0x7f23c8108f60 2024-09-11T22:30:03.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.696+0000 7f23c7e00640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f23ac0a2c90 0x7f23ac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.697+0000 7f23c7e00640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f23ac0a2c90 0x7f23ac0a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009fc0 tx=0x7f23b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:03.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.700+0000 7f23c5600640 1 -- 172.21.15.40:0/2809952188 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23c00319a0 con 0x7f23c8108f60 2024-09-11T22:30:03.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.888+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f23c810c1d0 con 0x7f23c8108f60 2024-09-11T22:30:03.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.888+0000 7f23c5600640 1 -- 172.21.15.40:0/2809952188 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f23c00bd2c0 con 0x7f23c8108f60 2024-09-11T22:30:03.890 INFO:teuthology.orchestra.run.smithi040.stdout:279172874286 2024-09-11T22:30:03.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f23ac0a2c90 msgr2=0x7f23ac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f23ac0a2c90 0x7f23ac0a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009fc0 tx=0x7f23b8005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c8108f60 msgr2=0x7f23c819ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c8108f60 0x7f23c819ed00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f23c0005e30 tx=0x7f23c0003f10 comp rx=0 tx=0).stop 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 shutdown_connections 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f23ac0a2c90 0x7f23ac0a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23c8108f60 0x7f23c819ed00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23c81047e0 0x7f23c819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 --2- 172.21.15.40:0/2809952188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c8103e30 0x7f23c819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 >> 172.21.15.40:0/2809952188 conn(0x7f23c80ff8d0 msgr2=0x7f23c8100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 shutdown_connections 2024-09-11T22:30:03.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:03.891+0000 7f23cd800640 1 -- 172.21.15.40:0/2809952188 wait complete. 2024-09-11T22:30:04.219 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:04 smithi040 ceph-mon[30787]: pgmap v358: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T22:30:04.219 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:04 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2733545677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T22:30:04.219 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:04 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2809952188' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T22:30:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.332+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2216141372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c41049a0 msgr2=0x7fd4c41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.332+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2216141372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c41049a0 0x7fd4c41089f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009900 tx=0x7fd4b002a400 comp rx=0 tx=0).stop 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.332+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2216141372 shutdown_connections 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.332+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2216141372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c4109120 0x7fd4c4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.332+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2216141372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c41049a0 0x7fd4c41089f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.332+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2216141372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c4103ff0 0x7fd4c41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.332+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2216141372 >> 172.21.15.40:0/2216141372 conn(0x7fd4c40ffa90 msgr2=0x7fd4c4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.332+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2216141372 shutdown_connections 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.332+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2216141372 wait complete. 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.333+0000 7fd4c8e00640 1 Processor -- start 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.333+0000 7fd4c8e00640 1 -- start start 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c8e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c4103ff0 0x7fd4c419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c8e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c41049a0 0x7fd4c419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c8e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c4109120 0x7fd4c419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c8e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4114170 con 0x7fd4c4109120 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c8e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4113ff0 con 0x7fd4c41049a0 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c8e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41142f0 con 0x7fd4c4103ff0 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c2800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c4109120 0x7fd4c419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c4103ff0 0x7fd4c419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c4103ff0 0x7fd4c419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:47438/0 (socket says 172.21.15.40:47438) 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c1e00640 1 -- 172.21.15.40:0/2464413692 learned_addr learned my addr 172.21.15.40:0/2464413692 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c1400640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c41049a0 0x7fd4c419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c1e00640 1 -- 172.21.15.40:0/2464413692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c41049a0 msgr2=0x7fd4c419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c1e00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c41049a0 0x7fd4c419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c1e00640 1 -- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c4109120 msgr2=0x7fd4c419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c1e00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c4109120 0x7fd4c419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c1e00640 1 -- 172.21.15.40:0/2464413692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c419f5e0 con 0x7fd4c4103ff0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.334+0000 7fd4c2800640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c4109120 0x7fd4c419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.335+0000 7fd4c1e00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c4103ff0 0x7fd4c419a630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400e9f0 tx=0x7fd4b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.335+0000 7fd4baa00640 1 -- 172.21.15.40:0/2464413692 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400cd80 con 0x7fd4c4103ff0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.335+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c419f8d0 con 0x7fd4c4103ff0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.335+0000 7fd4baa00640 1 -- 172.21.15.40:0/2464413692 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4b4010910 con 0x7fd4c4103ff0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.335+0000 7fd4baa00640 1 -- 172.21.15.40:0/2464413692 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40188f0 con 0x7fd4c4103ff0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.335+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c41a71b0 con 0x7fd4c4103ff0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.336+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c41043d0 con 0x7fd4c4103ff0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.338+0000 7fd4baa00640 1 -- 172.21.15.40:0/2464413692 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd4b4010ac0 con 0x7fd4c4103ff0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.339+0000 7fd4baa00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd4a80a2c10 0x7fd4a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.340+0000 7fd4baa00640 1 -- 172.21.15.40:0/2464413692 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fd4b40cf950 con 0x7fd4c4103ff0 2024-09-11T22:30:04.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.340+0000 7fd4c1400640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd4a80a2c10 0x7fd4a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:04.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.340+0000 7fd4c1400640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd4a80a2c10 0x7fd4a80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0000c00 tx=0x7fd4b0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:04.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.344+0000 7fd4baa00640 1 -- 172.21.15.40:0/2464413692 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4b409bd10 con 0x7fd4c4103ff0 2024-09-11T22:30:04.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:04 smithi177 ceph-mon[35530]: pgmap v358: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T22:30:04.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:04 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2733545677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T22:30:04.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:04 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2809952188' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T22:30:04.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.555+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd4c410c360 con 0x7fd4c4103ff0 2024-09-11T22:30:04.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.556+0000 7fd4baa00640 1 -- 172.21.15.40:0/2464413692 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4b40a0010 con 0x7fd4c4103ff0 2024-09-11T22:30:04.557 INFO:teuthology.orchestra.run.smithi040.stdout:77309411411 2024-09-11T22:30:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd4a80a2c10 msgr2=0x7fd4a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd4a80a2c10 0x7fd4a80a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0000c00 tx=0x7fd4b0005b50 comp rx=0 tx=0).stop 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c4103ff0 msgr2=0x7fd4c419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c4103ff0 0x7fd4c419a630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400e9f0 tx=0x7fd4b400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 shutdown_connections 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd4a80a2c10 0x7fd4a80a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4c4109120 0x7fd4c419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c41049a0 0x7fd4c419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 --2- 172.21.15.40:0/2464413692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4c4103ff0 0x7fd4c419a630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 >> 172.21.15.40:0/2464413692 conn(0x7fd4c40ffa90 msgr2=0x7fd4c4100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 shutdown_connections 2024-09-11T22:30:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:04.558+0000 7fd4c8e00640 1 -- 172.21.15.40:0/2464413692 wait complete. 2024-09-11T22:30:04.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:04 smithi146 ceph-mon[34996]: pgmap v358: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T22:30:04.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:04 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2733545677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T22:30:04.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:04 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2809952188' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T22:30:05.003 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874283 got 279172874286 for osd.9 2024-09-11T22:30:05.003 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:05 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2464413692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T22:30:05.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:05 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2464413692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T22:30:05.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:05 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2464413692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T22:30:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.551+0000 7f9235200640 1 -- 172.21.15.40:0/75109317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074510 msgr2=0x7f92300748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.551+0000 7f9235200640 1 --2- 172.21.15.40:0/75109317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074510 0x7f92300748f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9220009900 tx=0x7f922002a480 comp rx=0 tx=0).stop 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.551+0000 7f9235200640 1 -- 172.21.15.40:0/75109317 shutdown_connections 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.551+0000 7f9235200640 1 --2- 172.21.15.40:0/75109317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f923010e440 0x7f9230110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.551+0000 7f9235200640 1 --2- 172.21.15.40:0/75109317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9230074e30 0x7f923010df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.551+0000 7f9235200640 1 --2- 172.21.15.40:0/75109317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074510 0x7f92300748f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.551+0000 7f9235200640 1 -- 172.21.15.40:0/75109317 >> 172.21.15.40:0/75109317 conn(0x7f92300fd8c0 msgr2=0x7f92300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.551+0000 7f9235200640 1 -- 172.21.15.40:0/75109317 shutdown_connections 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.551+0000 7f9235200640 1 -- 172.21.15.40:0/75109317 wait complete. 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.552+0000 7f9235200640 1 Processor -- start 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.552+0000 7f9235200640 1 -- start start 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.552+0000 7f9235200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9230074510 0x7f923019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.552+0000 7f9235200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074e30 0x7f923019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.552+0000 7f9235200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f923010e440 0x7f923019dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.552+0000 7f9235200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f92301141c0 con 0x7f9230074e30 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.552+0000 7f9235200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9230114040 con 0x7f923010e440 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.552+0000 7f9235200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9230114340 con 0x7f9230074510 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f9225400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074e30 0x7f923019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f9225400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074e30 0x7f923019acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39480/0 (socket says 172.21.15.40:39480) 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f9225400640 1 -- 172.21.15.40:0/2347541897 learned_addr learned my addr 172.21.15.40:0/2347541897 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f922de00640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9230074510 0x7f923019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f922e800640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f923010e440 0x7f923019dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f9225400640 1 -- 172.21.15.40:0/2347541897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9230074510 msgr2=0x7f923019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f9225400640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9230074510 0x7f923019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f9225400640 1 -- 172.21.15.40:0/2347541897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f923010e440 msgr2=0x7f923019dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f9225400640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f923010e440 0x7f923019dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f9225400640 1 -- 172.21.15.40:0/2347541897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923019e6d0 con 0x7f9230074e30 2024-09-11T22:30:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.553+0000 7f9225400640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074e30 0x7f923019acc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f921800e9f0 tx=0x7f921800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.554+0000 7f9227400640 1 -- 172.21.15.40:0/2347541897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921800cd80 con 0x7f9230074e30 2024-09-11T22:30:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.554+0000 7f9227400640 1 -- 172.21.15.40:0/2347541897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9218010910 con 0x7f9230074e30 2024-09-11T22:30:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.554+0000 7f9227400640 1 -- 172.21.15.40:0/2347541897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218018990 con 0x7f9230074e30 2024-09-11T22:30:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.554+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923019e9c0 con 0x7f9230074e30 2024-09-11T22:30:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.554+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92301a7330 con 0x7f9230074e30 2024-09-11T22:30:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.555+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92300748f0 con 0x7f9230074e30 2024-09-11T22:30:05.990 INFO:teuthology.orchestra.run.smithi040.stdout:137438953545 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.557+0000 7f9227400640 1 -- 172.21.15.40:0/2347541897 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9218010ac0 con 0x7f9230074e30 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.558+0000 7f9227400640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f92140a2c90 0x7f92140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.558+0000 7f9227400640 1 -- 172.21.15.40:0/2347541897 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f92180cf830 con 0x7f9230074e30 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.558+0000 7f922de00640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f92140a2c90 0x7f92140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.559+0000 7f922de00640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f92140a2c90 0x7f92140a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9220000c00 tx=0x7f9220005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.562+0000 7f9227400640 1 -- 172.21.15.40:0/2347541897 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f921809bbf0 con 0x7f9230074e30 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.761+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f92301095c0 con 0x7f9230074e30 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f9227400640 1 -- 172.21.15.40:0/2347541897 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f921809fef0 con 0x7f9230074e30 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f92140a2c90 msgr2=0x7f92140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f92140a2c90 0x7f92140a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9220000c00 tx=0x7f9220005b50 comp rx=0 tx=0).stop 2024-09-11T22:30:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074e30 msgr2=0x7f923019acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:05.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074e30 0x7f923019acc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f921800e9f0 tx=0x7f921800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 shutdown_connections 2024-09-11T22:30:05.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f92140a2c90 0x7f92140a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f923010e440 0x7f923019dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9230074e30 0x7f923019acc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 --2- 172.21.15.40:0/2347541897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9230074510 0x7f923019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:05.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 >> 172.21.15.40:0/2347541897 conn(0x7f92300fd8c0 msgr2=0x7f92300fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:05.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 shutdown_connections 2024-09-11T22:30:05.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.766+0000 7f9235200640 1 -- 172.21.15.40:0/2347541897 wait complete. 2024-09-11T22:30:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.759+0000 7f918f600640 1 -- 172.21.15.40:0/3606209742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f918810c590 msgr2=0x7f918810c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.759+0000 7f918f600640 1 --2- 172.21.15.40:0/3606209742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f918810c590 0x7f918810c9f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9174009890 tx=0x7f917402a370 comp rx=0 tx=0).stop 2024-09-11T22:30:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.759+0000 7f918f600640 1 -- 172.21.15.40:0/3606209742 shutdown_connections 2024-09-11T22:30:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.759+0000 7f918f600640 1 --2- 172.21.15.40:0/3606209742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f918810cf30 0x7f9188119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.759+0000 7f918f600640 1 --2- 172.21.15.40:0/3606209742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f918810c590 0x7f918810c9f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.759+0000 7f918f600640 1 --2- 172.21.15.40:0/3606209742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9188112640 0x7f9188112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.759+0000 7f918f600640 1 -- 172.21.15.40:0/3606209742 >> 172.21.15.40:0/3606209742 conn(0x7f918806cdc0 msgr2=0x7f918806d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.760+0000 7f918f600640 1 -- 172.21.15.40:0/3606209742 shutdown_connections 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.760+0000 7f918f600640 1 -- 172.21.15.40:0/3606209742 wait complete. 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.761+0000 7f918f600640 1 Processor -- start 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.761+0000 7f918f600640 1 -- start start 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f918f600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f918810c590 0x7f91881a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f918f600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f918810cf30 0x7f91881a3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f918f600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9188112640 0x7f91881a7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f918f600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f918811c9a0 con 0x7f918810cf30 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f918f600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f918811c820 con 0x7f9188112640 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f918f600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f918811cb20 con 0x7f918810c590 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f9187e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f918810cf30 0x7f91881a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f9187e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f918810cf30 0x7f91881a3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39498/0 (socket says 172.21.15.40:39498) 2024-09-11T22:30:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f9187e00640 1 -- 172.21.15.40:0/4165074145 learned_addr learned my addr 172.21.15.40:0/4165074145 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.762+0000 7f918d600640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9188112640 0x7f91881a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.763+0000 7f918cc00640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f918810c590 0x7f91881a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.763+0000 7f918cc00640 1 -- 172.21.15.40:0/4165074145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9188112640 msgr2=0x7f91881a7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.763+0000 7f918cc00640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9188112640 0x7f91881a7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.763+0000 7f918cc00640 1 -- 172.21.15.40:0/4165074145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f918810cf30 msgr2=0x7f91881a3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.763+0000 7f918cc00640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f918810cf30 0x7f91881a3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.763+0000 7f918cc00640 1 -- 172.21.15.40:0/4165074145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91881a7df0 con 0x7f918810c590 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.763+0000 7f918cc00640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f918810c590 0x7f91881a2e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f917c00e9f0 tx=0x7f917c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.764+0000 7f9185600640 1 -- 172.21.15.40:0/4165074145 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c00ccc0 con 0x7f918810c590 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.764+0000 7f9185600640 1 -- 172.21.15.40:0/4165074145 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f917c005020 con 0x7f918810c590 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.764+0000 7f9185600640 1 -- 172.21.15.40:0/4165074145 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c004b20 con 0x7f918810c590 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.764+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91881a80e0 con 0x7f918810c590 2024-09-11T22:30:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.765+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91881af9c0 con 0x7f918810c590 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.767+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918810dcb0 con 0x7f918810c590 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.768+0000 7f9185600640 1 -- 172.21.15.40:0/4165074145 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f917c004cc0 con 0x7f918810c590 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.769+0000 7f9185600640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f91700a2c90 0x7f91700a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.769+0000 7f9185600640 1 -- 172.21.15.40:0/4165074145 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f917c0cf4c0 con 0x7f918810c590 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.769+0000 7f9187e00640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f91700a2c90 0x7f91700a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.770+0000 7f9187e00640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f91700a2c90 0x7f91700a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9174030520 tx=0x7f91740094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.773+0000 7f9185600640 1 -- 172.21.15.40:0/4165074145 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f917c09bed0 con 0x7f918810c590 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.988+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9188114a60 con 0x7f918810c590 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.988+0000 7f9185600640 1 -- 172.21.15.40:0/4165074145 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f917c09b7d0 con 0x7f918810c590 2024-09-11T22:30:06.394 INFO:teuthology.orchestra.run.smithi040.stdout:214748364857 2024-09-11T22:30:06.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.990+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f91700a2c90 msgr2=0x7f91700a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.990+0000 7f918f600640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f91700a2c90 0x7f91700a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9174030520 tx=0x7f91740094b0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.990+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f918810c590 msgr2=0x7f91881a2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.990+0000 7f918f600640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f918810c590 0x7f91881a2e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f917c00e9f0 tx=0x7f917c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.991+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 shutdown_connections 2024-09-11T22:30:06.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.991+0000 7f918f600640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f91700a2c90 0x7f91700a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.991+0000 7f918f600640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9188112640 0x7f91881a7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.991+0000 7f918f600640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f918810cf30 0x7f91881a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.991+0000 7f918f600640 1 --2- 172.21.15.40:0/4165074145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f918810c590 0x7f91881a2e40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.991+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 >> 172.21.15.40:0/4165074145 conn(0x7f918806cdc0 msgr2=0x7f918810af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:06.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.991+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 shutdown_connections 2024-09-11T22:30:06.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.991+0000 7f918f600640 1 -- 172.21.15.40:0/4165074145 wait complete. 2024-09-11T22:30:06.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:06 smithi040 ceph-mon[30787]: pgmap v359: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:06.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:06 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2347541897' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T22:30:06.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:06 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/4165074145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T22:30:06.396 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:06 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1282619115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T22:30:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:06 smithi177 ceph-mon[35530]: pgmap v359: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:06 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2347541897' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T22:30:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:06 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/4165074145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T22:30:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:06 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1282619115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T22:30:06.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:06 smithi146 ceph-mon[34996]: pgmap v359: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:06.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:06 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2347541897' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T22:30:06.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:06 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/4165074145' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T22:30:06.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:06 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1282619115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T22:30:06.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.882+0000 7fa219000640 1 -- 172.21.15.40:0/2267160382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2141019c0 msgr2=0x7fa214101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.882+0000 7fa219000640 1 --2- 172.21.15.40:0/2267160382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2141019c0 0x7fa214101e20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009930 tx=0x7fa1fc02a420 comp rx=0 tx=0).stop 2024-09-11T22:30:06.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.882+0000 7fa219000640 1 -- 172.21.15.40:0/2267160382 shutdown_connections 2024-09-11T22:30:06.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.882+0000 7fa219000640 1 --2- 172.21.15.40:0/2267160382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa214102360 0x7fa21410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.882+0000 7fa219000640 1 --2- 172.21.15.40:0/2267160382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2141019c0 0x7fa214101e20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.882+0000 7fa219000640 1 --2- 172.21.15.40:0/2267160382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2141079c0 0x7fa214107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.882+0000 7fa219000640 1 -- 172.21.15.40:0/2267160382 >> 172.21.15.40:0/2267160382 conn(0x7fa2140fd740 msgr2=0x7fa2140ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:06.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.882+0000 7fa219000640 1 -- 172.21.15.40:0/2267160382 shutdown_connections 2024-09-11T22:30:06.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.882+0000 7fa219000640 1 -- 172.21.15.40:0/2267160382 wait complete. 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.883+0000 7fa219000640 1 Processor -- start 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.883+0000 7fa219000640 1 -- start start 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.883+0000 7fa219000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2141019c0 0x7fa2140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.883+0000 7fa219000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa214102360 0x7fa214074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa219000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2141079c0 0x7fa214074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa219000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa214111dc0 con 0x7fa2141019c0 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa219000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa214111c40 con 0x7fa214102360 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa219000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa214111f40 con 0x7fa2141079c0 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa213400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2141019c0 0x7fa2140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa213400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2141019c0 0x7fa2140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39516/0 (socket says 172.21.15.40:39516) 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa20be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa214102360 0x7fa214074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa213400640 1 -- 172.21.15.40:0/1282619115 learned_addr learned my addr 172.21.15.40:0/1282619115 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa213e00640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2141079c0 0x7fa214074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa213400640 1 -- 172.21.15.40:0/1282619115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2141079c0 msgr2=0x7fa214074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa213400640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2141079c0 0x7fa214074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa213400640 1 -- 172.21.15.40:0/1282619115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa214102360 msgr2=0x7fa214074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa213400640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa214102360 0x7fa214074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.884+0000 7fa213400640 1 -- 172.21.15.40:0/1282619115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2141a6760 con 0x7fa2141019c0 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.885+0000 7fa213400640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2141019c0 0x7fa2140744f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa20400ea60 tx=0x7fa20400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.885+0000 7fa210c00640 1 -- 172.21.15.40:0/1282619115 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20400cde0 con 0x7fa2141019c0 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.885+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2141a6a50 con 0x7fa2141019c0 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.885+0000 7fa210c00640 1 -- 172.21.15.40:0/1282619115 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2040035f0 con 0x7fa2141019c0 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.885+0000 7fa210c00640 1 -- 172.21.15.40:0/1282619115 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204010670 con 0x7fa2141019c0 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.885+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2141a6fb0 con 0x7fa2141019c0 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.886+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa214101e20 con 0x7fa2141019c0 2024-09-11T22:30:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.888+0000 7fa210c00640 1 -- 172.21.15.40:0/1282619115 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa2040037a0 con 0x7fa2141019c0 2024-09-11T22:30:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.889+0000 7fa210c00640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1f80a2c90 0x7fa1f80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.890+0000 7fa210c00640 1 -- 172.21.15.40:0/1282619115 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fa2040cf7f0 con 0x7fa2141019c0 2024-09-11T22:30:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.890+0000 7fa20be00640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1f80a2c90 0x7fa1f80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.890+0000 7fa20be00640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1f80a2c90 0x7fa1f80a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009900 tx=0x7fa1fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:05.893+0000 7fa210c00640 1 -- 172.21.15.40:0/1282619115 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa20409c200 con 0x7fa2141019c0 2024-09-11T22:30:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.086+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa21402d7c0 con 0x7fa2141019c0 2024-09-11T22:30:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.087+0000 7fa210c00640 1 -- 172.21.15.40:0/1282619115 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa20409bb00 con 0x7fa2141019c0 2024-09-11T22:30:06.704 INFO:teuthology.orchestra.run.smithi040.stdout:193273528382 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1f80a2c90 msgr2=0x7fa1f80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1f80a2c90 0x7fa1f80a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009900 tx=0x7fa1fc0058d0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2141019c0 msgr2=0x7fa2140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2141019c0 0x7fa2140744f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa20400ea60 tx=0x7fa20400ef20 comp rx=0 tx=0).stop 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 shutdown_connections 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1f80a2c90 0x7fa1f80a5150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2141079c0 0x7fa214074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa214102360 0x7fa214074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 --2- 172.21.15.40:0/1282619115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2141019c0 0x7fa2140744f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 >> 172.21.15.40:0/1282619115 conn(0x7fa2140fd740 msgr2=0x7fa2140fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 shutdown_connections 2024-09-11T22:30:06.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:06.089+0000 7fa219000640 1 -- 172.21.15.40:0/1282619115 wait complete. 2024-09-11T22:30:07.508 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135919 got 244813135922 for osd.8 2024-09-11T22:30:07.508 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:07.835 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411407 got 77309411411 for osd.2 2024-09-11T22:30:07.835 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:08.299 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364854 got 214748364857 for osd.7 2024-09-11T22:30:08.300 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:08.416 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:08 smithi040 ceph-mon[30787]: pgmap v360: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T22:30:08.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:08 smithi177 ceph-mon[35530]: pgmap v360: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T22:30:08.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:08 smithi146 ceph-mon[34996]: pgmap v360: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T22:30:08.907 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790017 got 158913790019 for osd.5 2024-09-11T22:30:08.908 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:09.361 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528378 got 193273528382 for osd.6 2024-09-11T22:30:09.361 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:09.817 INFO:teuthology.orchestra.run.smithi040.stdout:330712481827 2024-09-11T22:30:09.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T22:30:10.290 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574934 got 55834574936 for osd.1 2024-09-11T22:30:10.290 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:10.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:10 smithi040 ceph-mon[30787]: pgmap v361: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T22:30:10.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:10 smithi177 ceph-mon[35530]: pgmap v361: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T22:30:10.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:10 smithi146 ceph-mon[34996]: pgmap v361: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T22:30:10.859 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:10.860 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:10.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953542 got 137438953545 for osd.4 2024-09-11T22:30:10.884 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:10.928 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:11.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.749+0000 7fc606200640 1 -- 172.21.15.40:0/2326270832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6001019c0 msgr2=0x7fc600101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.749+0000 7fc606200640 1 --2- 172.21.15.40:0/2326270832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6001019c0 0x7fc600101e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009890 tx=0x7fc5ec02a360 comp rx=0 tx=0).stop 2024-09-11T22:30:11.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.749+0000 7fc606200640 1 -- 172.21.15.40:0/2326270832 shutdown_connections 2024-09-11T22:30:11.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.749+0000 7fc606200640 1 --2- 172.21.15.40:0/2326270832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc600102360 0x7fc60010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.749+0000 7fc606200640 1 --2- 172.21.15.40:0/2326270832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6001019c0 0x7fc600101e20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.749+0000 7fc606200640 1 --2- 172.21.15.40:0/2326270832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6001079c0 0x7fc600107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.749+0000 7fc606200640 1 -- 172.21.15.40:0/2326270832 >> 172.21.15.40:0/2326270832 conn(0x7fc6000fd740 msgr2=0x7fc6000ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:11.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.749+0000 7fc606200640 1 -- 172.21.15.40:0/2326270832 shutdown_connections 2024-09-11T22:30:11.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.749+0000 7fc606200640 1 -- 172.21.15.40:0/2326270832 wait complete. 2024-09-11T22:30:11.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.751+0000 7fc606200640 1 Processor -- start 2024-09-11T22:30:11.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.751+0000 7fc606200640 1 -- start start 2024-09-11T22:30:11.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.751+0000 7fc606200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6001019c0 0x7fc6000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:11.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.751+0000 7fc606200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc600102360 0x7fc600074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.751+0000 7fc606200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001079c0 0x7fc600074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.751+0000 7fc606200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc600111dc0 con 0x7fc6001079c0 2024-09-11T22:30:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.751+0000 7fc606200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc600111c40 con 0x7fc600102360 2024-09-11T22:30:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.751+0000 7fc606200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc600111f40 con 0x7fc6001019c0 2024-09-11T22:30:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc605800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001079c0 0x7fc600074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc604e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6001019c0 0x7fc6000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc605800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001079c0 0x7fc600074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39566/0 (socket says 172.21.15.40:39566) 2024-09-11T22:30:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc5ffe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc600102360 0x7fc600074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:11.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc604e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6001019c0 0x7fc6000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:47508/0 (socket says 172.21.15.40:47508) 2024-09-11T22:30:11.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc605800640 1 -- 172.21.15.40:0/383126334 learned_addr learned my addr 172.21.15.40:0/383126334 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:11.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc5ffe00640 1 -- 172.21.15.40:0/383126334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6001019c0 msgr2=0x7fc6000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc5ffe00640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6001019c0 0x7fc6000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc5ffe00640 1 -- 172.21.15.40:0/383126334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001079c0 msgr2=0x7fc600074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc5ffe00640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001079c0 0x7fc600074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.752+0000 7fc5ffe00640 1 -- 172.21.15.40:0/383126334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6001a67d0 con 0x7fc600102360 2024-09-11T22:30:11.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.753+0000 7fc5ffe00640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc600102360 0x7fc600074a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec035040 tx=0x7fc5ec033ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:11.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.753+0000 7fc5fd600640 1 -- 172.21.15.40:0/383126334 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec037040 con 0x7fc600102360 2024-09-11T22:30:11.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.753+0000 7fc5fd600640 1 -- 172.21.15.40:0/383126334 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5ec033d90 con 0x7fc600102360 2024-09-11T22:30:11.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.753+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6001a6a60 con 0x7fc600102360 2024-09-11T22:30:11.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.753+0000 7fc5fd600640 1 -- 172.21.15.40:0/383126334 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec003830 con 0x7fc600102360 2024-09-11T22:30:11.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.753+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6001a6f40 con 0x7fc600102360 2024-09-11T22:30:11.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.754+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc600101e20 con 0x7fc600102360 2024-09-11T22:30:11.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.756+0000 7fc5fd600640 1 -- 172.21.15.40:0/383126334 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc5ec042020 con 0x7fc600102360 2024-09-11T22:30:11.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.758+0000 7fc5fd600640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc5e80a2c10 0x7fc5e80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:11.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.758+0000 7fc5fd600640 1 -- 172.21.15.40:0/383126334 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fc5ec0ef0f0 con 0x7fc600102360 2024-09-11T22:30:11.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.758+0000 7fc604e00640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc5e80a2c10 0x7fc5e80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:11.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.759+0000 7fc604e00640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc5e80a2c10 0x7fc5e80a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40096c0 tx=0x7fc5f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:11.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.760+0000 7fc5fd600640 1 -- 172.21.15.40:0/383126334 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5ec049020 con 0x7fc600102360 2024-09-11T22:30:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.653+0000 7f573b200640 1 -- 172.21.15.40:0/2289904889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57341079c0 msgr2=0x7f5734107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.653+0000 7f573b200640 1 --2- 172.21.15.40:0/2289904889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57341079c0 0x7f5734107da0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5728009930 tx=0x7f572802a420 comp rx=0 tx=0).stop 2024-09-11T22:30:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.653+0000 7f573b200640 1 -- 172.21.15.40:0/2289904889 shutdown_connections 2024-09-11T22:30:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.653+0000 7f573b200640 1 --2- 172.21.15.40:0/2289904889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5734102360 0x7f573410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.653+0000 7f573b200640 1 --2- 172.21.15.40:0/2289904889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57341019c0 0x7f5734101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.653+0000 7f573b200640 1 --2- 172.21.15.40:0/2289904889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57341079c0 0x7f5734107da0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.653+0000 7f573b200640 1 -- 172.21.15.40:0/2289904889 >> 172.21.15.40:0/2289904889 conn(0x7f57340fd740 msgr2=0x7f57340ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.653+0000 7f573b200640 1 -- 172.21.15.40:0/2289904889 shutdown_connections 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.653+0000 7f573b200640 1 -- 172.21.15.40:0/2289904889 wait complete. 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.654+0000 7f573b200640 1 Processor -- start 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.654+0000 7f573b200640 1 -- start start 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f573b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57341019c0 0x7f57341982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f573b200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734102360 0x7f57341987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f573b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57341079c0 0x7f573419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f573b200640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5734111dd0 con 0x7f5734102360 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f573b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5734111c50 con 0x7f57341079c0 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f573b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5734111f50 con 0x7f57341019c0 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f5739400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734102360 0x7f57341987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:11.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f5739e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57341019c0 0x7f57341982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f5739400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734102360 0x7f57341987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39546/0 (socket says 172.21.15.40:39546) 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f5739400640 1 -- 172.21.15.40:0/342715948 learned_addr learned my addr 172.21.15.40:0/342715948 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f573a800640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57341079c0 0x7f573419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.655+0000 7f5739400640 1 -- 172.21.15.40:0/342715948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57341019c0 msgr2=0x7f57341982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f5739400640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57341019c0 0x7f57341982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f5739400640 1 -- 172.21.15.40:0/342715948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57341079c0 msgr2=0x7f573419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f5739400640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57341079c0 0x7f573419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f5739400640 1 -- 172.21.15.40:0/342715948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573419d260 con 0x7f5734102360 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f5739e00640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57341019c0 0x7f57341982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f573a800640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57341079c0 0x7f573419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f5739400640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734102360 0x7f57341987f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f572400d950 tx=0x7f572400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:11.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f572ea00640 1 -- 172.21.15.40:0/342715948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5724017030 con 0x7f5734102360 2024-09-11T22:30:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573419d550 con 0x7f5734102360 2024-09-11T22:30:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f572ea00640 1 -- 172.21.15.40:0/342715948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5724004020 con 0x7f5734102360 2024-09-11T22:30:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f572ea00640 1 -- 172.21.15.40:0/342715948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57240047a0 con 0x7f5734102360 2024-09-11T22:30:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.656+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57341a4e30 con 0x7f5734102360 2024-09-11T22:30:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.658+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5734101e20 con 0x7f5734102360 2024-09-11T22:30:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.661+0000 7f572ea00640 1 -- 172.21.15.40:0/342715948 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f57240041d0 con 0x7f5734102360 2024-09-11T22:30:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.662+0000 7f572ea00640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f571c0a2c10 0x7f571c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:11.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.662+0000 7f572ea00640 1 -- 172.21.15.40:0/342715948 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f57240cf530 con 0x7f5734102360 2024-09-11T22:30:11.871 INFO:teuthology.orchestra.run.smithi040.stdout:300647710761 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.662+0000 7f5739e00640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f571c0a2c10 0x7f571c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.663+0000 7f5739e00640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f571c0a2c10 0x7f571c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5728006010 tx=0x7f5728031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.664+0000 7f572ea00640 1 -- 172.21.15.40:0/342715948 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f572409bfa0 con 0x7f5734102360 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.853+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5734109f90 con 0x7f5734102360 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.854+0000 7f572ea00640 1 -- 172.21.15.40:0/342715948 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f572409b8a0 con 0x7f5734102360 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f571c0a2c10 msgr2=0x7f571c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f571c0a2c10 0x7f571c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5728006010 tx=0x7f5728031510 comp rx=0 tx=0).stop 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734102360 msgr2=0x7f57341987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734102360 0x7f57341987f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f572400d950 tx=0x7f572400de10 comp rx=0 tx=0).stop 2024-09-11T22:30:11.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 shutdown_connections 2024-09-11T22:30:11.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f571c0a2c10 0x7f571c0a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57341079c0 0x7f573419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734102360 0x7f57341987f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 --2- 172.21.15.40:0/342715948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57341019c0 0x7f57341982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 >> 172.21.15.40:0/342715948 conn(0x7f57340fd740 msgr2=0x7f57340fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:11.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 shutdown_connections 2024-09-11T22:30:11.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.856+0000 7f573b200640 1 -- 172.21.15.40:0/342715948 wait complete. 2024-09-11T22:30:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.949+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fc600109f30 con 0x7fc600102360 2024-09-11T22:30:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.949+0000 7fc5fd600640 1 -- 172.21.15.40:0/383126334 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc5ec0bbc10 con 0x7fc600102360 2024-09-11T22:30:11.951 INFO:teuthology.orchestra.run.smithi040.stdout:330712481829 2024-09-11T22:30:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc5e80a2c10 msgr2=0x7fc5e80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc5e80a2c10 0x7fc5e80a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40096c0 tx=0x7fc5f4009260 comp rx=0 tx=0).stop 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc600102360 msgr2=0x7fc600074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc600102360 0x7fc600074a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec035040 tx=0x7fc5ec033ae0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 shutdown_connections 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fc5e80a2c10 0x7fc5e80a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001079c0 0x7fc600074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc600102360 0x7fc600074a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 --2- 172.21.15.40:0/383126334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6001019c0 0x7fc6000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 >> 172.21.15.40:0/383126334 conn(0x7fc6000fd740 msgr2=0x7fc6000fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 shutdown_connections 2024-09-11T22:30:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:11.952+0000 7fc606200640 1 -- 172.21.15.40:0/383126334 wait complete. 2024-09-11T22:30:12.416 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:12 smithi040 ceph-mon[30787]: pgmap v362: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:30:12.417 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:12 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/342715948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T22:30:12.417 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:12 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/383126334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T22:30:12.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:12 smithi177 ceph-mon[35530]: pgmap v362: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:30:12.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:12 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/342715948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T22:30:12.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:12 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/383126334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T22:30:12.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:12 smithi146 ceph-mon[34996]: pgmap v362: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:30:12.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:12 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/342715948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T22:30:12.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:12 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/383126334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T22:30:12.785 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710758 got 300647710761 for osd.10 2024-09-11T22:30:12.786 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:13.475 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481827 got 330712481829 for osd.11 2024-09-11T22:30:13.475 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.660+0000 7f56a1e00640 1 -- 172.21.15.40:0/3656387849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c108f60 msgr2=0x7f569c110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.660+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3656387849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c108f60 0x7f569c110ae0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5694009ca0 tx=0x7f569402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.660+0000 7f56a1e00640 1 -- 172.21.15.40:0/3656387849 shutdown_connections 2024-09-11T22:30:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.660+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3656387849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c108f60 0x7f569c110ae0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.660+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3656387849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f569c1047e0 0x7f569c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.660+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3656387849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c103e30 0x7f569c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.660+0000 7f56a1e00640 1 -- 172.21.15.40:0/3656387849 >> 172.21.15.40:0/3656387849 conn(0x7f569c0ff8d0 msgr2=0x7f569c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.660+0000 7f56a1e00640 1 -- 172.21.15.40:0/3656387849 shutdown_connections 2024-09-11T22:30:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.660+0000 7f56a1e00640 1 -- 172.21.15.40:0/3656387849 wait complete. 2024-09-11T22:30:13.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.661+0000 7f56a1e00640 1 Processor -- start 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f56a1e00640 1 -- start start 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f56a1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f569c103e30 0x7f569c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f56a1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c1047e0 0x7f569c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f56a1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c108f60 0x7f569c19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f56a1e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f569c114010 con 0x7f569c1047e0 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f56a1e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f569c113e90 con 0x7f569c108f60 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f56a1e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f569c114190 con 0x7f569c103e30 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f569be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c1047e0 0x7f569c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f56a0a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f569c103e30 0x7f569c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f569be00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c1047e0 0x7f569c19a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47432/0 (socket says 172.21.15.40:47432) 2024-09-11T22:30:13.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f569be00640 1 -- 172.21.15.40:0/3480753242 learned_addr learned my addr 172.21.15.40:0/3480753242 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:13.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.662+0000 7f56a1400640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c108f60 0x7f569c19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f569be00640 1 -- 172.21.15.40:0/3480753242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f569c103e30 msgr2=0x7f569c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f569be00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f569c103e30 0x7f569c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f569be00640 1 -- 172.21.15.40:0/3480753242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c108f60 msgr2=0x7f569c19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f569be00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c108f60 0x7f569c19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f569be00640 1 -- 172.21.15.40:0/3480753242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569c19f400 con 0x7f569c1047e0 2024-09-11T22:30:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f56a0a00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f569c103e30 0x7f569c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f569be00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c1047e0 0x7f569c19a990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f568800e9f0 tx=0x7f568800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:13.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f5699600640 1 -- 172.21.15.40:0/3480753242 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568800cd80 con 0x7f569c1047e0 2024-09-11T22:30:13.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f5699600640 1 -- 172.21.15.40:0/3480753242 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5688005500 con 0x7f569c1047e0 2024-09-11T22:30:13.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569c19f6f0 con 0x7f569c1047e0 2024-09-11T22:30:13.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.663+0000 7f5699600640 1 -- 172.21.15.40:0/3480753242 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688010690 con 0x7f569c1047e0 2024-09-11T22:30:13.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.664+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f569c1a6fd0 con 0x7f569c1047e0 2024-09-11T22:30:13.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.665+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569c104210 con 0x7f569c1047e0 2024-09-11T22:30:13.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.667+0000 7f5699600640 1 -- 172.21.15.40:0/3480753242 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f56880046c0 con 0x7f569c1047e0 2024-09-11T22:30:13.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.668+0000 7f5699600640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56840a2c10 0x7f56840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.669+0000 7f5699600640 1 -- 172.21.15.40:0/3480753242 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f56880cf960 con 0x7f569c1047e0 2024-09-11T22:30:13.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.669+0000 7f56a0a00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56840a2c10 0x7f56840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:13.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.669+0000 7f56a0a00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56840a2c10 0x7f56840a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5690009fc0 tx=0x7f5690005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:13.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.672+0000 7f5699600640 1 -- 172.21.15.40:0/3480753242 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f568809c370 con 0x7f569c1047e0 2024-09-11T22:30:13.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.860+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f569c10bbb0 con 0x7f569c1047e0 2024-09-11T22:30:13.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.860+0000 7f5699600640 1 -- 172.21.15.40:0/3480753242 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f568809bc70 con 0x7f569c1047e0 2024-09-11T22:30:13.862 INFO:teuthology.orchestra.run.smithi040.stdout:34359738463 2024-09-11T22:30:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56840a2c10 msgr2=0x7f56840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:13.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56840a2c10 0x7f56840a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5690009fc0 tx=0x7f5690005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c1047e0 msgr2=0x7f569c19a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c1047e0 0x7f569c19a990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f568800e9f0 tx=0x7f568800edf0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 shutdown_connections 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f56840a2c10 0x7f56840a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c108f60 0x7f569c19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f569c1047e0 0x7f569c19a990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 --2- 172.21.15.40:0/3480753242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f569c103e30 0x7f569c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 >> 172.21.15.40:0/3480753242 conn(0x7f569c0ff8d0 msgr2=0x7f569c100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 shutdown_connections 2024-09-11T22:30:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:13.863+0000 7f56a1e00640 1 -- 172.21.15.40:0/3480753242 wait complete. 2024-09-11T22:30:14.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:14 smithi040 ceph-mon[30787]: pgmap v363: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:14.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:14 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3480753242' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T22:30:14.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:14 smithi177 ceph-mon[35530]: pgmap v363: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:14.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:14 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3480753242' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T22:30:14.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:14 smithi146 ceph-mon[34996]: pgmap v363: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:14.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:14 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3480753242' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T22:30:14.617 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738459 got 34359738463 for osd.0 2024-09-11T22:30:14.618 DEBUG:teuthology.parallel:result is None 2024-09-11T22:30:14.618 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T22:30:14.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:30:14.997 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:15.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.544+0000 7f16ec800640 1 -- 172.21.15.40:0/3785638058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 msgr2=0x7f16e4110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.544+0000 7f16ec800640 1 --2- 172.21.15.40:0/3785638058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 0x7f16e4110ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009ca0 tx=0x7f16e002a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.544+0000 7f16ec800640 1 -- 172.21.15.40:0/3785638058 shutdown_connections 2024-09-11T22:30:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.544+0000 7f16ec800640 1 --2- 172.21.15.40:0/3785638058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 0x7f16e4110ca0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.544+0000 7f16ec800640 1 --2- 172.21.15.40:0/3785638058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16e41049a0 0x7f16e41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.544+0000 7f16ec800640 1 --2- 172.21.15.40:0/3785638058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e4103ff0 0x7f16e41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.544+0000 7f16ec800640 1 -- 172.21.15.40:0/3785638058 >> 172.21.15.40:0/3785638058 conn(0x7f16e40ffa90 msgr2=0x7f16e4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.544+0000 7f16ec800640 1 -- 172.21.15.40:0/3785638058 shutdown_connections 2024-09-11T22:30:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.544+0000 7f16ec800640 1 -- 172.21.15.40:0/3785638058 wait complete. 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.545+0000 7f16ec800640 1 Processor -- start 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.545+0000 7f16ec800640 1 -- start start 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.545+0000 7f16ec800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e4103ff0 0x7f16e419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.545+0000 7f16ec800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16e41049a0 0x7f16e419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.545+0000 7f16ec800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 0x7f16e419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.545+0000 7f16ec800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4114150 con 0x7f16e4109120 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.545+0000 7f16ec800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4113fd0 con 0x7f16e41049a0 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.545+0000 7f16ec800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41142d0 con 0x7f16e4103ff0 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 0x7f16e419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16e9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e4103ff0 0x7f16e419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16ea800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 0x7f16e419ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47454/0 (socket says 172.21.15.40:47454) 2024-09-11T22:30:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16ea800640 1 -- 172.21.15.40:0/3235073737 learned_addr learned my addr 172.21.15.40:0/3235073737 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16e9400640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16e41049a0 0x7f16e419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16ea800640 1 -- 172.21.15.40:0/3235073737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e4103ff0 msgr2=0x7f16e419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16ea800640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e4103ff0 0x7f16e419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16ea800640 1 -- 172.21.15.40:0/3235073737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16e41049a0 msgr2=0x7f16e419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16ea800640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16e41049a0 0x7f16e419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.546+0000 7f16ea800640 1 -- 172.21.15.40:0/3235073737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e419f560 con 0x7f16e4109120 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.547+0000 7f16ea800640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 0x7f16e419ee80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f16e0031a20 tx=0x7f16e0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.547+0000 7f16dea00640 1 -- 172.21.15.40:0/3235073737 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0003c30 con 0x7f16e4109120 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.547+0000 7f16dea00640 1 -- 172.21.15.40:0/3235073737 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16e0003dd0 con 0x7f16e4109120 2024-09-11T22:30:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.547+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e419f7f0 con 0x7f16e4109120 2024-09-11T22:30:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.547+0000 7f16dea00640 1 -- 172.21.15.40:0/3235073737 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e002fc40 con 0x7f16e4109120 2024-09-11T22:30:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.547+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e41a7130 con 0x7f16e4109120 2024-09-11T22:30:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.548+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e41043d0 con 0x7f16e4109120 2024-09-11T22:30:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.550+0000 7f16dea00640 1 -- 172.21.15.40:0/3235073737 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f16e0004050 con 0x7f16e4109120 2024-09-11T22:30:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.551+0000 7f16dea00640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16cc0a2c90 0x7f16cc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.551+0000 7f16dea00640 1 -- 172.21.15.40:0/3235073737 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f16e00f05a0 con 0x7f16e4109120 2024-09-11T22:30:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.552+0000 7f16e9e00640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16cc0a2c90 0x7f16cc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.552+0000 7f16e9e00640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16cc0a2c90 0x7f16cc0a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009bd0 tx=0x7f16d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.555+0000 7f16dea00640 1 -- 172.21.15.40:0/3235073737 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16e00bd270 con 0x7f16e4109120 2024-09-11T22:30:15.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.737+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16e4100d60 con 0x7f16cc0a2c90 2024-09-11T22:30:15.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.745+0000 7f16dea00640 1 -- 172.21.15.40:0/3235073737 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340357 (secure 0 0 0) 0x7f16e4100d60 con 0x7f16cc0a2c90 2024-09-11T22:30:15.752 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:15.754 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T22:30:15.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16cc0a2c90 msgr2=0x7f16cc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:15.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16cc0a2c90 0x7f16cc0a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009bd0 tx=0x7f16d8005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:15.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 msgr2=0x7f16e419ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:15.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 0x7f16e419ee80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f16e0031a20 tx=0x7f16e0031a50 comp rx=0 tx=0).stop 2024-09-11T22:30:15.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 shutdown_connections 2024-09-11T22:30:15.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16cc0a2c90 0x7f16cc0a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16e4109120 0x7f16e419ee80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16e41049a0 0x7f16e419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 --2- 172.21.15.40:0/3235073737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16e4103ff0 0x7f16e419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:15.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 >> 172.21.15.40:0/3235073737 conn(0x7f16e40ffa90 msgr2=0x7f16e4101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:15.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 shutdown_connections 2024-09-11T22:30:15.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:15.750+0000 7f16ec800640 1 -- 172.21.15.40:0/3235073737 wait complete. 2024-09-11T22:30:16.463 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:16 smithi040 ceph-mon[30787]: pgmap v364: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:16.463 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:16 smithi040 ceph-mon[30787]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:30:16.501 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-09-11T22:30:15.012912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657929,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":502,"num_read_kb":367,"num_write":354,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364224,"kb_used_data":14912,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124577600,"statfs":{"total":1151940427776,"available":1151567462400,"internally_reserved":0,"allocated":15269888,"data_stored":8499953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003887"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086788+0000","last_change":"2024-09-11T22:28:18.585171+0000","last_active":"2024-09-11T22:29:59.086788+0000","last_peered":"2024-09-11T22:29:59.086788+0000","last_clean":"2024-09-11T22:29:59.086788+0000","last_became_active":"2024-09-11T22:28:18.584790+0000","last_became_peered":"2024-09-11T22:28:18.584790+0000","last_unstale":"2024-09-11T22:29:59.086788+0000","last_undegraded":"2024-09-11T22:29:59.086788+0000","last_fullsized":"2024-09-11T22:29:59.086788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:53.528254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.813903+0000","last_change":"2024-09-11T22:29:59.813427+0000","last_active":"2024-09-11T22:29:59.813903+0000","last_peered":"2024-09-11T22:29:59.813903+0000","last_clean":"2024-09-11T22:29:59.813903+0000","last_became_active":"2024-09-11T22:29:59.812889+0000","last_became_peered":"2024-09-11T22:29:59.812889+0000","last_unstale":"2024-09-11T22:29:59.813903+0000","last_undegraded":"2024-09-11T22:29:59.813903+0000","last_fullsized":"2024-09-11T22:29:59.813903+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:34.696287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811225+0000","last_change":"2024-09-11T22:28:30.184272+0000","last_active":"2024-09-11T22:29:59.811225+0000","last_peered":"2024-09-11T22:29:59.811225+0000","last_clean":"2024-09-11T22:29:59.811225+0000","last_became_active":"2024-09-11T22:28:30.182956+0000","last_became_peered":"2024-09-11T22:28:30.182956+0000","last_unstale":"2024-09-11T22:29:59.811225+0000","last_undegraded":"2024-09-11T22:29:59.811225+0000","last_fullsized":"2024-09-11T22:29:59.811225+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.773131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085409+0000","last_change":"2024-09-11T22:28:18.782833+0000","last_active":"2024-09-11T22:29:59.085409+0000","last_peered":"2024-09-11T22:29:59.085409+0000","last_clean":"2024-09-11T22:29:59.085409+0000","last_became_active":"2024-09-11T22:28:18.781202+0000","last_became_peered":"2024-09-11T22:28:18.781202+0000","last_unstale":"2024-09-11T22:29:59.085409+0000","last_undegraded":"2024-09-11T22:29:59.085409+0000","last_fullsized":"2024-09-11T22:29:59.085409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:47.389717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388432+0000","last_change":"2024-09-11T22:28:21.126106+0000","last_active":"2024-09-11T22:29:59.388432+0000","last_peered":"2024-09-11T22:29:59.388432+0000","last_clean":"2024-09-11T22:29:59.388432+0000","last_became_active":"2024-09-11T22:28:21.125760+0000","last_became_peered":"2024-09-11T22:28:21.125760+0000","last_unstale":"2024-09-11T22:29:59.388432+0000","last_undegraded":"2024-09-11T22:29:59.388432+0000","last_fullsized":"2024-09-11T22:29:59.388432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:18.500241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.428837+0000","last_change":"2024-09-11T22:28:30.183343+0000","last_active":"2024-09-11T22:29:59.428837+0000","last_peered":"2024-09-11T22:29:59.428837+0000","last_clean":"2024-09-11T22:29:59.428837+0000","last_became_active":"2024-09-11T22:28:30.182811+0000","last_became_peered":"2024-09-11T22:28:30.182811+0000","last_unstale":"2024-09-11T22:29:59.428837+0000","last_undegraded":"2024-09-11T22:29:59.428837+0000","last_fullsized":"2024-09-11T22:29:59.428837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:48:18.262267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084794+0000","last_change":"2024-09-11T22:28:18.586872+0000","last_active":"2024-09-11T22:29:59.084794+0000","last_peered":"2024-09-11T22:29:59.084794+0000","last_clean":"2024-09-11T22:29:59.084794+0000","last_became_active":"2024-09-11T22:28:18.586516+0000","last_became_peered":"2024-09-11T22:28:18.586516+0000","last_unstale":"2024-09-11T22:29:59.084794+0000","last_undegraded":"2024-09-11T22:29:59.084794+0000","last_fullsized":"2024-09-11T22:29:59.084794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:07.479936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756311+0000","last_change":"2024-09-11T22:28:21.132488+0000","last_active":"2024-09-11T22:29:59.756311+0000","last_peered":"2024-09-11T22:29:59.756311+0000","last_clean":"2024-09-11T22:29:59.756311+0000","last_became_active":"2024-09-11T22:28:21.132153+0000","last_became_peered":"2024-09-11T22:28:21.132153+0000","last_unstale":"2024-09-11T22:29:59.756311+0000","last_undegraded":"2024-09-11T22:29:59.756311+0000","last_fullsized":"2024-09-11T22:29:59.756311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:43.791896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429065+0000","last_change":"2024-09-11T22:28:30.190272+0000","last_active":"2024-09-11T22:29:59.429065+0000","last_peered":"2024-09-11T22:29:59.429065+0000","last_clean":"2024-09-11T22:29:59.429065+0000","last_became_active":"2024-09-11T22:28:30.189912+0000","last_became_peered":"2024-09-11T22:28:30.189912+0000","last_unstale":"2024-09-11T22:29:59.429065+0000","last_undegraded":"2024-09-11T22:29:59.429065+0000","last_fullsized":"2024-09-11T22:29:59.429065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:56.166963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811468+0000","last_change":"2024-09-11T22:28:58.300107+0000","last_active":"2024-09-11T22:29:59.811468+0000","last_peered":"2024-09-11T22:29:59.811468+0000","last_clean":"2024-09-11T22:29:59.811468+0000","last_became_active":"2024-09-11T22:28:58.294806+0000","last_became_peered":"2024-09-11T22:28:58.294806+0000","last_unstale":"2024-09-11T22:29:59.811468+0000","last_undegraded":"2024-09-11T22:29:59.811468+0000","last_fullsized":"2024-09-11T22:29:59.811468+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:37.494929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215576+0000","last_change":"2024-09-11T22:28:21.128789+0000","last_active":"2024-09-11T22:29:59.215576+0000","last_peered":"2024-09-11T22:29:59.215576+0000","last_clean":"2024-09-11T22:29:59.215576+0000","last_became_active":"2024-09-11T22:28:21.128426+0000","last_became_peered":"2024-09-11T22:28:21.128426+0000","last_unstale":"2024-09-11T22:29:59.215576+0000","last_undegraded":"2024-09-11T22:29:59.215576+0000","last_fullsized":"2024-09-11T22:29:59.215576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:43.945247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.428991+0000","last_change":"2024-09-11T22:28:30.190240+0000","last_active":"2024-09-11T22:29:59.428991+0000","last_peered":"2024-09-11T22:29:59.428991+0000","last_clean":"2024-09-11T22:29:59.428991+0000","last_became_active":"2024-09-11T22:28:30.189826+0000","last_became_peered":"2024-09-11T22:28:30.189826+0000","last_unstale":"2024-09-11T22:29:59.428991+0000","last_undegraded":"2024-09-11T22:29:59.428991+0000","last_fullsized":"2024-09-11T22:29:59.428991+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.040193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811400+0000","last_change":"2024-09-11T22:28:21.124389+0000","last_active":"2024-09-11T22:29:59.811400+0000","last_peered":"2024-09-11T22:29:59.811400+0000","last_clean":"2024-09-11T22:29:59.811400+0000","last_became_active":"2024-09-11T22:28:21.124058+0000","last_became_peered":"2024-09-11T22:28:21.124058+0000","last_unstale":"2024-09-11T22:29:59.811400+0000","last_undegraded":"2024-09-11T22:29:59.811400+0000","last_fullsized":"2024-09-11T22:29:59.811400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:02.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":23,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811588+0000","last_change":"2024-09-11T22:28:58.304916+0000","last_active":"2024-09-11T22:29:59.811588+0000","last_peered":"2024-09-11T22:29:59.811588+0000","last_clean":"2024-09-11T22:29:59.811588+0000","last_became_active":"2024-09-11T22:28:58.296717+0000","last_became_peered":"2024-09-11T22:28:58.296717+0000","last_unstale":"2024-09-11T22:29:59.811588+0000","last_undegraded":"2024-09-11T22:29:59.811588+0000","last_fullsized":"2024-09-11T22:29:59.811588+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:30.044871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429328+0000","last_change":"2024-09-11T22:28:30.183135+0000","last_active":"2024-09-11T22:29:59.429328+0000","last_peered":"2024-09-11T22:29:59.429328+0000","last_clean":"2024-09-11T22:29:59.429328+0000","last_became_active":"2024-09-11T22:28:30.182768+0000","last_became_peered":"2024-09-11T22:28:30.182768+0000","last_unstale":"2024-09-11T22:29:59.429328+0000","last_undegraded":"2024-09-11T22:29:59.429328+0000","last_fullsized":"2024-09-11T22:29:59.429328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:26.703807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084383+0000","last_change":"2024-09-11T22:28:21.128609+0000","last_active":"2024-09-11T22:29:59.084383+0000","last_peered":"2024-09-11T22:29:59.084383+0000","last_clean":"2024-09-11T22:29:59.084383+0000","last_became_active":"2024-09-11T22:28:21.128240+0000","last_became_peered":"2024-09-11T22:28:21.128240+0000","last_unstale":"2024-09-11T22:29:59.084383+0000","last_undegraded":"2024-09-11T22:29:59.084383+0000","last_fullsized":"2024-09-11T22:29:59.084383+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:41.610223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811599+0000","last_change":"2024-09-11T22:28:18.588047+0000","last_active":"2024-09-11T22:29:59.811599+0000","last_peered":"2024-09-11T22:29:59.811599+0000","last_clean":"2024-09-11T22:29:59.811599+0000","last_became_active":"2024-09-11T22:28:18.587580+0000","last_became_peered":"2024-09-11T22:28:18.587580+0000","last_unstale":"2024-09-11T22:29:59.811599+0000","last_undegraded":"2024-09-11T22:29:59.811599+0000","last_fullsized":"2024-09-11T22:29:59.811599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:01.625014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429302+0000","last_change":"2024-09-11T22:28:30.194188+0000","last_active":"2024-09-11T22:29:59.429302+0000","last_peered":"2024-09-11T22:29:59.429302+0000","last_clean":"2024-09-11T22:29:59.429302+0000","last_became_active":"2024-09-11T22:28:30.193779+0000","last_became_peered":"2024-09-11T22:28:30.193779+0000","last_unstale":"2024-09-11T22:29:59.429302+0000","last_undegraded":"2024-09-11T22:29:59.429302+0000","last_fullsized":"2024-09-11T22:29:59.429302+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:37.328545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811615+0000","last_change":"2024-09-11T22:28:21.113112+0000","last_active":"2024-09-11T22:29:59.811615+0000","last_peered":"2024-09-11T22:29:59.811615+0000","last_clean":"2024-09-11T22:29:59.811615+0000","last_became_active":"2024-09-11T22:28:21.112644+0000","last_became_peered":"2024-09-11T22:28:21.112644+0000","last_unstale":"2024-09-11T22:29:59.811615+0000","last_undegraded":"2024-09-11T22:29:59.811615+0000","last_fullsized":"2024-09-11T22:29:59.811615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:47.520760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084340+0000","last_change":"2024-09-11T22:28:18.587008+0000","last_active":"2024-09-11T22:29:59.084340+0000","last_peered":"2024-09-11T22:29:59.084340+0000","last_clean":"2024-09-11T22:29:59.084340+0000","last_became_active":"2024-09-11T22:28:18.586519+0000","last_became_peered":"2024-09-11T22:28:18.586519+0000","last_unstale":"2024-09-11T22:29:59.084340+0000","last_undegraded":"2024-09-11T22:29:59.084340+0000","last_fullsized":"2024-09-11T22:29:59.084340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:53.600253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086266+0000","last_change":"2024-09-11T22:28:30.182409+0000","last_active":"2024-09-11T22:29:59.086266+0000","last_peered":"2024-09-11T22:29:59.086266+0000","last_clean":"2024-09-11T22:29:59.086266+0000","last_became_active":"2024-09-11T22:28:30.181991+0000","last_became_peered":"2024-09-11T22:28:30.181991+0000","last_unstale":"2024-09-11T22:29:59.086266+0000","last_undegraded":"2024-09-11T22:29:59.086266+0000","last_fullsized":"2024-09-11T22:29:59.086266+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:11.997540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084281+0000","last_change":"2024-09-11T22:28:21.120079+0000","last_active":"2024-09-11T22:29:59.084281+0000","last_peered":"2024-09-11T22:29:59.084281+0000","last_clean":"2024-09-11T22:29:59.084281+0000","last_became_active":"2024-09-11T22:28:21.119691+0000","last_became_peered":"2024-09-11T22:28:21.119691+0000","last_unstale":"2024-09-11T22:29:59.084281+0000","last_undegraded":"2024-09-11T22:29:59.084281+0000","last_fullsized":"2024-09-11T22:29:59.084281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:06.447839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.755927+0000","last_change":"2024-09-11T22:28:18.780774+0000","last_active":"2024-09-11T22:29:59.755927+0000","last_peered":"2024-09-11T22:29:59.755927+0000","last_clean":"2024-09-11T22:29:59.755927+0000","last_became_active":"2024-09-11T22:28:18.780460+0000","last_became_peered":"2024-09-11T22:28:18.780460+0000","last_unstale":"2024-09-11T22:29:59.755927+0000","last_undegraded":"2024-09-11T22:29:59.755927+0000","last_fullsized":"2024-09-11T22:29:59.755927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:03.157973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429636+0000","last_change":"2024-09-11T22:28:30.177658+0000","last_active":"2024-09-11T22:29:59.429636+0000","last_peered":"2024-09-11T22:29:59.429636+0000","last_clean":"2024-09-11T22:29:59.429636+0000","last_became_active":"2024-09-11T22:28:30.177237+0000","last_became_peered":"2024-09-11T22:28:30.177237+0000","last_unstale":"2024-09-11T22:29:59.429636+0000","last_undegraded":"2024-09-11T22:29:59.429636+0000","last_fullsized":"2024-09-11T22:29:59.429636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:43.495545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388324+0000","last_change":"2024-09-11T22:28:21.127248+0000","last_active":"2024-09-11T22:29:59.388324+0000","last_peered":"2024-09-11T22:29:59.388324+0000","last_clean":"2024-09-11T22:29:59.388324+0000","last_became_active":"2024-09-11T22:28:21.126927+0000","last_became_peered":"2024-09-11T22:28:21.126927+0000","last_unstale":"2024-09-11T22:29:59.388324+0000","last_undegraded":"2024-09-11T22:29:59.388324+0000","last_fullsized":"2024-09-11T22:29:59.388324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:22.219441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429803+0000","last_change":"2024-09-11T22:28:18.728680+0000","last_active":"2024-09-11T22:29:59.429803+0000","last_peered":"2024-09-11T22:29:59.429803+0000","last_clean":"2024-09-11T22:29:59.429803+0000","last_became_active":"2024-09-11T22:28:18.728235+0000","last_became_peered":"2024-09-11T22:28:18.728235+0000","last_unstale":"2024-09-11T22:29:59.429803+0000","last_undegraded":"2024-09-11T22:29:59.429803+0000","last_fullsized":"2024-09-11T22:29:59.429803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:26.002304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811363+0000","last_change":"2024-09-11T22:28:30.179945+0000","last_active":"2024-09-11T22:29:59.811363+0000","last_peered":"2024-09-11T22:29:59.811363+0000","last_clean":"2024-09-11T22:29:59.811363+0000","last_became_active":"2024-09-11T22:28:30.179089+0000","last_became_peered":"2024-09-11T22:28:30.179089+0000","last_unstale":"2024-09-11T22:29:59.811363+0000","last_undegraded":"2024-09-11T22:29:59.811363+0000","last_fullsized":"2024-09-11T22:29:59.811363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:34.126678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085318+0000","last_change":"2024-09-11T22:28:21.120411+0000","last_active":"2024-09-11T22:29:59.085318+0000","last_peered":"2024-09-11T22:29:59.085318+0000","last_clean":"2024-09-11T22:29:59.085318+0000","last_became_active":"2024-09-11T22:28:21.120048+0000","last_became_peered":"2024-09-11T22:28:21.120048+0000","last_unstale":"2024-09-11T22:29:59.085318+0000","last_undegraded":"2024-09-11T22:29:59.085318+0000","last_fullsized":"2024-09-11T22:29:59.085318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:07.194042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'13","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086424+0000","last_change":"2024-09-11T22:28:18.581589+0000","last_active":"2024-09-11T22:29:59.086424+0000","last_peered":"2024-09-11T22:29:59.086424+0000","last_clean":"2024-09-11T22:29:59.086424+0000","last_became_active":"2024-09-11T22:28:18.581104+0000","last_became_peered":"2024-09-11T22:28:18.581104+0000","last_unstale":"2024-09-11T22:29:59.086424+0000","last_undegraded":"2024-09-11T22:29:59.086424+0000","last_fullsized":"2024-09-11T22:29:59.086424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:55.318466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083872+0000","last_change":"2024-09-11T22:28:30.188454+0000","last_active":"2024-09-11T22:29:59.083872+0000","last_peered":"2024-09-11T22:29:59.083872+0000","last_clean":"2024-09-11T22:29:59.083872+0000","last_became_active":"2024-09-11T22:28:30.188048+0000","last_became_peered":"2024-09-11T22:28:30.188048+0000","last_unstale":"2024-09-11T22:29:59.083872+0000","last_undegraded":"2024-09-11T22:29:59.083872+0000","last_fullsized":"2024-09-11T22:29:59.083872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:54.994664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083621+0000","last_change":"2024-09-11T22:28:21.122495+0000","last_active":"2024-09-11T22:29:59.083621+0000","last_peered":"2024-09-11T22:29:59.083621+0000","last_clean":"2024-09-11T22:29:59.083621+0000","last_became_active":"2024-09-11T22:28:21.122157+0000","last_became_peered":"2024-09-11T22:28:21.122157+0000","last_unstale":"2024-09-11T22:29:59.083621+0000","last_undegraded":"2024-09-11T22:29:59.083621+0000","last_fullsized":"2024-09-11T22:29:59.083621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.126632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084933+0000","last_change":"2024-09-11T22:28:18.781729+0000","last_active":"2024-09-11T22:29:59.084933+0000","last_peered":"2024-09-11T22:29:59.084933+0000","last_clean":"2024-09-11T22:29:59.084933+0000","last_became_active":"2024-09-11T22:28:18.781391+0000","last_became_peered":"2024-09-11T22:28:18.781391+0000","last_unstale":"2024-09-11T22:29:59.084933+0000","last_undegraded":"2024-09-11T22:29:59.084933+0000","last_fullsized":"2024-09-11T22:29:59.084933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.711022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811722+0000","last_change":"2024-09-11T22:28:30.178873+0000","last_active":"2024-09-11T22:29:59.811722+0000","last_peered":"2024-09-11T22:29:59.811722+0000","last_clean":"2024-09-11T22:29:59.811722+0000","last_became_active":"2024-09-11T22:28:30.178479+0000","last_became_peered":"2024-09-11T22:28:30.178479+0000","last_unstale":"2024-09-11T22:29:59.811722+0000","last_undegraded":"2024-09-11T22:29:59.811722+0000","last_fullsized":"2024-09-11T22:29:59.811722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:18.091351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087453+0000","last_change":"2024-09-11T22:28:21.132816+0000","last_active":"2024-09-11T22:29:59.087453+0000","last_peered":"2024-09-11T22:29:59.087453+0000","last_clean":"2024-09-11T22:29:59.087453+0000","last_became_active":"2024-09-11T22:28:21.132445+0000","last_became_peered":"2024-09-11T22:28:21.132445+0000","last_unstale":"2024-09-11T22:29:59.087453+0000","last_undegraded":"2024-09-11T22:29:59.087453+0000","last_fullsized":"2024-09-11T22:29:59.087453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:23.286982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086223+0000","last_change":"2024-09-11T22:28:18.782841+0000","last_active":"2024-09-11T22:29:59.086223+0000","last_peered":"2024-09-11T22:29:59.086223+0000","last_clean":"2024-09-11T22:29:59.086223+0000","last_became_active":"2024-09-11T22:28:18.782482+0000","last_became_peered":"2024-09-11T22:28:18.782482+0000","last_unstale":"2024-09-11T22:29:59.086223+0000","last_undegraded":"2024-09-11T22:29:59.086223+0000","last_fullsized":"2024-09-11T22:29:59.086223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:40.439534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084304+0000","last_change":"2024-09-11T22:28:30.181202+0000","last_active":"2024-09-11T22:29:59.084304+0000","last_peered":"2024-09-11T22:29:59.084304+0000","last_clean":"2024-09-11T22:29:59.084304+0000","last_became_active":"2024-09-11T22:28:30.180770+0000","last_became_peered":"2024-09-11T22:28:30.180770+0000","last_unstale":"2024-09-11T22:29:59.084304+0000","last_undegraded":"2024-09-11T22:29:59.084304+0000","last_fullsized":"2024-09-11T22:29:59.084304+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.019563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.389072+0000","last_change":"2024-09-11T22:29:59.389072+0000","last_active":"2024-09-11T22:29:59.389072+0000","last_peered":"2024-09-11T22:29:59.389072+0000","last_clean":"2024-09-11T22:29:59.389072+0000","last_became_active":"2024-09-11T22:29:59.388745+0000","last_became_peered":"2024-09-11T22:29:59.388745+0000","last_unstale":"2024-09-11T22:29:59.389072+0000","last_undegraded":"2024-09-11T22:29:59.389072+0000","last_fullsized":"2024-09-11T22:29:59.389072+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:04.009871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811555+0000","last_change":"2024-09-11T22:28:18.583456+0000","last_active":"2024-09-11T22:29:59.811555+0000","last_peered":"2024-09-11T22:29:59.811555+0000","last_clean":"2024-09-11T22:29:59.811555+0000","last_became_active":"2024-09-11T22:28:18.582547+0000","last_became_peered":"2024-09-11T22:28:18.582547+0000","last_unstale":"2024-09-11T22:29:59.811555+0000","last_undegraded":"2024-09-11T22:29:59.811555+0000","last_fullsized":"2024-09-11T22:29:59.811555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:16.128672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083480+0000","last_change":"2024-09-11T22:28:30.180057+0000","last_active":"2024-09-11T22:29:59.083480+0000","last_peered":"2024-09-11T22:29:59.083480+0000","last_clean":"2024-09-11T22:29:59.083480+0000","last_became_active":"2024-09-11T22:28:30.179653+0000","last_became_peered":"2024-09-11T22:28:30.179653+0000","last_unstale":"2024-09-11T22:29:59.083480+0000","last_undegraded":"2024-09-11T22:29:59.083480+0000","last_fullsized":"2024-09-11T22:29:59.083480+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:08.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215312+0000","last_change":"2024-09-11T22:28:21.121130+0000","last_active":"2024-09-11T22:29:59.215312+0000","last_peered":"2024-09-11T22:29:59.215312+0000","last_clean":"2024-09-11T22:29:59.215312+0000","last_became_active":"2024-09-11T22:28:21.119673+0000","last_became_peered":"2024-09-11T22:28:21.119673+0000","last_unstale":"2024-09-11T22:29:59.215312+0000","last_undegraded":"2024-09-11T22:29:59.215312+0000","last_fullsized":"2024-09-11T22:29:59.215312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:48.095820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'4","reported_seq":105,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:11.445130+0000","last_change":"2024-09-11T22:28:18.781124+0000","last_active":"2024-09-11T22:30:11.445130+0000","last_peered":"2024-09-11T22:30:11.445130+0000","last_clean":"2024-09-11T22:30:11.445130+0000","last_became_active":"2024-09-11T22:28:18.780600+0000","last_became_peered":"2024-09-11T22:28:18.780600+0000","last_unstale":"2024-09-11T22:30:11.445130+0000","last_undegraded":"2024-09-11T22:30:11.445130+0000","last_fullsized":"2024-09-11T22:30:11.445130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.032623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083180+0000","last_change":"2024-09-11T22:28:30.180121+0000","last_active":"2024-09-11T22:29:59.083180+0000","last_peered":"2024-09-11T22:29:59.083180+0000","last_clean":"2024-09-11T22:29:59.083180+0000","last_became_active":"2024-09-11T22:28:30.179736+0000","last_became_peered":"2024-09-11T22:28:30.179736+0000","last_unstale":"2024-09-11T22:29:59.083180+0000","last_undegraded":"2024-09-11T22:29:59.083180+0000","last_fullsized":"2024-09-11T22:29:59.083180+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.199958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.082984+0000","last_change":"2024-09-11T22:28:21.111931+0000","last_active":"2024-09-11T22:29:59.082984+0000","last_peered":"2024-09-11T22:29:59.082984+0000","last_clean":"2024-09-11T22:29:59.082984+0000","last_became_active":"2024-09-11T22:28:21.111219+0000","last_became_peered":"2024-09-11T22:28:21.111219+0000","last_unstale":"2024-09-11T22:29:59.082984+0000","last_undegraded":"2024-09-11T22:29:59.082984+0000","last_fullsized":"2024-09-11T22:29:59.082984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:02.454748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811224+0000","last_change":"2024-09-11T22:28:18.583841+0000","last_active":"2024-09-11T22:29:59.811224+0000","last_peered":"2024-09-11T22:29:59.811224+0000","last_clean":"2024-09-11T22:29:59.811224+0000","last_became_active":"2024-09-11T22:28:18.583459+0000","last_became_peered":"2024-09-11T22:28:18.583459+0000","last_unstale":"2024-09-11T22:29:59.811224+0000","last_undegraded":"2024-09-11T22:29:59.811224+0000","last_fullsized":"2024-09-11T22:29:59.811224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:05.174157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215768+0000","last_change":"2024-09-11T22:28:30.188646+0000","last_active":"2024-09-11T22:29:59.215768+0000","last_peered":"2024-09-11T22:29:59.215768+0000","last_clean":"2024-09-11T22:29:59.215768+0000","last_became_active":"2024-09-11T22:28:30.188243+0000","last_became_peered":"2024-09-11T22:28:30.188243+0000","last_unstale":"2024-09-11T22:29:59.215768+0000","last_undegraded":"2024-09-11T22:29:59.215768+0000","last_fullsized":"2024-09-11T22:29:59.215768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:46.794048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084664+0000","last_change":"2024-09-11T22:28:21.134979+0000","last_active":"2024-09-11T22:29:59.084664+0000","last_peered":"2024-09-11T22:29:59.084664+0000","last_clean":"2024-09-11T22:29:59.084664+0000","last_became_active":"2024-09-11T22:28:21.130803+0000","last_became_peered":"2024-09-11T22:28:21.130803+0000","last_unstale":"2024-09-11T22:29:59.084664+0000","last_undegraded":"2024-09-11T22:29:59.084664+0000","last_fullsized":"2024-09-11T22:29:59.084664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:04.385857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429477+0000","last_change":"2024-09-11T22:28:18.583434+0000","last_active":"2024-09-11T22:29:59.429477+0000","last_peered":"2024-09-11T22:29:59.429477+0000","last_clean":"2024-09-11T22:29:59.429477+0000","last_became_active":"2024-09-11T22:28:18.583092+0000","last_became_peered":"2024-09-11T22:28:18.583092+0000","last_unstale":"2024-09-11T22:29:59.429477+0000","last_undegraded":"2024-09-11T22:29:59.429477+0000","last_fullsized":"2024-09-11T22:29:59.429477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:10.849520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":355,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811365+0000","last_change":"2024-09-11T22:27:00.252474+0000","last_active":"2024-09-11T22:29:59.811365+0000","last_peered":"2024-09-11T22:29:59.811365+0000","last_clean":"2024-09-11T22:29:59.811365+0000","last_became_active":"2024-09-11T22:27:00.252064+0000","last_became_peered":"2024-09-11T22:27:00.252064+0000","last_unstale":"2024-09-11T22:29:59.811365+0000","last_undegraded":"2024-09-11T22:29:59.811365+0000","last_fullsized":"2024-09-11T22:29:59.811365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:19.615362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:19.615362+0000","last_clean_scrub_stamp":"2024-09-11T22:23:19.615362+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:03.016822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811572+0000","last_change":"2024-09-11T22:28:30.181432+0000","last_active":"2024-09-11T22:29:59.811572+0000","last_peered":"2024-09-11T22:29:59.811572+0000","last_clean":"2024-09-11T22:29:59.811572+0000","last_became_active":"2024-09-11T22:28:30.180994+0000","last_became_peered":"2024-09-11T22:28:30.180994+0000","last_unstale":"2024-09-11T22:29:59.811572+0000","last_undegraded":"2024-09-11T22:29:59.811572+0000","last_fullsized":"2024-09-11T22:29:59.811572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:36.258723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811780+0000","last_change":"2024-09-11T22:28:21.124641+0000","last_active":"2024-09-11T22:29:59.811780+0000","last_peered":"2024-09-11T22:29:59.811780+0000","last_clean":"2024-09-11T22:29:59.811780+0000","last_became_active":"2024-09-11T22:28:21.124266+0000","last_became_peered":"2024-09-11T22:28:21.124266+0000","last_unstale":"2024-09-11T22:29:59.811780+0000","last_undegraded":"2024-09-11T22:29:59.811780+0000","last_fullsized":"2024-09-11T22:29:59.811780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:54.098515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811869+0000","last_change":"2024-09-11T22:28:18.781028+0000","last_active":"2024-09-11T22:29:59.811869+0000","last_peered":"2024-09-11T22:29:59.811869+0000","last_clean":"2024-09-11T22:29:59.811869+0000","last_became_active":"2024-09-11T22:28:18.780566+0000","last_became_peered":"2024-09-11T22:28:18.780566+0000","last_unstale":"2024-09-11T22:29:59.811869+0000","last_undegraded":"2024-09-11T22:29:59.811869+0000","last_fullsized":"2024-09-11T22:29:59.811869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:14.760302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.755952+0000","last_change":"2024-09-11T22:28:58.297083+0000","last_active":"2024-09-11T22:29:59.755952+0000","last_peered":"2024-09-11T22:29:59.755952+0000","last_clean":"2024-09-11T22:29:59.755952+0000","last_became_active":"2024-09-11T22:28:58.296577+0000","last_became_peered":"2024-09-11T22:28:58.296577+0000","last_unstale":"2024-09-11T22:29:59.755952+0000","last_undegraded":"2024-09-11T22:29:59.755952+0000","last_fullsized":"2024-09-11T22:29:59.755952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:42.592248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811556+0000","last_change":"2024-09-11T22:28:21.130748+0000","last_active":"2024-09-11T22:29:59.811556+0000","last_peered":"2024-09-11T22:29:59.811556+0000","last_clean":"2024-09-11T22:29:59.811556+0000","last_became_active":"2024-09-11T22:28:21.130397+0000","last_became_peered":"2024-09-11T22:28:21.130397+0000","last_unstale":"2024-09-11T22:29:59.811556+0000","last_undegraded":"2024-09-11T22:29:59.811556+0000","last_fullsized":"2024-09-11T22:29:59.811556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:09.683157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215830+0000","last_change":"2024-09-11T22:28:18.581826+0000","last_active":"2024-09-11T22:29:59.215830+0000","last_peered":"2024-09-11T22:29:59.215830+0000","last_clean":"2024-09-11T22:29:59.215830+0000","last_became_active":"2024-09-11T22:28:18.581485+0000","last_became_peered":"2024-09-11T22:28:18.581485+0000","last_unstale":"2024-09-11T22:29:59.215830+0000","last_undegraded":"2024-09-11T22:29:59.215830+0000","last_fullsized":"2024-09-11T22:29:59.215830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:10.930762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388184+0000","last_change":"2024-09-11T22:28:30.188296+0000","last_active":"2024-09-11T22:29:59.388184+0000","last_peered":"2024-09-11T22:29:59.388184+0000","last_clean":"2024-09-11T22:29:59.388184+0000","last_became_active":"2024-09-11T22:28:30.186935+0000","last_became_peered":"2024-09-11T22:28:30.186935+0000","last_unstale":"2024-09-11T22:29:59.388184+0000","last_undegraded":"2024-09-11T22:29:59.388184+0000","last_fullsized":"2024-09-11T22:29:59.388184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:05.918883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811749+0000","last_change":"2024-09-11T22:28:21.120482+0000","last_active":"2024-09-11T22:29:59.811749+0000","last_peered":"2024-09-11T22:29:59.811749+0000","last_clean":"2024-09-11T22:29:59.811749+0000","last_became_active":"2024-09-11T22:28:21.119896+0000","last_became_peered":"2024-09-11T22:28:21.119896+0000","last_unstale":"2024-09-11T22:29:59.811749+0000","last_undegraded":"2024-09-11T22:29:59.811749+0000","last_fullsized":"2024-09-11T22:29:59.811749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:04.651745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083613+0000","last_change":"2024-09-11T22:28:58.407709+0000","last_active":"2024-09-11T22:29:59.083613+0000","last_peered":"2024-09-11T22:29:59.083613+0000","last_clean":"2024-09-11T22:29:59.083613+0000","last_became_active":"2024-09-11T22:28:58.404756+0000","last_became_peered":"2024-09-11T22:28:58.404756+0000","last_unstale":"2024-09-11T22:29:59.083613+0000","last_undegraded":"2024-09-11T22:29:59.083613+0000","last_fullsized":"2024-09-11T22:29:59.083613+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.125354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215112+0000","last_change":"2024-09-11T22:28:30.180575+0000","last_active":"2024-09-11T22:29:59.215112+0000","last_peered":"2024-09-11T22:29:59.215112+0000","last_clean":"2024-09-11T22:29:59.215112+0000","last_became_active":"2024-09-11T22:28:30.180057+0000","last_became_peered":"2024-09-11T22:28:30.180057+0000","last_unstale":"2024-09-11T22:29:59.215112+0000","last_undegraded":"2024-09-11T22:29:59.215112+0000","last_fullsized":"2024-09-11T22:29:59.215112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:18.130207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812001+0000","last_change":"2024-09-11T22:28:21.122167+0000","last_active":"2024-09-11T22:29:59.812001+0000","last_peered":"2024-09-11T22:29:59.812001+0000","last_clean":"2024-09-11T22:29:59.812001+0000","last_became_active":"2024-09-11T22:28:21.121777+0000","last_became_peered":"2024-09-11T22:28:21.121777+0000","last_unstale":"2024-09-11T22:29:59.812001+0000","last_undegraded":"2024-09-11T22:29:59.812001+0000","last_fullsized":"2024-09-11T22:29:59.812001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:42.316290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085230+0000","last_change":"2024-09-11T22:28:18.583557+0000","last_active":"2024-09-11T22:29:59.085230+0000","last_peered":"2024-09-11T22:29:59.085230+0000","last_clean":"2024-09-11T22:29:59.085230+0000","last_became_active":"2024-09-11T22:28:18.583153+0000","last_became_peered":"2024-09-11T22:28:18.583153+0000","last_unstale":"2024-09-11T22:29:59.085230+0000","last_undegraded":"2024-09-11T22:29:59.085230+0000","last_fullsized":"2024-09-11T22:29:59.085230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:40.246846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215246+0000","last_change":"2024-09-11T22:28:30.184545+0000","last_active":"2024-09-11T22:29:59.215246+0000","last_peered":"2024-09-11T22:29:59.215246+0000","last_clean":"2024-09-11T22:29:59.215246+0000","last_became_active":"2024-09-11T22:28:30.184135+0000","last_became_peered":"2024-09-11T22:28:30.184135+0000","last_unstale":"2024-09-11T22:29:59.215246+0000","last_undegraded":"2024-09-11T22:29:59.215246+0000","last_fullsized":"2024-09-11T22:29:59.215246+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:11.088364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.758323+0000","last_change":"2024-09-11T22:29:59.757773+0000","last_active":"2024-09-11T22:29:59.758323+0000","last_peered":"2024-09-11T22:29:59.758323+0000","last_clean":"2024-09-11T22:29:59.758323+0000","last_became_active":"2024-09-11T22:29:59.757367+0000","last_became_peered":"2024-09-11T22:29:59.757367+0000","last_unstale":"2024-09-11T22:29:59.758323+0000","last_undegraded":"2024-09-11T22:29:59.758323+0000","last_fullsized":"2024-09-11T22:29:59.758323+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:53.196860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,1],"acting":[9,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084283+0000","last_change":"2024-09-11T22:28:18.781320+0000","last_active":"2024-09-11T22:29:59.084283+0000","last_peered":"2024-09-11T22:29:59.084283+0000","last_clean":"2024-09-11T22:29:59.084283+0000","last_became_active":"2024-09-11T22:28:18.780987+0000","last_became_peered":"2024-09-11T22:28:18.780987+0000","last_unstale":"2024-09-11T22:29:59.084283+0000","last_undegraded":"2024-09-11T22:29:59.084283+0000","last_fullsized":"2024-09-11T22:29:59.084283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:03.717586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083509+0000","last_change":"2024-09-11T22:28:30.185048+0000","last_active":"2024-09-11T22:29:59.083509+0000","last_peered":"2024-09-11T22:29:59.083509+0000","last_clean":"2024-09-11T22:29:59.083509+0000","last_became_active":"2024-09-11T22:28:30.184652+0000","last_became_peered":"2024-09-11T22:28:30.184652+0000","last_unstale":"2024-09-11T22:29:59.083509+0000","last_undegraded":"2024-09-11T22:29:59.083509+0000","last_fullsized":"2024-09-11T22:29:59.083509+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:29.449432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811149+0000","last_change":"2024-09-11T22:28:21.126875+0000","last_active":"2024-09-11T22:29:59.811149+0000","last_peered":"2024-09-11T22:29:59.811149+0000","last_clean":"2024-09-11T22:29:59.811149+0000","last_became_active":"2024-09-11T22:28:21.126549+0000","last_became_peered":"2024-09-11T22:28:21.126549+0000","last_unstale":"2024-09-11T22:29:59.811149+0000","last_undegraded":"2024-09-11T22:29:59.811149+0000","last_fullsized":"2024-09-11T22:29:59.811149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:16.410693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'4","reported_seq":108,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:11.445409+0000","last_change":"2024-09-11T22:28:18.586008+0000","last_active":"2024-09-11T22:30:11.445409+0000","last_peered":"2024-09-11T22:30:11.445409+0000","last_clean":"2024-09-11T22:30:11.445409+0000","last_became_active":"2024-09-11T22:28:18.585254+0000","last_became_peered":"2024-09-11T22:28:18.585254+0000","last_unstale":"2024-09-11T22:30:11.445409+0000","last_undegraded":"2024-09-11T22:30:11.445409+0000","last_fullsized":"2024-09-11T22:30:11.445409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:50.083339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085109+0000","last_change":"2024-09-11T22:28:58.323573+0000","last_active":"2024-09-11T22:29:59.085109+0000","last_peered":"2024-09-11T22:29:59.085109+0000","last_clean":"2024-09-11T22:29:59.085109+0000","last_became_active":"2024-09-11T22:28:58.323233+0000","last_became_peered":"2024-09-11T22:28:58.323233+0000","last_unstale":"2024-09-11T22:29:59.085109+0000","last_undegraded":"2024-09-11T22:29:59.085109+0000","last_fullsized":"2024-09-11T22:29:59.085109+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:33.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811411+0000","last_change":"2024-09-11T22:28:21.133655+0000","last_active":"2024-09-11T22:29:59.811411+0000","last_peered":"2024-09-11T22:29:59.811411+0000","last_clean":"2024-09-11T22:29:59.811411+0000","last_became_active":"2024-09-11T22:28:21.133296+0000","last_became_peered":"2024-09-11T22:28:21.133296+0000","last_unstale":"2024-09-11T22:29:59.811411+0000","last_undegraded":"2024-09-11T22:29:59.811411+0000","last_fullsized":"2024-09-11T22:29:59.811411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:54.956883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215599+0000","last_change":"2024-09-11T22:28:18.585001+0000","last_active":"2024-09-11T22:29:59.215599+0000","last_peered":"2024-09-11T22:29:59.215599+0000","last_clean":"2024-09-11T22:29:59.215599+0000","last_became_active":"2024-09-11T22:28:18.584570+0000","last_became_peered":"2024-09-11T22:28:18.584570+0000","last_unstale":"2024-09-11T22:29:59.215599+0000","last_undegraded":"2024-09-11T22:29:59.215599+0000","last_fullsized":"2024-09-11T22:29:59.215599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811613+0000","last_change":"2024-09-11T22:28:30.192923+0000","last_active":"2024-09-11T22:29:59.811613+0000","last_peered":"2024-09-11T22:29:59.811613+0000","last_clean":"2024-09-11T22:29:59.811613+0000","last_became_active":"2024-09-11T22:28:30.192600+0000","last_became_peered":"2024-09-11T22:28:30.192600+0000","last_unstale":"2024-09-11T22:29:59.811613+0000","last_undegraded":"2024-09-11T22:29:59.811613+0000","last_fullsized":"2024-09-11T22:29:59.811613+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083093+0000","last_change":"2024-09-11T22:28:21.131088+0000","last_active":"2024-09-11T22:29:59.083093+0000","last_peered":"2024-09-11T22:29:59.083093+0000","last_clean":"2024-09-11T22:29:59.083093+0000","last_became_active":"2024-09-11T22:28:21.127001+0000","last_became_peered":"2024-09-11T22:28:21.127001+0000","last_unstale":"2024-09-11T22:29:59.083093+0000","last_undegraded":"2024-09-11T22:29:59.083093+0000","last_fullsized":"2024-09-11T22:29:59.083093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:50.297619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812341+0000","last_change":"2024-09-11T22:28:18.587245+0000","last_active":"2024-09-11T22:29:59.812341+0000","last_peered":"2024-09-11T22:29:59.812341+0000","last_clean":"2024-09-11T22:29:59.812341+0000","last_became_active":"2024-09-11T22:28:18.586873+0000","last_became_peered":"2024-09-11T22:28:18.586873+0000","last_unstale":"2024-09-11T22:29:59.812341+0000","last_undegraded":"2024-09-11T22:29:59.812341+0000","last_fullsized":"2024-09-11T22:29:59.812341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:27.715781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215565+0000","last_change":"2024-09-11T22:28:30.183839+0000","last_active":"2024-09-11T22:29:59.215565+0000","last_peered":"2024-09-11T22:29:59.215565+0000","last_clean":"2024-09-11T22:29:59.215565+0000","last_became_active":"2024-09-11T22:28:30.183382+0000","last_became_peered":"2024-09-11T22:28:30.183382+0000","last_unstale":"2024-09-11T22:29:59.215565+0000","last_undegraded":"2024-09-11T22:29:59.215565+0000","last_fullsized":"2024-09-11T22:29:59.215565+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:31.144195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084623+0000","last_change":"2024-09-11T22:28:21.116932+0000","last_active":"2024-09-11T22:29:59.084623+0000","last_peered":"2024-09-11T22:29:59.084623+0000","last_clean":"2024-09-11T22:29:59.084623+0000","last_became_active":"2024-09-11T22:28:21.116285+0000","last_became_peered":"2024-09-11T22:28:21.116285+0000","last_unstale":"2024-09-11T22:29:59.084623+0000","last_undegraded":"2024-09-11T22:29:59.084623+0000","last_fullsized":"2024-09-11T22:29:59.084623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:04.737879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'32","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:10.445245+0000","last_change":"2024-09-11T22:28:18.581616+0000","last_active":"2024-09-11T22:30:10.445245+0000","last_peered":"2024-09-11T22:30:10.445245+0000","last_clean":"2024-09-11T22:30:10.445245+0000","last_became_active":"2024-09-11T22:28:18.581218+0000","last_became_peered":"2024-09-11T22:28:18.581218+0000","last_unstale":"2024-09-11T22:30:10.445245+0000","last_undegraded":"2024-09-11T22:30:10.445245+0000","last_fullsized":"2024-09-11T22:30:10.445245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:10.351050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":33,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087034+0000","last_change":"2024-09-11T22:28:58.297256+0000","last_active":"2024-09-11T22:29:59.087034+0000","last_peered":"2024-09-11T22:29:59.087034+0000","last_clean":"2024-09-11T22:29:59.087034+0000","last_became_active":"2024-09-11T22:28:58.296671+0000","last_became_peered":"2024-09-11T22:28:58.296671+0000","last_unstale":"2024-09-11T22:29:59.087034+0000","last_undegraded":"2024-09-11T22:29:59.087034+0000","last_fullsized":"2024-09-11T22:29:59.087034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:31.240144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756311+0000","last_change":"2024-09-11T22:28:21.128792+0000","last_active":"2024-09-11T22:29:59.756311+0000","last_peered":"2024-09-11T22:29:59.756311+0000","last_clean":"2024-09-11T22:29:59.756311+0000","last_became_active":"2024-09-11T22:28:21.128429+0000","last_became_peered":"2024-09-11T22:28:21.128429+0000","last_unstale":"2024-09-11T22:29:59.756311+0000","last_undegraded":"2024-09-11T22:29:59.756311+0000","last_fullsized":"2024-09-11T22:29:59.756311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:16.049877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215719+0000","last_change":"2024-09-11T22:28:18.781827+0000","last_active":"2024-09-11T22:29:59.215719+0000","last_peered":"2024-09-11T22:29:59.215719+0000","last_clean":"2024-09-11T22:29:59.215719+0000","last_became_active":"2024-09-11T22:28:18.781453+0000","last_became_peered":"2024-09-11T22:28:18.781453+0000","last_unstale":"2024-09-11T22:29:59.215719+0000","last_undegraded":"2024-09-11T22:29:59.215719+0000","last_fullsized":"2024-09-11T22:29:59.215719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:37.901034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429243+0000","last_change":"2024-09-11T22:28:30.182457+0000","last_active":"2024-09-11T22:29:59.429243+0000","last_peered":"2024-09-11T22:29:59.429243+0000","last_clean":"2024-09-11T22:29:59.429243+0000","last_became_active":"2024-09-11T22:28:30.181834+0000","last_became_peered":"2024-09-11T22:28:30.181834+0000","last_unstale":"2024-09-11T22:29:59.429243+0000","last_undegraded":"2024-09-11T22:29:59.429243+0000","last_fullsized":"2024-09-11T22:29:59.429243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:21.847470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388462+0000","last_change":"2024-09-11T22:28:21.121896+0000","last_active":"2024-09-11T22:29:59.388462+0000","last_peered":"2024-09-11T22:29:59.388462+0000","last_clean":"2024-09-11T22:29:59.388462+0000","last_became_active":"2024-09-11T22:28:21.120639+0000","last_became_peered":"2024-09-11T22:28:21.120639+0000","last_unstale":"2024-09-11T22:29:59.388462+0000","last_undegraded":"2024-09-11T22:29:59.388462+0000","last_fullsized":"2024-09-11T22:29:59.388462+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:59:58.707107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811651+0000","last_change":"2024-09-11T22:28:18.584577+0000","last_active":"2024-09-11T22:29:59.811651+0000","last_peered":"2024-09-11T22:29:59.811651+0000","last_clean":"2024-09-11T22:29:59.811651+0000","last_became_active":"2024-09-11T22:28:18.583642+0000","last_became_peered":"2024-09-11T22:28:18.583642+0000","last_unstale":"2024-09-11T22:29:59.811651+0000","last_undegraded":"2024-09-11T22:29:59.811651+0000","last_fullsized":"2024-09-11T22:29:59.811651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:09.685642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085296+0000","last_change":"2024-09-11T22:28:30.182767+0000","last_active":"2024-09-11T22:29:59.085296+0000","last_peered":"2024-09-11T22:29:59.085296+0000","last_clean":"2024-09-11T22:29:59.085296+0000","last_became_active":"2024-09-11T22:28:30.181902+0000","last_became_peered":"2024-09-11T22:28:30.181902+0000","last_unstale":"2024-09-11T22:29:59.085296+0000","last_undegraded":"2024-09-11T22:29:59.085296+0000","last_fullsized":"2024-09-11T22:29:59.085296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:49.618633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756454+0000","last_change":"2024-09-11T22:28:21.132388+0000","last_active":"2024-09-11T22:29:59.756454+0000","last_peered":"2024-09-11T22:29:59.756454+0000","last_clean":"2024-09-11T22:29:59.756454+0000","last_became_active":"2024-09-11T22:28:21.132053+0000","last_became_peered":"2024-09-11T22:28:21.132053+0000","last_unstale":"2024-09-11T22:29:59.756454+0000","last_undegraded":"2024-09-11T22:29:59.756454+0000","last_fullsized":"2024-09-11T22:29:59.756454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:04.813600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'3","reported_seq":101,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:09.442154+0000","last_change":"2024-09-11T22:28:18.577057+0000","last_active":"2024-09-11T22:30:09.442154+0000","last_peered":"2024-09-11T22:30:09.442154+0000","last_clean":"2024-09-11T22:30:09.442154+0000","last_became_active":"2024-09-11T22:28:18.576678+0000","last_became_peered":"2024-09-11T22:28:18.576678+0000","last_unstale":"2024-09-11T22:30:09.442154+0000","last_undegraded":"2024-09-11T22:30:09.442154+0000","last_fullsized":"2024-09-11T22:30:09.442154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:04.425896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084030+0000","last_change":"2024-09-11T22:28:30.184139+0000","last_active":"2024-09-11T22:29:59.084030+0000","last_peered":"2024-09-11T22:29:59.084030+0000","last_clean":"2024-09-11T22:29:59.084030+0000","last_became_active":"2024-09-11T22:28:30.182817+0000","last_became_peered":"2024-09-11T22:28:30.182817+0000","last_unstale":"2024-09-11T22:29:59.084030+0000","last_undegraded":"2024-09-11T22:29:59.084030+0000","last_fullsized":"2024-09-11T22:29:59.084030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:43.829873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388222+0000","last_change":"2024-09-11T22:28:30.182250+0000","last_active":"2024-09-11T22:29:59.388222+0000","last_peered":"2024-09-11T22:29:59.388222+0000","last_clean":"2024-09-11T22:29:59.388222+0000","last_became_active":"2024-09-11T22:28:30.178758+0000","last_became_peered":"2024-09-11T22:28:30.178758+0000","last_unstale":"2024-09-11T22:29:59.388222+0000","last_undegraded":"2024-09-11T22:29:59.388222+0000","last_fullsized":"2024-09-11T22:29:59.388222+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:25.120475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085814+0000","last_change":"2024-09-11T22:28:21.121208+0000","last_active":"2024-09-11T22:29:59.085814+0000","last_peered":"2024-09-11T22:29:59.085814+0000","last_clean":"2024-09-11T22:29:59.085814+0000","last_became_active":"2024-09-11T22:28:21.120904+0000","last_became_peered":"2024-09-11T22:28:21.120904+0000","last_unstale":"2024-09-11T22:29:59.085814+0000","last_undegraded":"2024-09-11T22:29:59.085814+0000","last_fullsized":"2024-09-11T22:29:59.085814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:36.696739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215534+0000","last_change":"2024-09-11T22:28:18.584471+0000","last_active":"2024-09-11T22:29:59.215534+0000","last_peered":"2024-09-11T22:29:59.215534+0000","last_clean":"2024-09-11T22:29:59.215534+0000","last_became_active":"2024-09-11T22:28:18.584124+0000","last_became_peered":"2024-09-11T22:28:18.584124+0000","last_unstale":"2024-09-11T22:29:59.215534+0000","last_undegraded":"2024-09-11T22:29:59.215534+0000","last_fullsized":"2024-09-11T22:29:59.215534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:40.992385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811684+0000","last_change":"2024-09-11T22:28:58.403924+0000","last_active":"2024-09-11T22:29:59.811684+0000","last_peered":"2024-09-11T22:29:59.811684+0000","last_clean":"2024-09-11T22:29:59.811684+0000","last_became_active":"2024-09-11T22:28:58.403543+0000","last_became_peered":"2024-09-11T22:28:58.403543+0000","last_unstale":"2024-09-11T22:29:59.811684+0000","last_undegraded":"2024-09-11T22:29:59.811684+0000","last_fullsized":"2024-09-11T22:29:59.811684+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:16.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084121+0000","last_change":"2024-09-11T22:28:21.136111+0000","last_active":"2024-09-11T22:29:59.084121+0000","last_peered":"2024-09-11T22:29:59.084121+0000","last_clean":"2024-09-11T22:29:59.084121+0000","last_became_active":"2024-09-11T22:28:21.135576+0000","last_became_peered":"2024-09-11T22:28:21.135576+0000","last_unstale":"2024-09-11T22:29:59.084121+0000","last_undegraded":"2024-09-11T22:29:59.084121+0000","last_fullsized":"2024-09-11T22:29:59.084121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:30.134734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083119+0000","last_change":"2024-09-11T22:28:18.583388+0000","last_active":"2024-09-11T22:29:59.083119+0000","last_peered":"2024-09-11T22:29:59.083119+0000","last_clean":"2024-09-11T22:29:59.083119+0000","last_became_active":"2024-09-11T22:28:18.582215+0000","last_became_peered":"2024-09-11T22:28:18.582215+0000","last_unstale":"2024-09-11T22:29:59.083119+0000","last_undegraded":"2024-09-11T22:29:59.083119+0000","last_fullsized":"2024-09-11T22:29:59.083119+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:56.816276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087325+0000","last_change":"2024-09-11T22:28:18.581722+0000","last_active":"2024-09-11T22:29:59.087325+0000","last_peered":"2024-09-11T22:29:59.087325+0000","last_clean":"2024-09-11T22:29:59.087325+0000","last_became_active":"2024-09-11T22:28:18.580961+0000","last_became_peered":"2024-09-11T22:28:18.580961+0000","last_unstale":"2024-09-11T22:29:59.087325+0000","last_undegraded":"2024-09-11T22:29:59.087325+0000","last_fullsized":"2024-09-11T22:29:59.087325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:22.629114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215423+0000","last_change":"2024-09-11T22:28:21.122053+0000","last_active":"2024-09-11T22:29:59.215423+0000","last_peered":"2024-09-11T22:29:59.215423+0000","last_clean":"2024-09-11T22:29:59.215423+0000","last_became_active":"2024-09-11T22:28:21.121708+0000","last_became_peered":"2024-09-11T22:28:21.121708+0000","last_unstale":"2024-09-11T22:29:59.215423+0000","last_undegraded":"2024-09-11T22:29:59.215423+0000","last_fullsized":"2024-09-11T22:29:59.215423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:36.457640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811466+0000","last_change":"2024-09-11T22:28:30.194472+0000","last_active":"2024-09-11T22:29:59.811466+0000","last_peered":"2024-09-11T22:29:59.811466+0000","last_clean":"2024-09-11T22:29:59.811466+0000","last_became_active":"2024-09-11T22:28:30.193986+0000","last_became_peered":"2024-09-11T22:28:30.193986+0000","last_unstale":"2024-09-11T22:29:59.811466+0000","last_undegraded":"2024-09-11T22:29:59.811466+0000","last_fullsized":"2024-09-11T22:29:59.811466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:27.608919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:10.444323+0000","last_change":"2024-09-11T22:28:18.588739+0000","last_active":"2024-09-11T22:30:10.444323+0000","last_peered":"2024-09-11T22:30:10.444323+0000","last_clean":"2024-09-11T22:30:10.444323+0000","last_became_active":"2024-09-11T22:28:18.586218+0000","last_became_peered":"2024-09-11T22:28:18.586218+0000","last_unstale":"2024-09-11T22:30:10.444323+0000","last_undegraded":"2024-09-11T22:30:10.444323+0000","last_fullsized":"2024-09-11T22:30:10.444323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:08.493132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084426+0000","last_change":"2024-09-11T22:28:21.122076+0000","last_active":"2024-09-11T22:29:59.084426+0000","last_peered":"2024-09-11T22:29:59.084426+0000","last_clean":"2024-09-11T22:29:59.084426+0000","last_became_active":"2024-09-11T22:28:21.121692+0000","last_became_peered":"2024-09-11T22:28:21.121692+0000","last_unstale":"2024-09-11T22:29:59.084426+0000","last_undegraded":"2024-09-11T22:29:59.084426+0000","last_fullsized":"2024-09-11T22:29:59.084426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:10.165221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811892+0000","last_change":"2024-09-11T22:28:30.179240+0000","last_active":"2024-09-11T22:29:59.811892+0000","last_peered":"2024-09-11T22:29:59.811892+0000","last_clean":"2024-09-11T22:29:59.811892+0000","last_became_active":"2024-09-11T22:28:30.178855+0000","last_became_peered":"2024-09-11T22:28:30.178855+0000","last_unstale":"2024-09-11T22:29:59.811892+0000","last_undegraded":"2024-09-11T22:29:59.811892+0000","last_fullsized":"2024-09-11T22:29:59.811892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:19.671279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812184+0000","last_change":"2024-09-11T22:28:21.115166+0000","last_active":"2024-09-11T22:29:59.812184+0000","last_peered":"2024-09-11T22:29:59.812184+0000","last_clean":"2024-09-11T22:29:59.812184+0000","last_became_active":"2024-09-11T22:28:21.114840+0000","last_became_peered":"2024-09-11T22:28:21.114840+0000","last_unstale":"2024-09-11T22:29:59.812184+0000","last_undegraded":"2024-09-11T22:29:59.812184+0000","last_fullsized":"2024-09-11T22:29:59.812184+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:09.505715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811684+0000","last_change":"2024-09-11T22:28:21.119822+0000","last_active":"2024-09-11T22:29:59.811684+0000","last_peered":"2024-09-11T22:29:59.811684+0000","last_clean":"2024-09-11T22:29:59.811684+0000","last_became_active":"2024-09-11T22:28:21.119480+0000","last_became_peered":"2024-09-11T22:28:21.119480+0000","last_unstale":"2024-09-11T22:29:59.811684+0000","last_undegraded":"2024-09-11T22:29:59.811684+0000","last_fullsized":"2024-09-11T22:29:59.811684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:35.654943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811483+0000","last_change":"2024-09-11T22:28:21.123521+0000","last_active":"2024-09-11T22:29:59.811483+0000","last_peered":"2024-09-11T22:29:59.811483+0000","last_clean":"2024-09-11T22:29:59.811483+0000","last_became_active":"2024-09-11T22:28:21.123197+0000","last_became_peered":"2024-09-11T22:28:21.123197+0000","last_unstale":"2024-09-11T22:29:59.811483+0000","last_undegraded":"2024-09-11T22:29:59.811483+0000","last_fullsized":"2024-09-11T22:29:59.811483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.418987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388251+0000","last_change":"2024-09-11T22:28:21.117212+0000","last_active":"2024-09-11T22:29:59.388251+0000","last_peered":"2024-09-11T22:29:59.388251+0000","last_clean":"2024-09-11T22:29:59.388251+0000","last_became_active":"2024-09-11T22:28:21.112432+0000","last_became_peered":"2024-09-11T22:28:21.112432+0000","last_unstale":"2024-09-11T22:29:59.388251+0000","last_undegraded":"2024-09-11T22:29:59.388251+0000","last_fullsized":"2024-09-11T22:29:59.388251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:56.053471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083583+0000","last_change":"2024-09-11T22:28:21.115374+0000","last_active":"2024-09-11T22:29:59.083583+0000","last_peered":"2024-09-11T22:29:59.083583+0000","last_clean":"2024-09-11T22:29:59.083583+0000","last_became_active":"2024-09-11T22:28:21.114943+0000","last_became_peered":"2024-09-11T22:28:21.114943+0000","last_unstale":"2024-09-11T22:29:59.083583+0000","last_undegraded":"2024-09-11T22:29:59.083583+0000","last_fullsized":"2024-09-11T22:29:59.083583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:32.564226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811868+0000","last_change":"2024-09-11T22:28:21.122897+0000","last_active":"2024-09-11T22:29:59.811868+0000","last_peered":"2024-09-11T22:29:59.811868+0000","last_clean":"2024-09-11T22:29:59.811868+0000","last_became_active":"2024-09-11T22:28:21.122594+0000","last_became_peered":"2024-09-11T22:28:21.122594+0000","last_unstale":"2024-09-11T22:29:59.811868+0000","last_undegraded":"2024-09-11T22:29:59.811868+0000","last_fullsized":"2024-09-11T22:29:59.811868+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:37.698479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811660+0000","last_change":"2024-09-11T22:28:21.126252+0000","last_active":"2024-09-11T22:29:59.811660+0000","last_peered":"2024-09-11T22:29:59.811660+0000","last_clean":"2024-09-11T22:29:59.811660+0000","last_became_active":"2024-09-11T22:28:21.125935+0000","last_became_peered":"2024-09-11T22:28:21.125935+0000","last_unstale":"2024-09-11T22:29:59.811660+0000","last_undegraded":"2024-09-11T22:29:59.811660+0000","last_fullsized":"2024-09-11T22:29:59.811660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.451659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085190+0000","last_change":"2024-09-11T22:28:58.297133+0000","last_active":"2024-09-11T22:29:59.085190+0000","last_peered":"2024-09-11T22:29:59.085190+0000","last_clean":"2024-09-11T22:29:59.085190+0000","last_became_active":"2024-09-11T22:28:58.296767+0000","last_became_peered":"2024-09-11T22:28:58.296767+0000","last_unstale":"2024-09-11T22:29:59.085190+0000","last_undegraded":"2024-09-11T22:29:59.085190+0000","last_fullsized":"2024-09-11T22:29:59.085190+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:28:49.660837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215190+0000","last_change":"2024-09-11T22:28:21.122293+0000","last_active":"2024-09-11T22:29:59.215190+0000","last_peered":"2024-09-11T22:29:59.215190+0000","last_clean":"2024-09-11T22:29:59.215190+0000","last_became_active":"2024-09-11T22:28:21.121930+0000","last_became_peered":"2024-09-11T22:28:21.121930+0000","last_unstale":"2024-09-11T22:29:59.215190+0000","last_undegraded":"2024-09-11T22:29:59.215190+0000","last_fullsized":"2024-09-11T22:29:59.215190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:43.231206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084215+0000","last_change":"2024-09-11T22:28:21.123949+0000","last_active":"2024-09-11T22:29:59.084215+0000","last_peered":"2024-09-11T22:29:59.084215+0000","last_clean":"2024-09-11T22:29:59.084215+0000","last_became_active":"2024-09-11T22:28:21.121894+0000","last_became_peered":"2024-09-11T22:28:21.121894+0000","last_unstale":"2024-09-11T22:29:59.084215+0000","last_undegraded":"2024-09-11T22:29:59.084215+0000","last_fullsized":"2024-09-11T22:29:59.084215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:56.227648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756134+0000","last_change":"2024-09-11T22:28:21.136287+0000","last_active":"2024-09-11T22:29:59.756134+0000","last_peered":"2024-09-11T22:29:59.756134+0000","last_clean":"2024-09-11T22:29:59.756134+0000","last_became_active":"2024-09-11T22:28:21.136000+0000","last_became_peered":"2024-09-11T22:28:21.136000+0000","last_unstale":"2024-09-11T22:29:59.756134+0000","last_undegraded":"2024-09-11T22:29:59.756134+0000","last_fullsized":"2024-09-11T22:29:59.756134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:32.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083352+0000","last_change":"2024-09-11T22:28:21.117324+0000","last_active":"2024-09-11T22:29:59.083352+0000","last_peered":"2024-09-11T22:29:59.083352+0000","last_clean":"2024-09-11T22:29:59.083352+0000","last_became_active":"2024-09-11T22:28:21.116945+0000","last_became_peered":"2024-09-11T22:28:21.116945+0000","last_unstale":"2024-09-11T22:29:59.083352+0000","last_undegraded":"2024-09-11T22:29:59.083352+0000","last_fullsized":"2024-09-11T22:29:59.083352+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.672745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812015+0000","last_change":"2024-09-11T22:28:21.117336+0000","last_active":"2024-09-11T22:29:59.812015+0000","last_peered":"2024-09-11T22:29:59.812015+0000","last_clean":"2024-09-11T22:29:59.812015+0000","last_became_active":"2024-09-11T22:28:21.117005+0000","last_became_peered":"2024-09-11T22:28:21.117005+0000","last_unstale":"2024-09-11T22:29:59.812015+0000","last_undegraded":"2024-09-11T22:29:59.812015+0000","last_fullsized":"2024-09-11T22:29:59.812015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:55.932442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812012+0000","last_change":"2024-09-11T22:28:21.132066+0000","last_active":"2024-09-11T22:29:59.812012+0000","last_peered":"2024-09-11T22:29:59.812012+0000","last_clean":"2024-09-11T22:29:59.812012+0000","last_became_active":"2024-09-11T22:28:21.131676+0000","last_became_peered":"2024-09-11T22:28:21.131676+0000","last_unstale":"2024-09-11T22:29:59.812012+0000","last_undegraded":"2024-09-11T22:29:59.812012+0000","last_fullsized":"2024-09-11T22:29:59.812012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:50.484049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086415+0000","last_change":"2024-09-11T22:28:21.125532+0000","last_active":"2024-09-11T22:29:59.086415+0000","last_peered":"2024-09-11T22:29:59.086415+0000","last_clean":"2024-09-11T22:29:59.086415+0000","last_became_active":"2024-09-11T22:28:21.125182+0000","last_became_peered":"2024-09-11T22:28:21.125182+0000","last_unstale":"2024-09-11T22:29:59.086415+0000","last_undegraded":"2024-09-11T22:29:59.086415+0000","last_fullsized":"2024-09-11T22:29:59.086415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:35.272900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812183+0000","last_change":"2024-09-11T22:28:21.129029+0000","last_active":"2024-09-11T22:29:59.812183+0000","last_peered":"2024-09-11T22:29:59.812183+0000","last_clean":"2024-09-11T22:29:59.812183+0000","last_became_active":"2024-09-11T22:28:21.128690+0000","last_became_peered":"2024-09-11T22:28:21.128690+0000","last_unstale":"2024-09-11T22:29:59.812183+0000","last_undegraded":"2024-09-11T22:29:59.812183+0000","last_fullsized":"2024-09-11T22:29:59.812183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:57.723871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.755809+0000","last_change":"2024-09-11T22:28:21.134491+0000","last_active":"2024-09-11T22:29:59.755809+0000","last_peered":"2024-09-11T22:29:59.755809+0000","last_clean":"2024-09-11T22:29:59.755809+0000","last_became_active":"2024-09-11T22:28:21.134142+0000","last_became_peered":"2024-09-11T22:28:21.134142+0000","last_unstale":"2024-09-11T22:29:59.755809+0000","last_undegraded":"2024-09-11T22:29:59.755809+0000","last_fullsized":"2024-09-11T22:29:59.755809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:16.960823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.387898+0000","last_change":"2024-09-11T22:28:21.114033+0000","last_active":"2024-09-11T22:29:59.387898+0000","last_peered":"2024-09-11T22:29:59.387898+0000","last_clean":"2024-09-11T22:29:59.387898+0000","last_became_active":"2024-09-11T22:28:21.113689+0000","last_became_peered":"2024-09-11T22:28:21.113689+0000","last_unstale":"2024-09-11T22:29:59.387898+0000","last_undegraded":"2024-09-11T22:29:59.387898+0000","last_fullsized":"2024-09-11T22:29:59.387898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:16.199958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.387993+0000","last_change":"2024-09-11T22:28:21.120938+0000","last_active":"2024-09-11T22:29:59.387993+0000","last_peered":"2024-09-11T22:29:59.387993+0000","last_clean":"2024-09-11T22:29:59.387993+0000","last_became_active":"2024-09-11T22:28:21.120410+0000","last_became_peered":"2024-09-11T22:28:21.120410+0000","last_unstale":"2024-09-11T22:29:59.387993+0000","last_undegraded":"2024-09-11T22:29:59.387993+0000","last_fullsized":"2024-09-11T22:29:59.387993+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.745133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083259+0000","last_change":"2024-09-11T22:28:21.131506+0000","last_active":"2024-09-11T22:29:59.083259+0000","last_peered":"2024-09-11T22:29:59.083259+0000","last_clean":"2024-09-11T22:29:59.083259+0000","last_became_active":"2024-09-11T22:28:21.123877+0000","last_became_peered":"2024-09-11T22:28:21.123877+0000","last_unstale":"2024-09-11T22:29:59.083259+0000","last_undegraded":"2024-09-11T22:29:59.083259+0000","last_fullsized":"2024-09-11T22:29:59.083259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:12.399779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429481+0000","last_change":"2024-09-11T22:28:21.121211+0000","last_active":"2024-09-11T22:29:59.429481+0000","last_peered":"2024-09-11T22:29:59.429481+0000","last_clean":"2024-09-11T22:29:59.429481+0000","last_became_active":"2024-09-11T22:28:21.120900+0000","last_became_peered":"2024-09-11T22:28:21.120900+0000","last_unstale":"2024-09-11T22:29:59.429481+0000","last_undegraded":"2024-09-11T22:29:59.429481+0000","last_fullsized":"2024-09-11T22:29:59.429481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:22.052996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811704+0000","last_change":"2024-09-11T22:28:21.125329+0000","last_active":"2024-09-11T22:29:59.811704+0000","last_peered":"2024-09-11T22:29:59.811704+0000","last_clean":"2024-09-11T22:29:59.811704+0000","last_became_active":"2024-09-11T22:28:21.124998+0000","last_became_peered":"2024-09-11T22:28:21.124998+0000","last_unstale":"2024-09-11T22:29:59.811704+0000","last_undegraded":"2024-09-11T22:29:59.811704+0000","last_fullsized":"2024-09-11T22:29:59.811704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:46.559796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087731+0000","last_change":"2024-09-11T22:28:21.123364+0000","last_active":"2024-09-11T22:29:59.087731+0000","last_peered":"2024-09-11T22:29:59.087731+0000","last_clean":"2024-09-11T22:29:59.087731+0000","last_became_active":"2024-09-11T22:28:21.123042+0000","last_became_peered":"2024-09-11T22:28:21.123042+0000","last_unstale":"2024-09-11T22:29:59.087731+0000","last_undegraded":"2024-09-11T22:29:59.087731+0000","last_fullsized":"2024-09-11T22:29:59.087731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:21.938986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756541+0000","last_change":"2024-09-11T22:28:21.131206+0000","last_active":"2024-09-11T22:29:59.756541+0000","last_peered":"2024-09-11T22:29:59.756541+0000","last_clean":"2024-09-11T22:29:59.756541+0000","last_became_active":"2024-09-11T22:28:21.130879+0000","last_became_peered":"2024-09-11T22:28:21.130879+0000","last_unstale":"2024-09-11T22:29:59.756541+0000","last_undegraded":"2024-09-11T22:29:59.756541+0000","last_fullsized":"2024-09-11T22:29:59.756541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:02.260645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084038+0000","last_change":"2024-09-11T22:28:21.128349+0000","last_active":"2024-09-11T22:29:59.084038+0000","last_peered":"2024-09-11T22:29:59.084038+0000","last_clean":"2024-09-11T22:29:59.084038+0000","last_became_active":"2024-09-11T22:28:21.124628+0000","last_became_peered":"2024-09-11T22:28:21.124628+0000","last_unstale":"2024-09-11T22:29:59.084038+0000","last_undegraded":"2024-09-11T22:29:59.084038+0000","last_fullsized":"2024-09-11T22:29:59.084038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.623110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811226+0000","last_change":"2024-09-11T22:28:21.126140+0000","last_active":"2024-09-11T22:29:59.811226+0000","last_peered":"2024-09-11T22:29:59.811226+0000","last_clean":"2024-09-11T22:29:59.811226+0000","last_became_active":"2024-09-11T22:28:21.125782+0000","last_became_peered":"2024-09-11T22:28:21.125782+0000","last_unstale":"2024-09-11T22:29:59.811226+0000","last_undegraded":"2024-09-11T22:29:59.811226+0000","last_fullsized":"2024-09-11T22:29:59.811226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:10.328879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087215+0000","last_change":"2024-09-11T22:28:21.124145+0000","last_active":"2024-09-11T22:29:59.087215+0000","last_peered":"2024-09-11T22:29:59.087215+0000","last_clean":"2024-09-11T22:29:59.087215+0000","last_became_active":"2024-09-11T22:28:21.123826+0000","last_became_peered":"2024-09-11T22:28:21.123826+0000","last_unstale":"2024-09-11T22:29:59.087215+0000","last_undegraded":"2024-09-11T22:29:59.087215+0000","last_fullsized":"2024-09-11T22:29:59.087215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:35.558812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084400+0000","last_change":"2024-09-11T22:28:21.132106+0000","last_active":"2024-09-11T22:29:59.084400+0000","last_peered":"2024-09-11T22:29:59.084400+0000","last_clean":"2024-09-11T22:29:59.084400+0000","last_became_active":"2024-09-11T22:28:21.131755+0000","last_became_peered":"2024-09-11T22:28:21.131755+0000","last_unstale":"2024-09-11T22:29:59.084400+0000","last_undegraded":"2024-09-11T22:29:59.084400+0000","last_fullsized":"2024-09-11T22:29:59.084400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:20.910633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429439+0000","last_change":"2024-09-11T22:28:21.122348+0000","last_active":"2024-09-11T22:29:59.429439+0000","last_peered":"2024-09-11T22:29:59.429439+0000","last_clean":"2024-09-11T22:29:59.429439+0000","last_became_active":"2024-09-11T22:28:21.121858+0000","last_became_peered":"2024-09-11T22:28:21.121858+0000","last_unstale":"2024-09-11T22:29:59.429439+0000","last_undegraded":"2024-09-11T22:29:59.429439+0000","last_fullsized":"2024-09-11T22:29:59.429439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:11.297623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388143+0000","last_change":"2024-09-11T22:28:21.125006+0000","last_active":"2024-09-11T22:29:59.388143+0000","last_peered":"2024-09-11T22:29:59.388143+0000","last_clean":"2024-09-11T22:29:59.388143+0000","last_became_active":"2024-09-11T22:28:21.124685+0000","last_became_peered":"2024-09-11T22:28:21.124685+0000","last_unstale":"2024-09-11T22:29:59.388143+0000","last_undegraded":"2024-09-11T22:29:59.388143+0000","last_fullsized":"2024-09-11T22:29:59.388143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:30.057740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388288+0000","last_change":"2024-09-11T22:28:21.117285+0000","last_active":"2024-09-11T22:29:59.388288+0000","last_peered":"2024-09-11T22:29:59.388288+0000","last_clean":"2024-09-11T22:29:59.388288+0000","last_became_active":"2024-09-11T22:28:21.116982+0000","last_became_peered":"2024-09-11T22:28:21.116982+0000","last_unstale":"2024-09-11T22:29:59.388288+0000","last_undegraded":"2024-09-11T22:29:59.388288+0000","last_fullsized":"2024-09-11T22:29:59.388288+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:12.068737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812060+0000","last_change":"2024-09-11T22:28:21.128020+0000","last_active":"2024-09-11T22:29:59.812060+0000","last_peered":"2024-09-11T22:29:59.812060+0000","last_clean":"2024-09-11T22:29:59.812060+0000","last_became_active":"2024-09-11T22:28:21.127665+0000","last_became_peered":"2024-09-11T22:28:21.127665+0000","last_unstale":"2024-09-11T22:29:59.812060+0000","last_undegraded":"2024-09-11T22:29:59.812060+0000","last_fullsized":"2024-09-11T22:29:59.812060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.422202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67327,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":376,"num_read_kb":258,"num_write":171,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481830,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1093632,"data_stored":545853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710762,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37092,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708060,"statfs":{"total":95995035648,"available":95957053440,"internally_reserved":0,"allocated":1785856,"data_stored":1196445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874289,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":550185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135925,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1110016,"data_stored":546009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28692,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716460,"statfs":{"total":95995035648,"available":95965655040,"internally_reserved":0,"allocated":1703936,"data_stored":1142313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528384,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1089536,"data_stored":541265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28700,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716452,"statfs":{"total":95995035648,"available":95965646848,"internally_reserved":0,"allocated":1712128,"data_stored":1137508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1101824,"data_stored":546308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":541459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36508,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708644,"statfs":{"total":95995035648,"available":95957651456,"internally_reserved":0,"allocated":1183744,"data_stored":605849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1159168,"data_stored":604106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1114112,"data_stored":542653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:30:16.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T22:30:16.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:16 smithi177 ceph-mon[35530]: pgmap v364: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:16.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:16 smithi177 ceph-mon[35530]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:30:16.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:16 smithi146 ceph-mon[34996]: pgmap v364: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:16.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:16 smithi146 ceph-mon[34996]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:30:16.882 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.445+0000 7f6c21c00640 1 -- 172.21.15.40:0/2095501944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c109120 msgr2=0x7f6c1c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.445+0000 7f6c21c00640 1 --2- 172.21.15.40:0/2095501944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c109120 0x7f6c1c110ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009ca0 tx=0x7f6c1402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.445+0000 7f6c21c00640 1 -- 172.21.15.40:0/2095501944 shutdown_connections 2024-09-11T22:30:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.445+0000 7f6c21c00640 1 --2- 172.21.15.40:0/2095501944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c109120 0x7f6c1c110ca0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.445+0000 7f6c21c00640 1 --2- 172.21.15.40:0/2095501944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1c1049a0 0x7f6c1c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.445+0000 7f6c21c00640 1 --2- 172.21.15.40:0/2095501944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1c103ff0 0x7f6c1c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.445+0000 7f6c21c00640 1 -- 172.21.15.40:0/2095501944 >> 172.21.15.40:0/2095501944 conn(0x7f6c1c0ffa90 msgr2=0x7f6c1c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.445+0000 7f6c21c00640 1 -- 172.21.15.40:0/2095501944 shutdown_connections 2024-09-11T22:30:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.445+0000 7f6c21c00640 1 -- 172.21.15.40:0/2095501944 wait complete. 2024-09-11T22:30:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.446+0000 7f6c21c00640 1 Processor -- start 2024-09-11T22:30:17.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.446+0000 7f6c21c00640 1 -- start start 2024-09-11T22:30:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c21c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1c103ff0 0x7f6c1c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c21c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c1049a0 0x7f6c1c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c21c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1c109120 0x7f6c1c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c21c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c114130 con 0x7f6c1c1049a0 2024-09-11T22:30:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c21c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c113fb0 con 0x7f6c1c103ff0 2024-09-11T22:30:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c21c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c1142b0 con 0x7f6c1c109120 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c1a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c1049a0 0x7f6c1c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c1a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c1049a0 0x7f6c1c19ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47466/0 (socket says 172.21.15.40:47466) 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c1a000640 1 -- 172.21.15.40:0/525660907 learned_addr learned my addr 172.21.15.40:0/525660907 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c1aa00640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1c103ff0 0x7f6c1c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.447+0000 7f6c1b400640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1c109120 0x7f6c1c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.448+0000 7f6c1a000640 1 -- 172.21.15.40:0/525660907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1c109120 msgr2=0x7f6c1c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.448+0000 7f6c1a000640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1c109120 0x7f6c1c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.448+0000 7f6c1a000640 1 -- 172.21.15.40:0/525660907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1c103ff0 msgr2=0x7f6c1c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.448+0000 7f6c1a000640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1c103ff0 0x7f6c1c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.448+0000 7f6c1a000640 1 -- 172.21.15.40:0/525660907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c19f5c0 con 0x7f6c1c1049a0 2024-09-11T22:30:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.448+0000 7f6c1a000640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c1049a0 0x7f6c1c19ab50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e9f0 tx=0x7f6c0800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.448+0000 7f6c13400640 1 -- 172.21.15.40:0/525660907 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800cd80 con 0x7f6c1c1049a0 2024-09-11T22:30:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.448+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c19f8b0 con 0x7f6c1c1049a0 2024-09-11T22:30:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.448+0000 7f6c13400640 1 -- 172.21.15.40:0/525660907 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c08010910 con 0x7f6c1c1049a0 2024-09-11T22:30:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.449+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c1a7190 con 0x7f6c1c1049a0 2024-09-11T22:30:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.449+0000 7f6c13400640 1 -- 172.21.15.40:0/525660907 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08018910 con 0x7f6c1c1049a0 2024-09-11T22:30:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.450+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1c1043d0 con 0x7f6c1c1049a0 2024-09-11T22:30:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.452+0000 7f6c13400640 1 -- 172.21.15.40:0/525660907 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6c08010ac0 con 0x7f6c1c1049a0 2024-09-11T22:30:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.454+0000 7f6c13400640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6c000a2c10 0x7f6c000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.454+0000 7f6c13400640 1 -- 172.21.15.40:0/525660907 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f6c080cf8a0 con 0x7f6c1c1049a0 2024-09-11T22:30:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.454+0000 7f6c1aa00640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6c000a2c10 0x7f6c000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.455+0000 7f6c1aa00640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6c000a2c10 0x7f6c000a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009bd0 tx=0x7f6c0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.458+0000 7f6c13400640 1 -- 172.21.15.40:0/525660907 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c0809bc60 con 0x7f6c1c1049a0 2024-09-11T22:30:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.643+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c1c100cc0 con 0x7f6c000a2c10 2024-09-11T22:30:17.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.652+0000 7f6c13400640 1 -- 172.21.15.40:0/525660907 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340357 (secure 0 0 0) 0x7f6c1c100cc0 con 0x7f6c000a2c10 2024-09-11T22:30:17.657 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:17.659 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-11T22:30:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6c000a2c10 msgr2=0x7f6c000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6c000a2c10 0x7f6c000a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009bd0 tx=0x7f6c0c005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c1049a0 msgr2=0x7f6c1c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c1049a0 0x7f6c1c19ab50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e9f0 tx=0x7f6c0800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 shutdown_connections 2024-09-11T22:30:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f6c000a2c10 0x7f6c000a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c1c109120 0x7f6c1c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c1c1049a0 0x7f6c1c19ab50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 --2- 172.21.15.40:0/525660907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c1c103ff0 0x7f6c1c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.656+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 >> 172.21.15.40:0/525660907 conn(0x7f6c1c0ffa90 msgr2=0x7f6c1c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.657+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 shutdown_connections 2024-09-11T22:30:17.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:17.657+0000 7f6c21c00640 1 -- 172.21.15.40:0/525660907 wait complete. 2024-09-11T22:30:18.381 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:18 smithi040 ceph-mon[30787]: pgmap v365: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:18.381 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:18 smithi040 ceph-mon[30787]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:30:18.385 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:18 smithi146 ceph-mon[34996]: pgmap v365: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:18.386 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:18 smithi146 ceph-mon[34996]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:30:18.420 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2024-09-11T22:30:17.013507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657929,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":522,"num_read_kb":377,"num_write":354,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364224,"kb_used_data":14912,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124577600,"statfs":{"total":1151940427776,"available":1151567462400,"internally_reserved":0,"allocated":15269888,"data_stored":8499953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003907"},"pg_stats":[{"pgid":"2.1f","version":"93'9","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086788+0000","last_change":"2024-09-11T22:28:18.585171+0000","last_active":"2024-09-11T22:29:59.086788+0000","last_peered":"2024-09-11T22:29:59.086788+0000","last_clean":"2024-09-11T22:29:59.086788+0000","last_became_active":"2024-09-11T22:28:18.584790+0000","last_became_peered":"2024-09-11T22:28:18.584790+0000","last_unstale":"2024-09-11T22:29:59.086788+0000","last_undegraded":"2024-09-11T22:29:59.086788+0000","last_fullsized":"2024-09-11T22:29:59.086788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:53.528254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.813903+0000","last_change":"2024-09-11T22:29:59.813427+0000","last_active":"2024-09-11T22:29:59.813903+0000","last_peered":"2024-09-11T22:29:59.813903+0000","last_clean":"2024-09-11T22:29:59.813903+0000","last_became_active":"2024-09-11T22:29:59.812889+0000","last_became_peered":"2024-09-11T22:29:59.812889+0000","last_unstale":"2024-09-11T22:29:59.813903+0000","last_undegraded":"2024-09-11T22:29:59.813903+0000","last_fullsized":"2024-09-11T22:29:59.813903+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:34.696287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811225+0000","last_change":"2024-09-11T22:28:30.184272+0000","last_active":"2024-09-11T22:29:59.811225+0000","last_peered":"2024-09-11T22:29:59.811225+0000","last_clean":"2024-09-11T22:29:59.811225+0000","last_became_active":"2024-09-11T22:28:30.182956+0000","last_became_peered":"2024-09-11T22:28:30.182956+0000","last_unstale":"2024-09-11T22:29:59.811225+0000","last_undegraded":"2024-09-11T22:29:59.811225+0000","last_fullsized":"2024-09-11T22:29:59.811225+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.773131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085409+0000","last_change":"2024-09-11T22:28:18.782833+0000","last_active":"2024-09-11T22:29:59.085409+0000","last_peered":"2024-09-11T22:29:59.085409+0000","last_clean":"2024-09-11T22:29:59.085409+0000","last_became_active":"2024-09-11T22:28:18.781202+0000","last_became_peered":"2024-09-11T22:28:18.781202+0000","last_unstale":"2024-09-11T22:29:59.085409+0000","last_undegraded":"2024-09-11T22:29:59.085409+0000","last_fullsized":"2024-09-11T22:29:59.085409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:47.389717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388432+0000","last_change":"2024-09-11T22:28:21.126106+0000","last_active":"2024-09-11T22:29:59.388432+0000","last_peered":"2024-09-11T22:29:59.388432+0000","last_clean":"2024-09-11T22:29:59.388432+0000","last_became_active":"2024-09-11T22:28:21.125760+0000","last_became_peered":"2024-09-11T22:28:21.125760+0000","last_unstale":"2024-09-11T22:29:59.388432+0000","last_undegraded":"2024-09-11T22:29:59.388432+0000","last_fullsized":"2024-09-11T22:29:59.388432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:18.500241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.428837+0000","last_change":"2024-09-11T22:28:30.183343+0000","last_active":"2024-09-11T22:29:59.428837+0000","last_peered":"2024-09-11T22:29:59.428837+0000","last_clean":"2024-09-11T22:29:59.428837+0000","last_became_active":"2024-09-11T22:28:30.182811+0000","last_became_peered":"2024-09-11T22:28:30.182811+0000","last_unstale":"2024-09-11T22:29:59.428837+0000","last_undegraded":"2024-09-11T22:29:59.428837+0000","last_fullsized":"2024-09-11T22:29:59.428837+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:48:18.262267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084794+0000","last_change":"2024-09-11T22:28:18.586872+0000","last_active":"2024-09-11T22:29:59.084794+0000","last_peered":"2024-09-11T22:29:59.084794+0000","last_clean":"2024-09-11T22:29:59.084794+0000","last_became_active":"2024-09-11T22:28:18.586516+0000","last_became_peered":"2024-09-11T22:28:18.586516+0000","last_unstale":"2024-09-11T22:29:59.084794+0000","last_undegraded":"2024-09-11T22:29:59.084794+0000","last_fullsized":"2024-09-11T22:29:59.084794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:07.479936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756311+0000","last_change":"2024-09-11T22:28:21.132488+0000","last_active":"2024-09-11T22:29:59.756311+0000","last_peered":"2024-09-11T22:29:59.756311+0000","last_clean":"2024-09-11T22:29:59.756311+0000","last_became_active":"2024-09-11T22:28:21.132153+0000","last_became_peered":"2024-09-11T22:28:21.132153+0000","last_unstale":"2024-09-11T22:29:59.756311+0000","last_undegraded":"2024-09-11T22:29:59.756311+0000","last_fullsized":"2024-09-11T22:29:59.756311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:43.791896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429065+0000","last_change":"2024-09-11T22:28:30.190272+0000","last_active":"2024-09-11T22:29:59.429065+0000","last_peered":"2024-09-11T22:29:59.429065+0000","last_clean":"2024-09-11T22:29:59.429065+0000","last_became_active":"2024-09-11T22:28:30.189912+0000","last_became_peered":"2024-09-11T22:28:30.189912+0000","last_unstale":"2024-09-11T22:29:59.429065+0000","last_undegraded":"2024-09-11T22:29:59.429065+0000","last_fullsized":"2024-09-11T22:29:59.429065+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:56.166963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811468+0000","last_change":"2024-09-11T22:28:58.300107+0000","last_active":"2024-09-11T22:29:59.811468+0000","last_peered":"2024-09-11T22:29:59.811468+0000","last_clean":"2024-09-11T22:29:59.811468+0000","last_became_active":"2024-09-11T22:28:58.294806+0000","last_became_peered":"2024-09-11T22:28:58.294806+0000","last_unstale":"2024-09-11T22:29:59.811468+0000","last_undegraded":"2024-09-11T22:29:59.811468+0000","last_fullsized":"2024-09-11T22:29:59.811468+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:37.494929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215576+0000","last_change":"2024-09-11T22:28:21.128789+0000","last_active":"2024-09-11T22:29:59.215576+0000","last_peered":"2024-09-11T22:29:59.215576+0000","last_clean":"2024-09-11T22:29:59.215576+0000","last_became_active":"2024-09-11T22:28:21.128426+0000","last_became_peered":"2024-09-11T22:28:21.128426+0000","last_unstale":"2024-09-11T22:29:59.215576+0000","last_undegraded":"2024-09-11T22:29:59.215576+0000","last_fullsized":"2024-09-11T22:29:59.215576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:43.945247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.428991+0000","last_change":"2024-09-11T22:28:30.190240+0000","last_active":"2024-09-11T22:29:59.428991+0000","last_peered":"2024-09-11T22:29:59.428991+0000","last_clean":"2024-09-11T22:29:59.428991+0000","last_became_active":"2024-09-11T22:28:30.189826+0000","last_became_peered":"2024-09-11T22:28:30.189826+0000","last_unstale":"2024-09-11T22:29:59.428991+0000","last_undegraded":"2024-09-11T22:29:59.428991+0000","last_fullsized":"2024-09-11T22:29:59.428991+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.040193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811400+0000","last_change":"2024-09-11T22:28:21.124389+0000","last_active":"2024-09-11T22:29:59.811400+0000","last_peered":"2024-09-11T22:29:59.811400+0000","last_clean":"2024-09-11T22:29:59.811400+0000","last_became_active":"2024-09-11T22:28:21.124058+0000","last_became_peered":"2024-09-11T22:28:21.124058+0000","last_unstale":"2024-09-11T22:29:59.811400+0000","last_undegraded":"2024-09-11T22:29:59.811400+0000","last_fullsized":"2024-09-11T22:29:59.811400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:02.735365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":23,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811588+0000","last_change":"2024-09-11T22:28:58.304916+0000","last_active":"2024-09-11T22:29:59.811588+0000","last_peered":"2024-09-11T22:29:59.811588+0000","last_clean":"2024-09-11T22:29:59.811588+0000","last_became_active":"2024-09-11T22:28:58.296717+0000","last_became_peered":"2024-09-11T22:28:58.296717+0000","last_unstale":"2024-09-11T22:29:59.811588+0000","last_undegraded":"2024-09-11T22:29:59.811588+0000","last_fullsized":"2024-09-11T22:29:59.811588+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:30.044871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429328+0000","last_change":"2024-09-11T22:28:30.183135+0000","last_active":"2024-09-11T22:29:59.429328+0000","last_peered":"2024-09-11T22:29:59.429328+0000","last_clean":"2024-09-11T22:29:59.429328+0000","last_became_active":"2024-09-11T22:28:30.182768+0000","last_became_peered":"2024-09-11T22:28:30.182768+0000","last_unstale":"2024-09-11T22:29:59.429328+0000","last_undegraded":"2024-09-11T22:29:59.429328+0000","last_fullsized":"2024-09-11T22:29:59.429328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:26.703807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084383+0000","last_change":"2024-09-11T22:28:21.128609+0000","last_active":"2024-09-11T22:29:59.084383+0000","last_peered":"2024-09-11T22:29:59.084383+0000","last_clean":"2024-09-11T22:29:59.084383+0000","last_became_active":"2024-09-11T22:28:21.128240+0000","last_became_peered":"2024-09-11T22:28:21.128240+0000","last_unstale":"2024-09-11T22:29:59.084383+0000","last_undegraded":"2024-09-11T22:29:59.084383+0000","last_fullsized":"2024-09-11T22:29:59.084383+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:41.610223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811599+0000","last_change":"2024-09-11T22:28:18.588047+0000","last_active":"2024-09-11T22:29:59.811599+0000","last_peered":"2024-09-11T22:29:59.811599+0000","last_clean":"2024-09-11T22:29:59.811599+0000","last_became_active":"2024-09-11T22:28:18.587580+0000","last_became_peered":"2024-09-11T22:28:18.587580+0000","last_unstale":"2024-09-11T22:29:59.811599+0000","last_undegraded":"2024-09-11T22:29:59.811599+0000","last_fullsized":"2024-09-11T22:29:59.811599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:01.625014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429302+0000","last_change":"2024-09-11T22:28:30.194188+0000","last_active":"2024-09-11T22:29:59.429302+0000","last_peered":"2024-09-11T22:29:59.429302+0000","last_clean":"2024-09-11T22:29:59.429302+0000","last_became_active":"2024-09-11T22:28:30.193779+0000","last_became_peered":"2024-09-11T22:28:30.193779+0000","last_unstale":"2024-09-11T22:29:59.429302+0000","last_undegraded":"2024-09-11T22:29:59.429302+0000","last_fullsized":"2024-09-11T22:29:59.429302+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:37.328545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811615+0000","last_change":"2024-09-11T22:28:21.113112+0000","last_active":"2024-09-11T22:29:59.811615+0000","last_peered":"2024-09-11T22:29:59.811615+0000","last_clean":"2024-09-11T22:29:59.811615+0000","last_became_active":"2024-09-11T22:28:21.112644+0000","last_became_peered":"2024-09-11T22:28:21.112644+0000","last_unstale":"2024-09-11T22:29:59.811615+0000","last_undegraded":"2024-09-11T22:29:59.811615+0000","last_fullsized":"2024-09-11T22:29:59.811615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:47.520760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084340+0000","last_change":"2024-09-11T22:28:18.587008+0000","last_active":"2024-09-11T22:29:59.084340+0000","last_peered":"2024-09-11T22:29:59.084340+0000","last_clean":"2024-09-11T22:29:59.084340+0000","last_became_active":"2024-09-11T22:28:18.586519+0000","last_became_peered":"2024-09-11T22:28:18.586519+0000","last_unstale":"2024-09-11T22:29:59.084340+0000","last_undegraded":"2024-09-11T22:29:59.084340+0000","last_fullsized":"2024-09-11T22:29:59.084340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:53.600253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086266+0000","last_change":"2024-09-11T22:28:30.182409+0000","last_active":"2024-09-11T22:29:59.086266+0000","last_peered":"2024-09-11T22:29:59.086266+0000","last_clean":"2024-09-11T22:29:59.086266+0000","last_became_active":"2024-09-11T22:28:30.181991+0000","last_became_peered":"2024-09-11T22:28:30.181991+0000","last_unstale":"2024-09-11T22:29:59.086266+0000","last_undegraded":"2024-09-11T22:29:59.086266+0000","last_fullsized":"2024-09-11T22:29:59.086266+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:11.997540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084281+0000","last_change":"2024-09-11T22:28:21.120079+0000","last_active":"2024-09-11T22:29:59.084281+0000","last_peered":"2024-09-11T22:29:59.084281+0000","last_clean":"2024-09-11T22:29:59.084281+0000","last_became_active":"2024-09-11T22:28:21.119691+0000","last_became_peered":"2024-09-11T22:28:21.119691+0000","last_unstale":"2024-09-11T22:29:59.084281+0000","last_undegraded":"2024-09-11T22:29:59.084281+0000","last_fullsized":"2024-09-11T22:29:59.084281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:06.447839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.755927+0000","last_change":"2024-09-11T22:28:18.780774+0000","last_active":"2024-09-11T22:29:59.755927+0000","last_peered":"2024-09-11T22:29:59.755927+0000","last_clean":"2024-09-11T22:29:59.755927+0000","last_became_active":"2024-09-11T22:28:18.780460+0000","last_became_peered":"2024-09-11T22:28:18.780460+0000","last_unstale":"2024-09-11T22:29:59.755927+0000","last_undegraded":"2024-09-11T22:29:59.755927+0000","last_fullsized":"2024-09-11T22:29:59.755927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:43:03.157973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429636+0000","last_change":"2024-09-11T22:28:30.177658+0000","last_active":"2024-09-11T22:29:59.429636+0000","last_peered":"2024-09-11T22:29:59.429636+0000","last_clean":"2024-09-11T22:29:59.429636+0000","last_became_active":"2024-09-11T22:28:30.177237+0000","last_became_peered":"2024-09-11T22:28:30.177237+0000","last_unstale":"2024-09-11T22:29:59.429636+0000","last_undegraded":"2024-09-11T22:29:59.429636+0000","last_fullsized":"2024-09-11T22:29:59.429636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:43.495545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388324+0000","last_change":"2024-09-11T22:28:21.127248+0000","last_active":"2024-09-11T22:29:59.388324+0000","last_peered":"2024-09-11T22:29:59.388324+0000","last_clean":"2024-09-11T22:29:59.388324+0000","last_became_active":"2024-09-11T22:28:21.126927+0000","last_became_peered":"2024-09-11T22:28:21.126927+0000","last_unstale":"2024-09-11T22:29:59.388324+0000","last_undegraded":"2024-09-11T22:29:59.388324+0000","last_fullsized":"2024-09-11T22:29:59.388324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:22.219441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429803+0000","last_change":"2024-09-11T22:28:18.728680+0000","last_active":"2024-09-11T22:29:59.429803+0000","last_peered":"2024-09-11T22:29:59.429803+0000","last_clean":"2024-09-11T22:29:59.429803+0000","last_became_active":"2024-09-11T22:28:18.728235+0000","last_became_peered":"2024-09-11T22:28:18.728235+0000","last_unstale":"2024-09-11T22:29:59.429803+0000","last_undegraded":"2024-09-11T22:29:59.429803+0000","last_fullsized":"2024-09-11T22:29:59.429803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:26.002304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811363+0000","last_change":"2024-09-11T22:28:30.179945+0000","last_active":"2024-09-11T22:29:59.811363+0000","last_peered":"2024-09-11T22:29:59.811363+0000","last_clean":"2024-09-11T22:29:59.811363+0000","last_became_active":"2024-09-11T22:28:30.179089+0000","last_became_peered":"2024-09-11T22:28:30.179089+0000","last_unstale":"2024-09-11T22:29:59.811363+0000","last_undegraded":"2024-09-11T22:29:59.811363+0000","last_fullsized":"2024-09-11T22:29:59.811363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:04:34.126678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085318+0000","last_change":"2024-09-11T22:28:21.120411+0000","last_active":"2024-09-11T22:29:59.085318+0000","last_peered":"2024-09-11T22:29:59.085318+0000","last_clean":"2024-09-11T22:29:59.085318+0000","last_became_active":"2024-09-11T22:28:21.120048+0000","last_became_peered":"2024-09-11T22:28:21.120048+0000","last_unstale":"2024-09-11T22:29:59.085318+0000","last_undegraded":"2024-09-11T22:29:59.085318+0000","last_fullsized":"2024-09-11T22:29:59.085318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:52:07.194042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'13","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086424+0000","last_change":"2024-09-11T22:28:18.581589+0000","last_active":"2024-09-11T22:29:59.086424+0000","last_peered":"2024-09-11T22:29:59.086424+0000","last_clean":"2024-09-11T22:29:59.086424+0000","last_became_active":"2024-09-11T22:28:18.581104+0000","last_became_peered":"2024-09-11T22:28:18.581104+0000","last_unstale":"2024-09-11T22:29:59.086424+0000","last_undegraded":"2024-09-11T22:29:59.086424+0000","last_fullsized":"2024-09-11T22:29:59.086424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:55.318466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083872+0000","last_change":"2024-09-11T22:28:30.188454+0000","last_active":"2024-09-11T22:29:59.083872+0000","last_peered":"2024-09-11T22:29:59.083872+0000","last_clean":"2024-09-11T22:29:59.083872+0000","last_became_active":"2024-09-11T22:28:30.188048+0000","last_became_peered":"2024-09-11T22:28:30.188048+0000","last_unstale":"2024-09-11T22:29:59.083872+0000","last_undegraded":"2024-09-11T22:29:59.083872+0000","last_fullsized":"2024-09-11T22:29:59.083872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:54.994664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083621+0000","last_change":"2024-09-11T22:28:21.122495+0000","last_active":"2024-09-11T22:29:59.083621+0000","last_peered":"2024-09-11T22:29:59.083621+0000","last_clean":"2024-09-11T22:29:59.083621+0000","last_became_active":"2024-09-11T22:28:21.122157+0000","last_became_peered":"2024-09-11T22:28:21.122157+0000","last_unstale":"2024-09-11T22:29:59.083621+0000","last_undegraded":"2024-09-11T22:29:59.083621+0000","last_fullsized":"2024-09-11T22:29:59.083621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.126632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'1","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084933+0000","last_change":"2024-09-11T22:28:18.781729+0000","last_active":"2024-09-11T22:29:59.084933+0000","last_peered":"2024-09-11T22:29:59.084933+0000","last_clean":"2024-09-11T22:29:59.084933+0000","last_became_active":"2024-09-11T22:28:18.781391+0000","last_became_peered":"2024-09-11T22:28:18.781391+0000","last_unstale":"2024-09-11T22:29:59.084933+0000","last_undegraded":"2024-09-11T22:29:59.084933+0000","last_fullsized":"2024-09-11T22:29:59.084933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.711022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811722+0000","last_change":"2024-09-11T22:28:30.178873+0000","last_active":"2024-09-11T22:29:59.811722+0000","last_peered":"2024-09-11T22:29:59.811722+0000","last_clean":"2024-09-11T22:29:59.811722+0000","last_became_active":"2024-09-11T22:28:30.178479+0000","last_became_peered":"2024-09-11T22:28:30.178479+0000","last_unstale":"2024-09-11T22:29:59.811722+0000","last_undegraded":"2024-09-11T22:29:59.811722+0000","last_fullsized":"2024-09-11T22:29:59.811722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:18.091351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087453+0000","last_change":"2024-09-11T22:28:21.132816+0000","last_active":"2024-09-11T22:29:59.087453+0000","last_peered":"2024-09-11T22:29:59.087453+0000","last_clean":"2024-09-11T22:29:59.087453+0000","last_became_active":"2024-09-11T22:28:21.132445+0000","last_became_peered":"2024-09-11T22:28:21.132445+0000","last_unstale":"2024-09-11T22:29:59.087453+0000","last_undegraded":"2024-09-11T22:29:59.087453+0000","last_fullsized":"2024-09-11T22:29:59.087453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:23.286982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086223+0000","last_change":"2024-09-11T22:28:18.782841+0000","last_active":"2024-09-11T22:29:59.086223+0000","last_peered":"2024-09-11T22:29:59.086223+0000","last_clean":"2024-09-11T22:29:59.086223+0000","last_became_active":"2024-09-11T22:28:18.782482+0000","last_became_peered":"2024-09-11T22:28:18.782482+0000","last_unstale":"2024-09-11T22:29:59.086223+0000","last_undegraded":"2024-09-11T22:29:59.086223+0000","last_fullsized":"2024-09-11T22:29:59.086223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:40.439534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084304+0000","last_change":"2024-09-11T22:28:30.181202+0000","last_active":"2024-09-11T22:29:59.084304+0000","last_peered":"2024-09-11T22:29:59.084304+0000","last_clean":"2024-09-11T22:29:59.084304+0000","last_became_active":"2024-09-11T22:28:30.180770+0000","last_became_peered":"2024-09-11T22:28:30.180770+0000","last_unstale":"2024-09-11T22:29:59.084304+0000","last_undegraded":"2024-09-11T22:29:59.084304+0000","last_fullsized":"2024-09-11T22:29:59.084304+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:53.019563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.389072+0000","last_change":"2024-09-11T22:29:59.389072+0000","last_active":"2024-09-11T22:29:59.389072+0000","last_peered":"2024-09-11T22:29:59.389072+0000","last_clean":"2024-09-11T22:29:59.389072+0000","last_became_active":"2024-09-11T22:29:59.388745+0000","last_became_peered":"2024-09-11T22:29:59.388745+0000","last_unstale":"2024-09-11T22:29:59.389072+0000","last_undegraded":"2024-09-11T22:29:59.389072+0000","last_fullsized":"2024-09-11T22:29:59.389072+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:04.009871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811555+0000","last_change":"2024-09-11T22:28:18.583456+0000","last_active":"2024-09-11T22:29:59.811555+0000","last_peered":"2024-09-11T22:29:59.811555+0000","last_clean":"2024-09-11T22:29:59.811555+0000","last_became_active":"2024-09-11T22:28:18.582547+0000","last_became_peered":"2024-09-11T22:28:18.582547+0000","last_unstale":"2024-09-11T22:29:59.811555+0000","last_undegraded":"2024-09-11T22:29:59.811555+0000","last_fullsized":"2024-09-11T22:29:59.811555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:16.128672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083480+0000","last_change":"2024-09-11T22:28:30.180057+0000","last_active":"2024-09-11T22:29:59.083480+0000","last_peered":"2024-09-11T22:29:59.083480+0000","last_clean":"2024-09-11T22:29:59.083480+0000","last_became_active":"2024-09-11T22:28:30.179653+0000","last_became_peered":"2024-09-11T22:28:30.179653+0000","last_unstale":"2024-09-11T22:29:59.083480+0000","last_undegraded":"2024-09-11T22:29:59.083480+0000","last_fullsized":"2024-09-11T22:29:59.083480+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:08.525849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215312+0000","last_change":"2024-09-11T22:28:21.121130+0000","last_active":"2024-09-11T22:29:59.215312+0000","last_peered":"2024-09-11T22:29:59.215312+0000","last_clean":"2024-09-11T22:29:59.215312+0000","last_became_active":"2024-09-11T22:28:21.119673+0000","last_became_peered":"2024-09-11T22:28:21.119673+0000","last_unstale":"2024-09-11T22:29:59.215312+0000","last_undegraded":"2024-09-11T22:29:59.215312+0000","last_fullsized":"2024-09-11T22:29:59.215312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:48.095820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'4","reported_seq":105,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:11.445130+0000","last_change":"2024-09-11T22:28:18.781124+0000","last_active":"2024-09-11T22:30:11.445130+0000","last_peered":"2024-09-11T22:30:11.445130+0000","last_clean":"2024-09-11T22:30:11.445130+0000","last_became_active":"2024-09-11T22:28:18.780600+0000","last_became_peered":"2024-09-11T22:28:18.780600+0000","last_unstale":"2024-09-11T22:30:11.445130+0000","last_undegraded":"2024-09-11T22:30:11.445130+0000","last_fullsized":"2024-09-11T22:30:11.445130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.032623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083180+0000","last_change":"2024-09-11T22:28:30.180121+0000","last_active":"2024-09-11T22:29:59.083180+0000","last_peered":"2024-09-11T22:29:59.083180+0000","last_clean":"2024-09-11T22:29:59.083180+0000","last_became_active":"2024-09-11T22:28:30.179736+0000","last_became_peered":"2024-09-11T22:28:30.179736+0000","last_unstale":"2024-09-11T22:29:59.083180+0000","last_undegraded":"2024-09-11T22:29:59.083180+0000","last_fullsized":"2024-09-11T22:29:59.083180+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.199958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.082984+0000","last_change":"2024-09-11T22:28:21.111931+0000","last_active":"2024-09-11T22:29:59.082984+0000","last_peered":"2024-09-11T22:29:59.082984+0000","last_clean":"2024-09-11T22:29:59.082984+0000","last_became_active":"2024-09-11T22:28:21.111219+0000","last_became_peered":"2024-09-11T22:28:21.111219+0000","last_unstale":"2024-09-11T22:29:59.082984+0000","last_undegraded":"2024-09-11T22:29:59.082984+0000","last_fullsized":"2024-09-11T22:29:59.082984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:02.454748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811224+0000","last_change":"2024-09-11T22:28:18.583841+0000","last_active":"2024-09-11T22:29:59.811224+0000","last_peered":"2024-09-11T22:29:59.811224+0000","last_clean":"2024-09-11T22:29:59.811224+0000","last_became_active":"2024-09-11T22:28:18.583459+0000","last_became_peered":"2024-09-11T22:28:18.583459+0000","last_unstale":"2024-09-11T22:29:59.811224+0000","last_undegraded":"2024-09-11T22:29:59.811224+0000","last_fullsized":"2024-09-11T22:29:59.811224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:05.174157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215768+0000","last_change":"2024-09-11T22:28:30.188646+0000","last_active":"2024-09-11T22:29:59.215768+0000","last_peered":"2024-09-11T22:29:59.215768+0000","last_clean":"2024-09-11T22:29:59.215768+0000","last_became_active":"2024-09-11T22:28:30.188243+0000","last_became_peered":"2024-09-11T22:28:30.188243+0000","last_unstale":"2024-09-11T22:29:59.215768+0000","last_undegraded":"2024-09-11T22:29:59.215768+0000","last_fullsized":"2024-09-11T22:29:59.215768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:46.794048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084664+0000","last_change":"2024-09-11T22:28:21.134979+0000","last_active":"2024-09-11T22:29:59.084664+0000","last_peered":"2024-09-11T22:29:59.084664+0000","last_clean":"2024-09-11T22:29:59.084664+0000","last_became_active":"2024-09-11T22:28:21.130803+0000","last_became_peered":"2024-09-11T22:28:21.130803+0000","last_unstale":"2024-09-11T22:29:59.084664+0000","last_undegraded":"2024-09-11T22:29:59.084664+0000","last_fullsized":"2024-09-11T22:29:59.084664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:04.385857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'3","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429477+0000","last_change":"2024-09-11T22:28:18.583434+0000","last_active":"2024-09-11T22:29:59.429477+0000","last_peered":"2024-09-11T22:29:59.429477+0000","last_clean":"2024-09-11T22:29:59.429477+0000","last_became_active":"2024-09-11T22:28:18.583092+0000","last_became_peered":"2024-09-11T22:28:18.583092+0000","last_unstale":"2024-09-11T22:29:59.429477+0000","last_undegraded":"2024-09-11T22:29:59.429477+0000","last_fullsized":"2024-09-11T22:29:59.429477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:10.849520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":355,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811365+0000","last_change":"2024-09-11T22:27:00.252474+0000","last_active":"2024-09-11T22:29:59.811365+0000","last_peered":"2024-09-11T22:29:59.811365+0000","last_clean":"2024-09-11T22:29:59.811365+0000","last_became_active":"2024-09-11T22:27:00.252064+0000","last_became_peered":"2024-09-11T22:27:00.252064+0000","last_unstale":"2024-09-11T22:29:59.811365+0000","last_undegraded":"2024-09-11T22:29:59.811365+0000","last_fullsized":"2024-09-11T22:29:59.811365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:23:19.615362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:23:19.615362+0000","last_clean_scrub_stamp":"2024-09-11T22:23:19.615362+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:03.016822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811572+0000","last_change":"2024-09-11T22:28:30.181432+0000","last_active":"2024-09-11T22:29:59.811572+0000","last_peered":"2024-09-11T22:29:59.811572+0000","last_clean":"2024-09-11T22:29:59.811572+0000","last_became_active":"2024-09-11T22:28:30.180994+0000","last_became_peered":"2024-09-11T22:28:30.180994+0000","last_unstale":"2024-09-11T22:29:59.811572+0000","last_undegraded":"2024-09-11T22:29:59.811572+0000","last_fullsized":"2024-09-11T22:29:59.811572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:36.258723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811780+0000","last_change":"2024-09-11T22:28:21.124641+0000","last_active":"2024-09-11T22:29:59.811780+0000","last_peered":"2024-09-11T22:29:59.811780+0000","last_clean":"2024-09-11T22:29:59.811780+0000","last_became_active":"2024-09-11T22:28:21.124266+0000","last_became_peered":"2024-09-11T22:28:21.124266+0000","last_unstale":"2024-09-11T22:29:59.811780+0000","last_undegraded":"2024-09-11T22:29:59.811780+0000","last_fullsized":"2024-09-11T22:29:59.811780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:54.098515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811869+0000","last_change":"2024-09-11T22:28:18.781028+0000","last_active":"2024-09-11T22:29:59.811869+0000","last_peered":"2024-09-11T22:29:59.811869+0000","last_clean":"2024-09-11T22:29:59.811869+0000","last_became_active":"2024-09-11T22:28:18.780566+0000","last_became_peered":"2024-09-11T22:28:18.780566+0000","last_unstale":"2024-09-11T22:29:59.811869+0000","last_undegraded":"2024-09-11T22:29:59.811869+0000","last_fullsized":"2024-09-11T22:29:59.811869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:14.760302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.755952+0000","last_change":"2024-09-11T22:28:58.297083+0000","last_active":"2024-09-11T22:29:59.755952+0000","last_peered":"2024-09-11T22:29:59.755952+0000","last_clean":"2024-09-11T22:29:59.755952+0000","last_became_active":"2024-09-11T22:28:58.296577+0000","last_became_peered":"2024-09-11T22:28:58.296577+0000","last_unstale":"2024-09-11T22:29:59.755952+0000","last_undegraded":"2024-09-11T22:29:59.755952+0000","last_fullsized":"2024-09-11T22:29:59.755952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:42.592248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811556+0000","last_change":"2024-09-11T22:28:21.130748+0000","last_active":"2024-09-11T22:29:59.811556+0000","last_peered":"2024-09-11T22:29:59.811556+0000","last_clean":"2024-09-11T22:29:59.811556+0000","last_became_active":"2024-09-11T22:28:21.130397+0000","last_became_peered":"2024-09-11T22:28:21.130397+0000","last_unstale":"2024-09-11T22:29:59.811556+0000","last_undegraded":"2024-09-11T22:29:59.811556+0000","last_fullsized":"2024-09-11T22:29:59.811556+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:09.683157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215830+0000","last_change":"2024-09-11T22:28:18.581826+0000","last_active":"2024-09-11T22:29:59.215830+0000","last_peered":"2024-09-11T22:29:59.215830+0000","last_clean":"2024-09-11T22:29:59.215830+0000","last_became_active":"2024-09-11T22:28:18.581485+0000","last_became_peered":"2024-09-11T22:28:18.581485+0000","last_unstale":"2024-09-11T22:29:59.215830+0000","last_undegraded":"2024-09-11T22:29:59.215830+0000","last_fullsized":"2024-09-11T22:29:59.215830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:10.930762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388184+0000","last_change":"2024-09-11T22:28:30.188296+0000","last_active":"2024-09-11T22:29:59.388184+0000","last_peered":"2024-09-11T22:29:59.388184+0000","last_clean":"2024-09-11T22:29:59.388184+0000","last_became_active":"2024-09-11T22:28:30.186935+0000","last_became_peered":"2024-09-11T22:28:30.186935+0000","last_unstale":"2024-09-11T22:29:59.388184+0000","last_undegraded":"2024-09-11T22:29:59.388184+0000","last_fullsized":"2024-09-11T22:29:59.388184+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:05.918883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811749+0000","last_change":"2024-09-11T22:28:21.120482+0000","last_active":"2024-09-11T22:29:59.811749+0000","last_peered":"2024-09-11T22:29:59.811749+0000","last_clean":"2024-09-11T22:29:59.811749+0000","last_became_active":"2024-09-11T22:28:21.119896+0000","last_became_peered":"2024-09-11T22:28:21.119896+0000","last_unstale":"2024-09-11T22:29:59.811749+0000","last_undegraded":"2024-09-11T22:29:59.811749+0000","last_fullsized":"2024-09-11T22:29:59.811749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:04.651745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083613+0000","last_change":"2024-09-11T22:28:58.407709+0000","last_active":"2024-09-11T22:29:59.083613+0000","last_peered":"2024-09-11T22:29:59.083613+0000","last_clean":"2024-09-11T22:29:59.083613+0000","last_became_active":"2024-09-11T22:28:58.404756+0000","last_became_peered":"2024-09-11T22:28:58.404756+0000","last_unstale":"2024-09-11T22:29:59.083613+0000","last_undegraded":"2024-09-11T22:29:59.083613+0000","last_fullsized":"2024-09-11T22:29:59.083613+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.125354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215112+0000","last_change":"2024-09-11T22:28:30.180575+0000","last_active":"2024-09-11T22:29:59.215112+0000","last_peered":"2024-09-11T22:29:59.215112+0000","last_clean":"2024-09-11T22:29:59.215112+0000","last_became_active":"2024-09-11T22:28:30.180057+0000","last_became_peered":"2024-09-11T22:28:30.180057+0000","last_unstale":"2024-09-11T22:29:59.215112+0000","last_undegraded":"2024-09-11T22:29:59.215112+0000","last_fullsized":"2024-09-11T22:29:59.215112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:18.130207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812001+0000","last_change":"2024-09-11T22:28:21.122167+0000","last_active":"2024-09-11T22:29:59.812001+0000","last_peered":"2024-09-11T22:29:59.812001+0000","last_clean":"2024-09-11T22:29:59.812001+0000","last_became_active":"2024-09-11T22:28:21.121777+0000","last_became_peered":"2024-09-11T22:28:21.121777+0000","last_unstale":"2024-09-11T22:29:59.812001+0000","last_undegraded":"2024-09-11T22:29:59.812001+0000","last_fullsized":"2024-09-11T22:29:59.812001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:42.316290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085230+0000","last_change":"2024-09-11T22:28:18.583557+0000","last_active":"2024-09-11T22:29:59.085230+0000","last_peered":"2024-09-11T22:29:59.085230+0000","last_clean":"2024-09-11T22:29:59.085230+0000","last_became_active":"2024-09-11T22:28:18.583153+0000","last_became_peered":"2024-09-11T22:28:18.583153+0000","last_unstale":"2024-09-11T22:29:59.085230+0000","last_undegraded":"2024-09-11T22:29:59.085230+0000","last_fullsized":"2024-09-11T22:29:59.085230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:40.246846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215246+0000","last_change":"2024-09-11T22:28:30.184545+0000","last_active":"2024-09-11T22:29:59.215246+0000","last_peered":"2024-09-11T22:29:59.215246+0000","last_clean":"2024-09-11T22:29:59.215246+0000","last_became_active":"2024-09-11T22:28:30.184135+0000","last_became_peered":"2024-09-11T22:28:30.184135+0000","last_unstale":"2024-09-11T22:29:59.215246+0000","last_undegraded":"2024-09-11T22:29:59.215246+0000","last_fullsized":"2024-09-11T22:29:59.215246+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:11.088364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.758323+0000","last_change":"2024-09-11T22:29:59.757773+0000","last_active":"2024-09-11T22:29:59.758323+0000","last_peered":"2024-09-11T22:29:59.758323+0000","last_clean":"2024-09-11T22:29:59.758323+0000","last_became_active":"2024-09-11T22:29:59.757367+0000","last_became_peered":"2024-09-11T22:29:59.757367+0000","last_unstale":"2024-09-11T22:29:59.758323+0000","last_undegraded":"2024-09-11T22:29:59.758323+0000","last_fullsized":"2024-09-11T22:29:59.758323+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:53.196860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,1],"acting":[9,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.10","version":"93'15","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084283+0000","last_change":"2024-09-11T22:28:18.781320+0000","last_active":"2024-09-11T22:29:59.084283+0000","last_peered":"2024-09-11T22:29:59.084283+0000","last_clean":"2024-09-11T22:29:59.084283+0000","last_became_active":"2024-09-11T22:28:18.780987+0000","last_became_peered":"2024-09-11T22:28:18.780987+0000","last_unstale":"2024-09-11T22:29:59.084283+0000","last_undegraded":"2024-09-11T22:29:59.084283+0000","last_fullsized":"2024-09-11T22:29:59.084283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:03.717586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083509+0000","last_change":"2024-09-11T22:28:30.185048+0000","last_active":"2024-09-11T22:29:59.083509+0000","last_peered":"2024-09-11T22:29:59.083509+0000","last_clean":"2024-09-11T22:29:59.083509+0000","last_became_active":"2024-09-11T22:28:30.184652+0000","last_became_peered":"2024-09-11T22:28:30.184652+0000","last_unstale":"2024-09-11T22:29:59.083509+0000","last_undegraded":"2024-09-11T22:29:59.083509+0000","last_fullsized":"2024-09-11T22:29:59.083509+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:29.449432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811149+0000","last_change":"2024-09-11T22:28:21.126875+0000","last_active":"2024-09-11T22:29:59.811149+0000","last_peered":"2024-09-11T22:29:59.811149+0000","last_clean":"2024-09-11T22:29:59.811149+0000","last_became_active":"2024-09-11T22:28:21.126549+0000","last_became_peered":"2024-09-11T22:28:21.126549+0000","last_unstale":"2024-09-11T22:29:59.811149+0000","last_undegraded":"2024-09-11T22:29:59.811149+0000","last_fullsized":"2024-09-11T22:29:59.811149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:16.410693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'4","reported_seq":108,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:11.445409+0000","last_change":"2024-09-11T22:28:18.586008+0000","last_active":"2024-09-11T22:30:11.445409+0000","last_peered":"2024-09-11T22:30:11.445409+0000","last_clean":"2024-09-11T22:30:11.445409+0000","last_became_active":"2024-09-11T22:28:18.585254+0000","last_became_peered":"2024-09-11T22:28:18.585254+0000","last_unstale":"2024-09-11T22:30:11.445409+0000","last_undegraded":"2024-09-11T22:30:11.445409+0000","last_fullsized":"2024-09-11T22:30:11.445409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:50.083339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085109+0000","last_change":"2024-09-11T22:28:58.323573+0000","last_active":"2024-09-11T22:29:59.085109+0000","last_peered":"2024-09-11T22:29:59.085109+0000","last_clean":"2024-09-11T22:29:59.085109+0000","last_became_active":"2024-09-11T22:28:58.323233+0000","last_became_peered":"2024-09-11T22:28:58.323233+0000","last_unstale":"2024-09-11T22:29:59.085109+0000","last_undegraded":"2024-09-11T22:29:59.085109+0000","last_fullsized":"2024-09-11T22:29:59.085109+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:33.319535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811411+0000","last_change":"2024-09-11T22:28:21.133655+0000","last_active":"2024-09-11T22:29:59.811411+0000","last_peered":"2024-09-11T22:29:59.811411+0000","last_clean":"2024-09-11T22:29:59.811411+0000","last_became_active":"2024-09-11T22:28:21.133296+0000","last_became_peered":"2024-09-11T22:28:21.133296+0000","last_unstale":"2024-09-11T22:29:59.811411+0000","last_undegraded":"2024-09-11T22:29:59.811411+0000","last_fullsized":"2024-09-11T22:29:59.811411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:54.956883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215599+0000","last_change":"2024-09-11T22:28:18.585001+0000","last_active":"2024-09-11T22:29:59.215599+0000","last_peered":"2024-09-11T22:29:59.215599+0000","last_clean":"2024-09-11T22:29:59.215599+0000","last_became_active":"2024-09-11T22:28:18.584570+0000","last_became_peered":"2024-09-11T22:28:18.584570+0000","last_unstale":"2024-09-11T22:29:59.215599+0000","last_undegraded":"2024-09-11T22:29:59.215599+0000","last_fullsized":"2024-09-11T22:29:59.215599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:51.512138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811613+0000","last_change":"2024-09-11T22:28:30.192923+0000","last_active":"2024-09-11T22:29:59.811613+0000","last_peered":"2024-09-11T22:29:59.811613+0000","last_clean":"2024-09-11T22:29:59.811613+0000","last_became_active":"2024-09-11T22:28:30.192600+0000","last_became_peered":"2024-09-11T22:28:30.192600+0000","last_unstale":"2024-09-11T22:29:59.811613+0000","last_undegraded":"2024-09-11T22:29:59.811613+0000","last_fullsized":"2024-09-11T22:29:59.811613+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:24.368842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083093+0000","last_change":"2024-09-11T22:28:21.131088+0000","last_active":"2024-09-11T22:29:59.083093+0000","last_peered":"2024-09-11T22:29:59.083093+0000","last_clean":"2024-09-11T22:29:59.083093+0000","last_became_active":"2024-09-11T22:28:21.127001+0000","last_became_peered":"2024-09-11T22:28:21.127001+0000","last_unstale":"2024-09-11T22:29:59.083093+0000","last_undegraded":"2024-09-11T22:29:59.083093+0000","last_fullsized":"2024-09-11T22:29:59.083093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:50.297619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'6","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812341+0000","last_change":"2024-09-11T22:28:18.587245+0000","last_active":"2024-09-11T22:29:59.812341+0000","last_peered":"2024-09-11T22:29:59.812341+0000","last_clean":"2024-09-11T22:29:59.812341+0000","last_became_active":"2024-09-11T22:28:18.586873+0000","last_became_peered":"2024-09-11T22:28:18.586873+0000","last_unstale":"2024-09-11T22:29:59.812341+0000","last_undegraded":"2024-09-11T22:29:59.812341+0000","last_fullsized":"2024-09-11T22:29:59.812341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:27.715781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215565+0000","last_change":"2024-09-11T22:28:30.183839+0000","last_active":"2024-09-11T22:29:59.215565+0000","last_peered":"2024-09-11T22:29:59.215565+0000","last_clean":"2024-09-11T22:29:59.215565+0000","last_became_active":"2024-09-11T22:28:30.183382+0000","last_became_peered":"2024-09-11T22:28:30.183382+0000","last_unstale":"2024-09-11T22:29:59.215565+0000","last_undegraded":"2024-09-11T22:29:59.215565+0000","last_fullsized":"2024-09-11T22:29:59.215565+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:31.144195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084623+0000","last_change":"2024-09-11T22:28:21.116932+0000","last_active":"2024-09-11T22:29:59.084623+0000","last_peered":"2024-09-11T22:29:59.084623+0000","last_clean":"2024-09-11T22:29:59.084623+0000","last_became_active":"2024-09-11T22:28:21.116285+0000","last_became_peered":"2024-09-11T22:28:21.116285+0000","last_unstale":"2024-09-11T22:29:59.084623+0000","last_undegraded":"2024-09-11T22:29:59.084623+0000","last_fullsized":"2024-09-11T22:29:59.084623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:04.737879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'32","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:15.450733+0000","last_change":"2024-09-11T22:28:18.581616+0000","last_active":"2024-09-11T22:30:15.450733+0000","last_peered":"2024-09-11T22:30:15.450733+0000","last_clean":"2024-09-11T22:30:15.450733+0000","last_became_active":"2024-09-11T22:28:18.581218+0000","last_became_peered":"2024-09-11T22:28:18.581218+0000","last_unstale":"2024-09-11T22:30:15.450733+0000","last_undegraded":"2024-09-11T22:30:15.450733+0000","last_fullsized":"2024-09-11T22:30:15.450733+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:10.351050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":133,"num_read_kb":127,"num_write":33,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087034+0000","last_change":"2024-09-11T22:28:58.297256+0000","last_active":"2024-09-11T22:29:59.087034+0000","last_peered":"2024-09-11T22:29:59.087034+0000","last_clean":"2024-09-11T22:29:59.087034+0000","last_became_active":"2024-09-11T22:28:58.296671+0000","last_became_peered":"2024-09-11T22:28:58.296671+0000","last_unstale":"2024-09-11T22:29:59.087034+0000","last_undegraded":"2024-09-11T22:29:59.087034+0000","last_fullsized":"2024-09-11T22:29:59.087034+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:31.240144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756311+0000","last_change":"2024-09-11T22:28:21.128792+0000","last_active":"2024-09-11T22:29:59.756311+0000","last_peered":"2024-09-11T22:29:59.756311+0000","last_clean":"2024-09-11T22:29:59.756311+0000","last_became_active":"2024-09-11T22:28:21.128429+0000","last_became_peered":"2024-09-11T22:28:21.128429+0000","last_unstale":"2024-09-11T22:29:59.756311+0000","last_undegraded":"2024-09-11T22:29:59.756311+0000","last_fullsized":"2024-09-11T22:29:59.756311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:16.049877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'4","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215719+0000","last_change":"2024-09-11T22:28:18.781827+0000","last_active":"2024-09-11T22:29:59.215719+0000","last_peered":"2024-09-11T22:29:59.215719+0000","last_clean":"2024-09-11T22:29:59.215719+0000","last_became_active":"2024-09-11T22:28:18.781453+0000","last_became_peered":"2024-09-11T22:28:18.781453+0000","last_unstale":"2024-09-11T22:29:59.215719+0000","last_undegraded":"2024-09-11T22:29:59.215719+0000","last_fullsized":"2024-09-11T22:29:59.215719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:37.901034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429243+0000","last_change":"2024-09-11T22:28:30.182457+0000","last_active":"2024-09-11T22:29:59.429243+0000","last_peered":"2024-09-11T22:29:59.429243+0000","last_clean":"2024-09-11T22:29:59.429243+0000","last_became_active":"2024-09-11T22:28:30.181834+0000","last_became_peered":"2024-09-11T22:28:30.181834+0000","last_unstale":"2024-09-11T22:29:59.429243+0000","last_undegraded":"2024-09-11T22:29:59.429243+0000","last_fullsized":"2024-09-11T22:29:59.429243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:21.847470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388462+0000","last_change":"2024-09-11T22:28:21.121896+0000","last_active":"2024-09-11T22:29:59.388462+0000","last_peered":"2024-09-11T22:29:59.388462+0000","last_clean":"2024-09-11T22:29:59.388462+0000","last_became_active":"2024-09-11T22:28:21.120639+0000","last_became_peered":"2024-09-11T22:28:21.120639+0000","last_unstale":"2024-09-11T22:29:59.388462+0000","last_undegraded":"2024-09-11T22:29:59.388462+0000","last_fullsized":"2024-09-11T22:29:59.388462+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:59:58.707107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811651+0000","last_change":"2024-09-11T22:28:18.584577+0000","last_active":"2024-09-11T22:29:59.811651+0000","last_peered":"2024-09-11T22:29:59.811651+0000","last_clean":"2024-09-11T22:29:59.811651+0000","last_became_active":"2024-09-11T22:28:18.583642+0000","last_became_peered":"2024-09-11T22:28:18.583642+0000","last_unstale":"2024-09-11T22:29:59.811651+0000","last_undegraded":"2024-09-11T22:29:59.811651+0000","last_fullsized":"2024-09-11T22:29:59.811651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:09.685642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085296+0000","last_change":"2024-09-11T22:28:30.182767+0000","last_active":"2024-09-11T22:29:59.085296+0000","last_peered":"2024-09-11T22:29:59.085296+0000","last_clean":"2024-09-11T22:29:59.085296+0000","last_became_active":"2024-09-11T22:28:30.181902+0000","last_became_peered":"2024-09-11T22:28:30.181902+0000","last_unstale":"2024-09-11T22:29:59.085296+0000","last_undegraded":"2024-09-11T22:29:59.085296+0000","last_fullsized":"2024-09-11T22:29:59.085296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:49.618633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756454+0000","last_change":"2024-09-11T22:28:21.132388+0000","last_active":"2024-09-11T22:29:59.756454+0000","last_peered":"2024-09-11T22:29:59.756454+0000","last_clean":"2024-09-11T22:29:59.756454+0000","last_became_active":"2024-09-11T22:28:21.132053+0000","last_became_peered":"2024-09-11T22:28:21.132053+0000","last_unstale":"2024-09-11T22:29:59.756454+0000","last_undegraded":"2024-09-11T22:29:59.756454+0000","last_fullsized":"2024-09-11T22:29:59.756454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:04.813600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'3","reported_seq":106,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:14.448919+0000","last_change":"2024-09-11T22:28:18.577057+0000","last_active":"2024-09-11T22:30:14.448919+0000","last_peered":"2024-09-11T22:30:14.448919+0000","last_clean":"2024-09-11T22:30:14.448919+0000","last_became_active":"2024-09-11T22:28:18.576678+0000","last_became_peered":"2024-09-11T22:28:18.576678+0000","last_unstale":"2024-09-11T22:30:14.448919+0000","last_undegraded":"2024-09-11T22:30:14.448919+0000","last_fullsized":"2024-09-11T22:30:14.448919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:04.425896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084030+0000","last_change":"2024-09-11T22:28:30.184139+0000","last_active":"2024-09-11T22:29:59.084030+0000","last_peered":"2024-09-11T22:29:59.084030+0000","last_clean":"2024-09-11T22:29:59.084030+0000","last_became_active":"2024-09-11T22:28:30.182817+0000","last_became_peered":"2024-09-11T22:28:30.182817+0000","last_unstale":"2024-09-11T22:29:59.084030+0000","last_undegraded":"2024-09-11T22:29:59.084030+0000","last_fullsized":"2024-09-11T22:29:59.084030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:43.829873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388222+0000","last_change":"2024-09-11T22:28:30.182250+0000","last_active":"2024-09-11T22:29:59.388222+0000","last_peered":"2024-09-11T22:29:59.388222+0000","last_clean":"2024-09-11T22:29:59.388222+0000","last_became_active":"2024-09-11T22:28:30.178758+0000","last_became_peered":"2024-09-11T22:28:30.178758+0000","last_unstale":"2024-09-11T22:29:59.388222+0000","last_undegraded":"2024-09-11T22:29:59.388222+0000","last_fullsized":"2024-09-11T22:29:59.388222+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:25.120475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085814+0000","last_change":"2024-09-11T22:28:21.121208+0000","last_active":"2024-09-11T22:29:59.085814+0000","last_peered":"2024-09-11T22:29:59.085814+0000","last_clean":"2024-09-11T22:29:59.085814+0000","last_became_active":"2024-09-11T22:28:21.120904+0000","last_became_peered":"2024-09-11T22:28:21.120904+0000","last_unstale":"2024-09-11T22:29:59.085814+0000","last_undegraded":"2024-09-11T22:29:59.085814+0000","last_fullsized":"2024-09-11T22:29:59.085814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:36.696739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215534+0000","last_change":"2024-09-11T22:28:18.584471+0000","last_active":"2024-09-11T22:29:59.215534+0000","last_peered":"2024-09-11T22:29:59.215534+0000","last_clean":"2024-09-11T22:29:59.215534+0000","last_became_active":"2024-09-11T22:28:18.584124+0000","last_became_peered":"2024-09-11T22:28:18.584124+0000","last_unstale":"2024-09-11T22:29:59.215534+0000","last_undegraded":"2024-09-11T22:29:59.215534+0000","last_fullsized":"2024-09-11T22:29:59.215534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:40.992385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811684+0000","last_change":"2024-09-11T22:28:58.403924+0000","last_active":"2024-09-11T22:29:59.811684+0000","last_peered":"2024-09-11T22:29:59.811684+0000","last_clean":"2024-09-11T22:29:59.811684+0000","last_became_active":"2024-09-11T22:28:58.403543+0000","last_became_peered":"2024-09-11T22:28:58.403543+0000","last_unstale":"2024-09-11T22:29:59.811684+0000","last_undegraded":"2024-09-11T22:29:59.811684+0000","last_fullsized":"2024-09-11T22:29:59.811684+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:16.279362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084121+0000","last_change":"2024-09-11T22:28:21.136111+0000","last_active":"2024-09-11T22:29:59.084121+0000","last_peered":"2024-09-11T22:29:59.084121+0000","last_clean":"2024-09-11T22:29:59.084121+0000","last_became_active":"2024-09-11T22:28:21.135576+0000","last_became_peered":"2024-09-11T22:28:21.135576+0000","last_unstale":"2024-09-11T22:29:59.084121+0000","last_undegraded":"2024-09-11T22:29:59.084121+0000","last_fullsized":"2024-09-11T22:29:59.084121+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:30.134734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083119+0000","last_change":"2024-09-11T22:28:18.583388+0000","last_active":"2024-09-11T22:29:59.083119+0000","last_peered":"2024-09-11T22:29:59.083119+0000","last_clean":"2024-09-11T22:29:59.083119+0000","last_became_active":"2024-09-11T22:28:18.582215+0000","last_became_peered":"2024-09-11T22:28:18.582215+0000","last_unstale":"2024-09-11T22:29:59.083119+0000","last_undegraded":"2024-09-11T22:29:59.083119+0000","last_fullsized":"2024-09-11T22:29:59.083119+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:56.816276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087325+0000","last_change":"2024-09-11T22:28:18.581722+0000","last_active":"2024-09-11T22:29:59.087325+0000","last_peered":"2024-09-11T22:29:59.087325+0000","last_clean":"2024-09-11T22:29:59.087325+0000","last_became_active":"2024-09-11T22:28:18.580961+0000","last_became_peered":"2024-09-11T22:28:18.580961+0000","last_unstale":"2024-09-11T22:29:59.087325+0000","last_undegraded":"2024-09-11T22:29:59.087325+0000","last_fullsized":"2024-09-11T22:29:59.087325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:22.629114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215423+0000","last_change":"2024-09-11T22:28:21.122053+0000","last_active":"2024-09-11T22:29:59.215423+0000","last_peered":"2024-09-11T22:29:59.215423+0000","last_clean":"2024-09-11T22:29:59.215423+0000","last_became_active":"2024-09-11T22:28:21.121708+0000","last_became_peered":"2024-09-11T22:28:21.121708+0000","last_unstale":"2024-09-11T22:29:59.215423+0000","last_undegraded":"2024-09-11T22:29:59.215423+0000","last_fullsized":"2024-09-11T22:29:59.215423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:36.457640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811466+0000","last_change":"2024-09-11T22:28:30.194472+0000","last_active":"2024-09-11T22:29:59.811466+0000","last_peered":"2024-09-11T22:29:59.811466+0000","last_clean":"2024-09-11T22:29:59.811466+0000","last_became_active":"2024-09-11T22:28:30.193986+0000","last_became_peered":"2024-09-11T22:28:30.193986+0000","last_unstale":"2024-09-11T22:29:59.811466+0000","last_undegraded":"2024-09-11T22:29:59.811466+0000","last_fullsized":"2024-09-11T22:29:59.811466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:27.608919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'6","reported_seq":114,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:30:15.451027+0000","last_change":"2024-09-11T22:28:18.588739+0000","last_active":"2024-09-11T22:30:15.451027+0000","last_peered":"2024-09-11T22:30:15.451027+0000","last_clean":"2024-09-11T22:30:15.451027+0000","last_became_active":"2024-09-11T22:28:18.586218+0000","last_became_peered":"2024-09-11T22:28:18.586218+0000","last_unstale":"2024-09-11T22:30:15.451027+0000","last_undegraded":"2024-09-11T22:30:15.451027+0000","last_fullsized":"2024-09-11T22:30:15.451027+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:17.560765+0000","last_clean_scrub_stamp":"2024-09-11T22:28:17.560765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:08.493132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084426+0000","last_change":"2024-09-11T22:28:21.122076+0000","last_active":"2024-09-11T22:29:59.084426+0000","last_peered":"2024-09-11T22:29:59.084426+0000","last_clean":"2024-09-11T22:29:59.084426+0000","last_became_active":"2024-09-11T22:28:21.121692+0000","last_became_peered":"2024-09-11T22:28:21.121692+0000","last_unstale":"2024-09-11T22:29:59.084426+0000","last_undegraded":"2024-09-11T22:29:59.084426+0000","last_fullsized":"2024-09-11T22:29:59.084426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:10.165221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811892+0000","last_change":"2024-09-11T22:28:30.179240+0000","last_active":"2024-09-11T22:29:59.811892+0000","last_peered":"2024-09-11T22:29:59.811892+0000","last_clean":"2024-09-11T22:29:59.811892+0000","last_became_active":"2024-09-11T22:28:30.178855+0000","last_became_peered":"2024-09-11T22:28:30.178855+0000","last_unstale":"2024-09-11T22:29:59.811892+0000","last_undegraded":"2024-09-11T22:29:59.811892+0000","last_fullsized":"2024-09-11T22:29:59.811892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:29.142947+0000","last_clean_scrub_stamp":"2024-09-11T22:28:29.142947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:19.671279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812184+0000","last_change":"2024-09-11T22:28:21.115166+0000","last_active":"2024-09-11T22:29:59.812184+0000","last_peered":"2024-09-11T22:29:59.812184+0000","last_clean":"2024-09-11T22:29:59.812184+0000","last_became_active":"2024-09-11T22:28:21.114840+0000","last_became_peered":"2024-09-11T22:28:21.114840+0000","last_unstale":"2024-09-11T22:29:59.812184+0000","last_undegraded":"2024-09-11T22:29:59.812184+0000","last_fullsized":"2024-09-11T22:29:59.812184+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:09.505715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811684+0000","last_change":"2024-09-11T22:28:21.119822+0000","last_active":"2024-09-11T22:29:59.811684+0000","last_peered":"2024-09-11T22:29:59.811684+0000","last_clean":"2024-09-11T22:29:59.811684+0000","last_became_active":"2024-09-11T22:28:21.119480+0000","last_became_peered":"2024-09-11T22:28:21.119480+0000","last_unstale":"2024-09-11T22:29:59.811684+0000","last_undegraded":"2024-09-11T22:29:59.811684+0000","last_fullsized":"2024-09-11T22:29:59.811684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:35.654943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811483+0000","last_change":"2024-09-11T22:28:21.123521+0000","last_active":"2024-09-11T22:29:59.811483+0000","last_peered":"2024-09-11T22:29:59.811483+0000","last_clean":"2024-09-11T22:29:59.811483+0000","last_became_active":"2024-09-11T22:28:21.123197+0000","last_became_peered":"2024-09-11T22:28:21.123197+0000","last_unstale":"2024-09-11T22:29:59.811483+0000","last_undegraded":"2024-09-11T22:29:59.811483+0000","last_fullsized":"2024-09-11T22:29:59.811483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:03.418987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388251+0000","last_change":"2024-09-11T22:28:21.117212+0000","last_active":"2024-09-11T22:29:59.388251+0000","last_peered":"2024-09-11T22:29:59.388251+0000","last_clean":"2024-09-11T22:29:59.388251+0000","last_became_active":"2024-09-11T22:28:21.112432+0000","last_became_peered":"2024-09-11T22:28:21.112432+0000","last_unstale":"2024-09-11T22:29:59.388251+0000","last_undegraded":"2024-09-11T22:29:59.388251+0000","last_fullsized":"2024-09-11T22:29:59.388251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:56.053471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083583+0000","last_change":"2024-09-11T22:28:21.115374+0000","last_active":"2024-09-11T22:29:59.083583+0000","last_peered":"2024-09-11T22:29:59.083583+0000","last_clean":"2024-09-11T22:29:59.083583+0000","last_became_active":"2024-09-11T22:28:21.114943+0000","last_became_peered":"2024-09-11T22:28:21.114943+0000","last_unstale":"2024-09-11T22:29:59.083583+0000","last_undegraded":"2024-09-11T22:29:59.083583+0000","last_fullsized":"2024-09-11T22:29:59.083583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:32.564226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811868+0000","last_change":"2024-09-11T22:28:21.122897+0000","last_active":"2024-09-11T22:29:59.811868+0000","last_peered":"2024-09-11T22:29:59.811868+0000","last_clean":"2024-09-11T22:29:59.811868+0000","last_became_active":"2024-09-11T22:28:21.122594+0000","last_became_peered":"2024-09-11T22:28:21.122594+0000","last_unstale":"2024-09-11T22:29:59.811868+0000","last_undegraded":"2024-09-11T22:29:59.811868+0000","last_fullsized":"2024-09-11T22:29:59.811868+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:37.698479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811660+0000","last_change":"2024-09-11T22:28:21.126252+0000","last_active":"2024-09-11T22:29:59.811660+0000","last_peered":"2024-09-11T22:29:59.811660+0000","last_clean":"2024-09-11T22:29:59.811660+0000","last_became_active":"2024-09-11T22:28:21.125935+0000","last_became_peered":"2024-09-11T22:28:21.125935+0000","last_unstale":"2024-09-11T22:29:59.811660+0000","last_undegraded":"2024-09-11T22:29:59.811660+0000","last_fullsized":"2024-09-11T22:29:59.811660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:27.451659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.085190+0000","last_change":"2024-09-11T22:28:58.297133+0000","last_active":"2024-09-11T22:29:59.085190+0000","last_peered":"2024-09-11T22:29:59.085190+0000","last_clean":"2024-09-11T22:29:59.085190+0000","last_became_active":"2024-09-11T22:28:58.296767+0000","last_became_peered":"2024-09-11T22:28:58.296767+0000","last_unstale":"2024-09-11T22:29:59.085190+0000","last_undegraded":"2024-09-11T22:29:59.085190+0000","last_fullsized":"2024-09-11T22:29:59.085190+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:28:49.660837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.215190+0000","last_change":"2024-09-11T22:28:21.122293+0000","last_active":"2024-09-11T22:29:59.215190+0000","last_peered":"2024-09-11T22:29:59.215190+0000","last_clean":"2024-09-11T22:29:59.215190+0000","last_became_active":"2024-09-11T22:28:21.121930+0000","last_became_peered":"2024-09-11T22:28:21.121930+0000","last_unstale":"2024-09-11T22:29:59.215190+0000","last_undegraded":"2024-09-11T22:29:59.215190+0000","last_fullsized":"2024-09-11T22:29:59.215190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:06:43.231206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084215+0000","last_change":"2024-09-11T22:28:21.123949+0000","last_active":"2024-09-11T22:29:59.084215+0000","last_peered":"2024-09-11T22:29:59.084215+0000","last_clean":"2024-09-11T22:29:59.084215+0000","last_became_active":"2024-09-11T22:28:21.121894+0000","last_became_peered":"2024-09-11T22:28:21.121894+0000","last_unstale":"2024-09-11T22:29:59.084215+0000","last_undegraded":"2024-09-11T22:29:59.084215+0000","last_fullsized":"2024-09-11T22:29:59.084215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:56.227648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756134+0000","last_change":"2024-09-11T22:28:21.136287+0000","last_active":"2024-09-11T22:29:59.756134+0000","last_peered":"2024-09-11T22:29:59.756134+0000","last_clean":"2024-09-11T22:29:59.756134+0000","last_became_active":"2024-09-11T22:28:21.136000+0000","last_became_peered":"2024-09-11T22:28:21.136000+0000","last_unstale":"2024-09-11T22:29:59.756134+0000","last_undegraded":"2024-09-11T22:29:59.756134+0000","last_fullsized":"2024-09-11T22:29:59.756134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:32.709627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083352+0000","last_change":"2024-09-11T22:28:21.117324+0000","last_active":"2024-09-11T22:29:59.083352+0000","last_peered":"2024-09-11T22:29:59.083352+0000","last_clean":"2024-09-11T22:29:59.083352+0000","last_became_active":"2024-09-11T22:28:21.116945+0000","last_became_peered":"2024-09-11T22:28:21.116945+0000","last_unstale":"2024-09-11T22:29:59.083352+0000","last_undegraded":"2024-09-11T22:29:59.083352+0000","last_fullsized":"2024-09-11T22:29:59.083352+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:27.672745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812015+0000","last_change":"2024-09-11T22:28:21.117336+0000","last_active":"2024-09-11T22:29:59.812015+0000","last_peered":"2024-09-11T22:29:59.812015+0000","last_clean":"2024-09-11T22:29:59.812015+0000","last_became_active":"2024-09-11T22:28:21.117005+0000","last_became_peered":"2024-09-11T22:28:21.117005+0000","last_unstale":"2024-09-11T22:29:59.812015+0000","last_undegraded":"2024-09-11T22:29:59.812015+0000","last_fullsized":"2024-09-11T22:29:59.812015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:55.932442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812012+0000","last_change":"2024-09-11T22:28:21.132066+0000","last_active":"2024-09-11T22:29:59.812012+0000","last_peered":"2024-09-11T22:29:59.812012+0000","last_clean":"2024-09-11T22:29:59.812012+0000","last_became_active":"2024-09-11T22:28:21.131676+0000","last_became_peered":"2024-09-11T22:28:21.131676+0000","last_unstale":"2024-09-11T22:29:59.812012+0000","last_undegraded":"2024-09-11T22:29:59.812012+0000","last_fullsized":"2024-09-11T22:29:59.812012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:50.484049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.086415+0000","last_change":"2024-09-11T22:28:21.125532+0000","last_active":"2024-09-11T22:29:59.086415+0000","last_peered":"2024-09-11T22:29:59.086415+0000","last_clean":"2024-09-11T22:29:59.086415+0000","last_became_active":"2024-09-11T22:28:21.125182+0000","last_became_peered":"2024-09-11T22:28:21.125182+0000","last_unstale":"2024-09-11T22:29:59.086415+0000","last_undegraded":"2024-09-11T22:29:59.086415+0000","last_fullsized":"2024-09-11T22:29:59.086415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:35.272900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812183+0000","last_change":"2024-09-11T22:28:21.129029+0000","last_active":"2024-09-11T22:29:59.812183+0000","last_peered":"2024-09-11T22:29:59.812183+0000","last_clean":"2024-09-11T22:29:59.812183+0000","last_became_active":"2024-09-11T22:28:21.128690+0000","last_became_peered":"2024-09-11T22:28:21.128690+0000","last_unstale":"2024-09-11T22:29:59.812183+0000","last_undegraded":"2024-09-11T22:29:59.812183+0000","last_fullsized":"2024-09-11T22:29:59.812183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:57.723871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.755809+0000","last_change":"2024-09-11T22:28:21.134491+0000","last_active":"2024-09-11T22:29:59.755809+0000","last_peered":"2024-09-11T22:29:59.755809+0000","last_clean":"2024-09-11T22:29:59.755809+0000","last_became_active":"2024-09-11T22:28:21.134142+0000","last_became_peered":"2024-09-11T22:28:21.134142+0000","last_unstale":"2024-09-11T22:29:59.755809+0000","last_undegraded":"2024-09-11T22:29:59.755809+0000","last_fullsized":"2024-09-11T22:29:59.755809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:16.960823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.387898+0000","last_change":"2024-09-11T22:28:21.114033+0000","last_active":"2024-09-11T22:29:59.387898+0000","last_peered":"2024-09-11T22:29:59.387898+0000","last_clean":"2024-09-11T22:29:59.387898+0000","last_became_active":"2024-09-11T22:28:21.113689+0000","last_became_peered":"2024-09-11T22:28:21.113689+0000","last_unstale":"2024-09-11T22:29:59.387898+0000","last_undegraded":"2024-09-11T22:29:59.387898+0000","last_fullsized":"2024-09-11T22:29:59.387898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:16.199958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.387993+0000","last_change":"2024-09-11T22:28:21.120938+0000","last_active":"2024-09-11T22:29:59.387993+0000","last_peered":"2024-09-11T22:29:59.387993+0000","last_clean":"2024-09-11T22:29:59.387993+0000","last_became_active":"2024-09-11T22:28:21.120410+0000","last_became_peered":"2024-09-11T22:28:21.120410+0000","last_unstale":"2024-09-11T22:29:59.387993+0000","last_undegraded":"2024-09-11T22:29:59.387993+0000","last_fullsized":"2024-09-11T22:29:59.387993+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:56.745133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.083259+0000","last_change":"2024-09-11T22:28:21.131506+0000","last_active":"2024-09-11T22:29:59.083259+0000","last_peered":"2024-09-11T22:29:59.083259+0000","last_clean":"2024-09-11T22:29:59.083259+0000","last_became_active":"2024-09-11T22:28:21.123877+0000","last_became_peered":"2024-09-11T22:28:21.123877+0000","last_unstale":"2024-09-11T22:29:59.083259+0000","last_undegraded":"2024-09-11T22:29:59.083259+0000","last_fullsized":"2024-09-11T22:29:59.083259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:12.399779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429481+0000","last_change":"2024-09-11T22:28:21.121211+0000","last_active":"2024-09-11T22:29:59.429481+0000","last_peered":"2024-09-11T22:29:59.429481+0000","last_clean":"2024-09-11T22:29:59.429481+0000","last_became_active":"2024-09-11T22:28:21.120900+0000","last_became_peered":"2024-09-11T22:28:21.120900+0000","last_unstale":"2024-09-11T22:29:59.429481+0000","last_undegraded":"2024-09-11T22:29:59.429481+0000","last_fullsized":"2024-09-11T22:29:59.429481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:22.052996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811704+0000","last_change":"2024-09-11T22:28:21.125329+0000","last_active":"2024-09-11T22:29:59.811704+0000","last_peered":"2024-09-11T22:29:59.811704+0000","last_clean":"2024-09-11T22:29:59.811704+0000","last_became_active":"2024-09-11T22:28:21.124998+0000","last_became_peered":"2024-09-11T22:28:21.124998+0000","last_unstale":"2024-09-11T22:29:59.811704+0000","last_undegraded":"2024-09-11T22:29:59.811704+0000","last_fullsized":"2024-09-11T22:29:59.811704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:45:46.559796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087731+0000","last_change":"2024-09-11T22:28:21.123364+0000","last_active":"2024-09-11T22:29:59.087731+0000","last_peered":"2024-09-11T22:29:59.087731+0000","last_clean":"2024-09-11T22:29:59.087731+0000","last_became_active":"2024-09-11T22:28:21.123042+0000","last_became_peered":"2024-09-11T22:28:21.123042+0000","last_unstale":"2024-09-11T22:29:59.087731+0000","last_undegraded":"2024-09-11T22:29:59.087731+0000","last_fullsized":"2024-09-11T22:29:59.087731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:21.938986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.756541+0000","last_change":"2024-09-11T22:28:21.131206+0000","last_active":"2024-09-11T22:29:59.756541+0000","last_peered":"2024-09-11T22:29:59.756541+0000","last_clean":"2024-09-11T22:29:59.756541+0000","last_became_active":"2024-09-11T22:28:21.130879+0000","last_became_peered":"2024-09-11T22:28:21.130879+0000","last_unstale":"2024-09-11T22:29:59.756541+0000","last_undegraded":"2024-09-11T22:29:59.756541+0000","last_fullsized":"2024-09-11T22:29:59.756541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:02.260645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084038+0000","last_change":"2024-09-11T22:28:21.128349+0000","last_active":"2024-09-11T22:29:59.084038+0000","last_peered":"2024-09-11T22:29:59.084038+0000","last_clean":"2024-09-11T22:29:59.084038+0000","last_became_active":"2024-09-11T22:28:21.124628+0000","last_became_peered":"2024-09-11T22:28:21.124628+0000","last_unstale":"2024-09-11T22:29:59.084038+0000","last_undegraded":"2024-09-11T22:29:59.084038+0000","last_fullsized":"2024-09-11T22:29:59.084038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:37.623110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.811226+0000","last_change":"2024-09-11T22:28:21.126140+0000","last_active":"2024-09-11T22:29:59.811226+0000","last_peered":"2024-09-11T22:29:59.811226+0000","last_clean":"2024-09-11T22:29:59.811226+0000","last_became_active":"2024-09-11T22:28:21.125782+0000","last_became_peered":"2024-09-11T22:28:21.125782+0000","last_unstale":"2024-09-11T22:29:59.811226+0000","last_undegraded":"2024-09-11T22:29:59.811226+0000","last_fullsized":"2024-09-11T22:29:59.811226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:10.328879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.087215+0000","last_change":"2024-09-11T22:28:21.124145+0000","last_active":"2024-09-11T22:29:59.087215+0000","last_peered":"2024-09-11T22:29:59.087215+0000","last_clean":"2024-09-11T22:29:59.087215+0000","last_became_active":"2024-09-11T22:28:21.123826+0000","last_became_peered":"2024-09-11T22:28:21.123826+0000","last_unstale":"2024-09-11T22:29:59.087215+0000","last_undegraded":"2024-09-11T22:29:59.087215+0000","last_fullsized":"2024-09-11T22:29:59.087215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:35.558812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.084400+0000","last_change":"2024-09-11T22:28:21.132106+0000","last_active":"2024-09-11T22:29:59.084400+0000","last_peered":"2024-09-11T22:29:59.084400+0000","last_clean":"2024-09-11T22:29:59.084400+0000","last_became_active":"2024-09-11T22:28:21.131755+0000","last_became_peered":"2024-09-11T22:28:21.131755+0000","last_unstale":"2024-09-11T22:29:59.084400+0000","last_undegraded":"2024-09-11T22:29:59.084400+0000","last_fullsized":"2024-09-11T22:29:59.084400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:20.910633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.429439+0000","last_change":"2024-09-11T22:28:21.122348+0000","last_active":"2024-09-11T22:29:59.429439+0000","last_peered":"2024-09-11T22:29:59.429439+0000","last_clean":"2024-09-11T22:29:59.429439+0000","last_became_active":"2024-09-11T22:28:21.121858+0000","last_became_peered":"2024-09-11T22:28:21.121858+0000","last_unstale":"2024-09-11T22:29:59.429439+0000","last_undegraded":"2024-09-11T22:29:59.429439+0000","last_fullsized":"2024-09-11T22:29:59.429439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:11.297623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388143+0000","last_change":"2024-09-11T22:28:21.125006+0000","last_active":"2024-09-11T22:29:59.388143+0000","last_peered":"2024-09-11T22:29:59.388143+0000","last_clean":"2024-09-11T22:29:59.388143+0000","last_became_active":"2024-09-11T22:28:21.124685+0000","last_became_peered":"2024-09-11T22:28:21.124685+0000","last_unstale":"2024-09-11T22:29:59.388143+0000","last_undegraded":"2024-09-11T22:29:59.388143+0000","last_fullsized":"2024-09-11T22:29:59.388143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:30.057740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.388288+0000","last_change":"2024-09-11T22:28:21.117285+0000","last_active":"2024-09-11T22:29:59.388288+0000","last_peered":"2024-09-11T22:29:59.388288+0000","last_clean":"2024-09-11T22:29:59.388288+0000","last_became_active":"2024-09-11T22:28:21.116982+0000","last_became_peered":"2024-09-11T22:28:21.116982+0000","last_unstale":"2024-09-11T22:29:59.388288+0000","last_undegraded":"2024-09-11T22:29:59.388288+0000","last_fullsized":"2024-09-11T22:29:59.388288+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:12.068737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-11T22:29:59.812060+0000","last_change":"2024-09-11T22:28:21.128020+0000","last_active":"2024-09-11T22:29:59.812060+0000","last_peered":"2024-09-11T22:29:59.812060+0000","last_clean":"2024-09-11T22:29:59.812060+0000","last_became_active":"2024-09-11T22:28:21.127665+0000","last_became_peered":"2024-09-11T22:28:21.127665+0000","last_unstale":"2024-09-11T22:29:59.812060+0000","last_undegraded":"2024-09-11T22:29:59.812060+0000","last_fullsized":"2024-09-11T22:29:59.812060+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:28:20.088457+0000","last_clean_scrub_stamp":"2024-09-11T22:28:20.088457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:11.422202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67327,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":396,"num_read_kb":268,"num_write":171,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":201981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481830,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1093632,"data_stored":545853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710763,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37092,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708060,"statfs":{"total":95995035648,"available":95957053440,"internally_reserved":0,"allocated":1785856,"data_stored":1196445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874289,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":550185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135925,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1110016,"data_stored":546009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28692,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716460,"statfs":{"total":95995035648,"available":95965655040,"internally_reserved":0,"allocated":1703936,"data_stored":1142313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528384,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1089536,"data_stored":541265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28700,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716452,"statfs":{"total":95995035648,"available":95965646848,"internally_reserved":0,"allocated":1712128,"data_stored":1137508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1101824,"data_stored":546308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1101824,"data_stored":541459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36508,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708644,"statfs":{"total":95995035648,"available":95957651456,"internally_reserved":0,"allocated":1183744,"data_stored":605849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1159168,"data_stored":604106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1114112,"data_stored":542653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":64902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:30:18.425 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T22:30:18.426 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T22:30:18.426 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T22:30:18.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T22:30:18.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:18 smithi177 ceph-mon[35530]: pgmap v365: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:18.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:18 smithi177 ceph-mon[35530]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T22:30:18.821 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:19.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:19 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:30:19.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:19 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:30:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.563+0000 7ff6fb800640 1 -- 172.21.15.40:0/1235169286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f41049a0 msgr2=0x7ff6f41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.563+0000 7ff6fb800640 1 --2- 172.21.15.40:0/1235169286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f41049a0 0x7ff6f41089f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009900 tx=0x7ff6dc02a410 comp rx=0 tx=0).stop 2024-09-11T22:30:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.563+0000 7ff6fb800640 1 -- 172.21.15.40:0/1235169286 shutdown_connections 2024-09-11T22:30:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.563+0000 7ff6fb800640 1 --2- 172.21.15.40:0/1235169286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f4109120 0x7ff6f4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.563+0000 7ff6fb800640 1 --2- 172.21.15.40:0/1235169286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f41049a0 0x7ff6f41089f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.563+0000 7ff6fb800640 1 --2- 172.21.15.40:0/1235169286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4103ff0 0x7ff6f41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.563+0000 7ff6fb800640 1 -- 172.21.15.40:0/1235169286 >> 172.21.15.40:0/1235169286 conn(0x7ff6f40ffa90 msgr2=0x7ff6f4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.564+0000 7ff6fb800640 1 -- 172.21.15.40:0/1235169286 shutdown_connections 2024-09-11T22:30:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.564+0000 7ff6fb800640 1 -- 172.21.15.40:0/1235169286 wait complete. 2024-09-11T22:30:19.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.565+0000 7ff6fb800640 1 Processor -- start 2024-09-11T22:30:19.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.565+0000 7ff6fb800640 1 -- start start 2024-09-11T22:30:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6fb800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6fb800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f41049a0 0x7ff6f419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6fb800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f4109120 0x7ff6f419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6fb800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4114170 con 0x7ff6f4109120 2024-09-11T22:30:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6fb800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4113ff0 con 0x7ff6f41049a0 2024-09-11T22:30:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6fb800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41142f0 con 0x7ff6f4103ff0 2024-09-11T22:30:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6ebe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f41049a0 0x7ff6f419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6f8e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6f9800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f4109120 0x7ff6f419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6ebe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f41049a0 0x7ff6f419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:46324/0 (socket says 172.21.15.40:46324) 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6ebe00640 1 -- 172.21.15.40:0/3241005696 learned_addr learned my addr 172.21.15.40:0/3241005696 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6f8e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:56498/0 (socket says 172.21.15.40:56498) 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6f8e00640 1 -- 172.21.15.40:0/3241005696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f41049a0 msgr2=0x7ff6f419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6f8e00640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f41049a0 0x7ff6f419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6f8e00640 1 -- 172.21.15.40:0/3241005696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f4109120 msgr2=0x7ff6f419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.566+0000 7ff6f8e00640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f4109120 0x7ff6f419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.567+0000 7ff6f8e00640 1 -- 172.21.15.40:0/3241005696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f419f600 con 0x7ff6f4103ff0 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.567+0000 7ff6ebe00640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f41049a0 0x7ff6f419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.567+0000 7ff6f8e00640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400e9f0 tx=0x7ff6e400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:19.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.567+0000 7ff6f2000640 1 -- 172.21.15.40:0/3241005696 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e400ccc0 con 0x7ff6f4103ff0 2024-09-11T22:30:19.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.567+0000 7ff6f2000640 1 -- 172.21.15.40:0/3241005696 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6e4010910 con 0x7ff6f4103ff0 2024-09-11T22:30:19.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.567+0000 7ff6f2000640 1 -- 172.21.15.40:0/3241005696 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4018800 con 0x7ff6f4103ff0 2024-09-11T22:30:19.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.567+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f419f8f0 con 0x7ff6f4103ff0 2024-09-11T22:30:19.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.567+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f41a71d0 con 0x7ff6f4103ff0 2024-09-11T22:30:19.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.568+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f41043d0 con 0x7ff6f4103ff0 2024-09-11T22:30:19.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.570+0000 7ff6f2000640 1 -- 172.21.15.40:0/3241005696 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff6e4010ac0 con 0x7ff6f4103ff0 2024-09-11T22:30:19.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.572+0000 7ff6f2000640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff6d80a2c10 0x7ff6d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:19.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.572+0000 7ff6f2000640 1 -- 172.21.15.40:0/3241005696 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7ff6e40cfd80 con 0x7ff6f4103ff0 2024-09-11T22:30:19.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.572+0000 7ff6ebe00640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff6d80a2c10 0x7ff6d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:19.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.573+0000 7ff6ebe00640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff6d80a2c10 0x7ff6d80a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0096c0 tx=0x7ff6dc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:19.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.574+0000 7ff6f2000640 1 -- 172.21.15.40:0/3241005696 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6e409c790 con 0x7ff6f4103ff0 2024-09-11T22:30:19.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:19 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:30:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.799+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff6f410c360 con 0x7ff6f4103ff0 2024-09-11T22:30:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.800+0000 7ff6f2000640 1 -- 172.21.15.40:0/3241005696 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff6e409c090 con 0x7ff6f4103ff0 2024-09-11T22:30:19.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:19.802 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T22:30:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff6d80a2c10 msgr2=0x7ff6d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff6d80a2c10 0x7ff6d80a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0096c0 tx=0x7ff6dc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f4103ff0 msgr2=0x7ff6f419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400e9f0 tx=0x7ff6e400edf0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 shutdown_connections 2024-09-11T22:30:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff6d80a2c10 0x7ff6d80a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6f4109120 0x7ff6f419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f41049a0 0x7ff6f419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 --2- 172.21.15.40:0/3241005696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f4103ff0 0x7ff6f419a650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:19.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 >> 172.21.15.40:0/3241005696 conn(0x7ff6f40ffa90 msgr2=0x7ff6f4100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:19.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 shutdown_connections 2024-09-11T22:30:19.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:19.803+0000 7ff6fb800640 1 -- 172.21.15.40:0/3241005696 wait complete. 2024-09-11T22:30:20.753 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T22:30:20.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:30:20.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:20 smithi040 ceph-mon[30787]: pgmap v366: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:20.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:20.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:20.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:20.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:20 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:20.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:20 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3241005696' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T22:30:21.038 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:20 smithi177 ceph-mon[35530]: pgmap v366: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:21.038 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:21.038 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:21.038 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:21.038 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:20 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:21.038 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:20 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3241005696' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T22:30:21.092 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:20 smithi146 ceph-mon[34996]: pgmap v366: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:21.092 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:21.092 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:21.092 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:21.092 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:20 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:21.093 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:20 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3241005696' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T22:30:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:21.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.750+0000 7f7af6e00640 1 -- 172.21.15.40:0/360751847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0106f10 msgr2=0x7f7af010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.750+0000 7f7af6e00640 1 --2- 172.21.15.40:0/360751847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0106f10 0x7f7af010ea90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8009ca0 tx=0x7f7ae802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.750+0000 7f7af6e00640 1 -- 172.21.15.40:0/360751847 shutdown_connections 2024-09-11T22:30:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.750+0000 7f7af6e00640 1 --2- 172.21.15.40:0/360751847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0106f10 0x7f7af010ea90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.750+0000 7f7af6e00640 1 --2- 172.21.15.40:0/360751847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7af0102790 0x7f7af01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.750+0000 7f7af6e00640 1 --2- 172.21.15.40:0/360751847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af0101de0 0x7f7af01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.750+0000 7f7af6e00640 1 -- 172.21.15.40:0/360751847 >> 172.21.15.40:0/360751847 conn(0x7f7af00fd8c0 msgr2=0x7f7af00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.750+0000 7f7af6e00640 1 -- 172.21.15.40:0/360751847 shutdown_connections 2024-09-11T22:30:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.750+0000 7f7af6e00640 1 -- 172.21.15.40:0/360751847 wait complete. 2024-09-11T22:30:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.751+0000 7f7af6e00640 1 Processor -- start 2024-09-11T22:30:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.751+0000 7f7af6e00640 1 -- start start 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.751+0000 7f7af6e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0101de0 0x7f7af019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.751+0000 7f7af6e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7af0102790 0x7f7af019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7af6e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af0106f10 0x7f7af019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7af6e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7af0111fc0 con 0x7f7af0101de0 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7af6e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7af0111e40 con 0x7f7af0106f10 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7af6e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7af0112140 con 0x7f7af0102790 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aefe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0101de0 0x7f7af019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aefe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0101de0 0x7f7af019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47516/0 (socket says 172.21.15.40:47516) 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aefe00640 1 -- 172.21.15.40:0/3783907302 learned_addr learned my addr 172.21.15.40:0/3783907302 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7af4e00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af0106f10 0x7f7af019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aef400640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7af0102790 0x7f7af019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aefe00640 1 -- 172.21.15.40:0/3783907302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7af0102790 msgr2=0x7f7af019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aefe00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7af0102790 0x7f7af019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aefe00640 1 -- 172.21.15.40:0/3783907302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af0106f10 msgr2=0x7f7af019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aefe00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af0106f10 0x7f7af019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aefe00640 1 -- 172.21.15.40:0/3783907302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af019f590 con 0x7f7af0101de0 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.752+0000 7f7aef400640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7af0102790 0x7f7af019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.753+0000 7f7af4e00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af0106f10 0x7f7af019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.753+0000 7f7aefe00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0101de0 0x7f7af019a5e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000e9f0 tx=0x7f7ae000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.753+0000 7f7aecc00640 1 -- 172.21.15.40:0/3783907302 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000cd80 con 0x7f7af0101de0 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.753+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af019f880 con 0x7f7af0101de0 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.753+0000 7f7aecc00640 1 -- 172.21.15.40:0/3783907302 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ae0010910 con 0x7f7af0101de0 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.753+0000 7f7aecc00640 1 -- 172.21.15.40:0/3783907302 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0018990 con 0x7f7af0101de0 2024-09-11T22:30:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.753+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af01a7160 con 0x7f7af0101de0 2024-09-11T22:30:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.754+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af01021c0 con 0x7f7af0101de0 2024-09-11T22:30:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.756+0000 7f7aecc00640 1 -- 172.21.15.40:0/3783907302 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7ae0010ac0 con 0x7f7af0101de0 2024-09-11T22:30:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.757+0000 7f7aecc00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7ad40a2c10 0x7f7ad40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.758+0000 7f7aecc00640 1 -- 172.21.15.40:0/3783907302 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f7ae00cf8d0 con 0x7f7af0101de0 2024-09-11T22:30:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.758+0000 7f7aef400640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7ad40a2c10 0x7f7ad40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.758+0000 7f7aef400640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7ad40a2c10 0x7f7ad40a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7af0076480 tx=0x7f7adc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:21.762+0000 7f7aecc00640 1 -- 172.21.15.40:0/3783907302 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ae009bc90 con 0x7f7af0101de0 2024-09-11T22:30:22.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.012+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7af01a7400 con 0x7f7af0101de0 2024-09-11T22:30:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.013+0000 7f7aecc00640 1 -- 172.21.15.40:0/3783907302 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f7ae009ff90 con 0x7f7af0101de0 2024-09-11T22:30:22.014 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:22.014 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"btime":"2024-09-11T22:29:17:363470+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:29:16.869039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24517,"mds_2":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24499,24517,24527]},"id":1}]} 2024-09-11T22:30:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 25 2024-09-11T22:30:22.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7ad40a2c10 msgr2=0x7f7ad40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7ad40a2c10 0x7f7ad40a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7af0076480 tx=0x7f7adc005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:22.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0101de0 msgr2=0x7f7af019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0101de0 0x7f7af019a5e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000e9f0 tx=0x7f7ae000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 shutdown_connections 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7ad40a2c10 0x7f7ad40a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af0106f10 0x7f7af019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7af0102790 0x7f7af019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 --2- 172.21.15.40:0/3783907302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7af0101de0 0x7f7af019a5e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 >> 172.21.15.40:0/3783907302 conn(0x7f7af00fd8c0 msgr2=0x7f7af00fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 shutdown_connections 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:22.016+0000 7f7af6e00640 1 -- 172.21.15.40:0/3783907302 wait complete. 2024-09-11T22:30:22.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:30:23.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:22 smithi146 ceph-mon[34996]: pgmap v367: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:23.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:23.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:23.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:22 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3783907302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:23.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:30:23.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:30:23.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:22 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:23.179 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:23.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:22 smithi040 ceph-mon[30787]: pgmap v367: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:23.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:23.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:23.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:22 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3783907302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:23.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:30:23.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:30:23.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:22 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:23.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:22 smithi177 ceph-mon[35530]: pgmap v367: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:23.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:23.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:23.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:22 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3783907302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:23.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:30:23.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:30:23.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:22 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.706+0000 7f69ffe00640 1 -- 172.21.15.40:0/2832320033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a00108f60 msgr2=0x7f6a00110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.706+0000 7f69ffe00640 1 --2- 172.21.15.40:0/2832320033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a00108f60 0x7f6a00110ae0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009ca0 tx=0x7f69f802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.706+0000 7f69ffe00640 1 -- 172.21.15.40:0/2832320033 shutdown_connections 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.706+0000 7f69ffe00640 1 --2- 172.21.15.40:0/2832320033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a00108f60 0x7f6a00110ae0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.706+0000 7f69ffe00640 1 --2- 172.21.15.40:0/2832320033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a001047e0 0x7f6a00108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.706+0000 7f69ffe00640 1 --2- 172.21.15.40:0/2832320033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a00103e30 0x7f6a00104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.706+0000 7f69ffe00640 1 -- 172.21.15.40:0/2832320033 >> 172.21.15.40:0/2832320033 conn(0x7f6a000ff8d0 msgr2=0x7f6a00101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.706+0000 7f69ffe00640 1 -- 172.21.15.40:0/2832320033 shutdown_connections 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.706+0000 7f69ffe00640 1 -- 172.21.15.40:0/2832320033 wait complete. 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.707+0000 7f69ffe00640 1 Processor -- start 2024-09-11T22:30:23.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.707+0000 7f69ffe00640 1 -- start start 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.707+0000 7f69ffe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a00103e30 0x7f6a0019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.707+0000 7f69ffe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a001047e0 0x7f6a0019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.707+0000 7f69ffe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a00108f60 0x7f6a0019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.707+0000 7f69ffe00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00114010 con 0x7f6a001047e0 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.707+0000 7f69ffe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00113e90 con 0x7f6a00103e30 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.707+0000 7f69ffe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00114190 con 0x7f6a00108f60 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69f7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a001047e0 0x7f6a0019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69f7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a001047e0 0x7f6a0019a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57548/0 (socket says 172.21.15.40:57548) 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69f7e00640 1 -- 172.21.15.40:0/3828434206 learned_addr learned my addr 172.21.15.40:0/3828434206 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69ff400640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a00108f60 0x7f6a0019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69fea00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a00103e30 0x7f6a0019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69f7e00640 1 -- 172.21.15.40:0/3828434206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a00108f60 msgr2=0x7f6a0019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:23.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69f7e00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a00108f60 0x7f6a0019ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69f7e00640 1 -- 172.21.15.40:0/3828434206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a00103e30 msgr2=0x7f6a0019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69f7e00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a00103e30 0x7f6a0019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.708+0000 7f69f7e00640 1 -- 172.21.15.40:0/3828434206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0019f3c0 con 0x7f6a001047e0 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.709+0000 7f69f7e00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a001047e0 0x7f6a0019a950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f69e800d950 tx=0x7f69e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.709+0000 7f69f7400640 1 -- 172.21.15.40:0/3828434206 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8017030 con 0x7f6a001047e0 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.709+0000 7f69f7400640 1 -- 172.21.15.40:0/3828434206 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69e8004020 con 0x7f6a001047e0 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.709+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0019f6b0 con 0x7f6a001047e0 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.709+0000 7f69f7400640 1 -- 172.21.15.40:0/3828434206 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e80047a0 con 0x7f6a001047e0 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.709+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a001a6f90 con 0x7f6a001047e0 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.710+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a00104210 con 0x7f6a001047e0 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.713+0000 7f69f7400640 1 -- 172.21.15.40:0/3828434206 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f69e80041d0 con 0x7f6a001047e0 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.714+0000 7f69f7400640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69e40a2c10 0x7f69e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:23.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.714+0000 7f69f7400640 1 -- 172.21.15.40:0/3828434206 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f69e80cee90 con 0x7f6a001047e0 2024-09-11T22:30:23.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.714+0000 7f69fea00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69e40a2c10 0x7f69e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:23.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.715+0000 7f69fea00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69e40a2c10 0x7f69e40a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009bd0 tx=0x7f69f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:23.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.718+0000 7f69f7400640 1 -- 172.21.15.40:0/3828434206 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69e809b8a0 con 0x7f6a001047e0 2024-09-11T22:30:23.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.943+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a001a7280 con 0x7f6a001047e0 2024-09-11T22:30:23.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.944+0000 7f69f7400640 1 -- 172.21.15.40:0/3828434206 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f69e809b1a0 con 0x7f6a001047e0 2024-09-11T22:30:23.945 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:23.945 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"btime":"2024-09-11T22:29:17:363470+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:29:16.869039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24517,"mds_2":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24499,24517,24527]},"id":1}]} 2024-09-11T22:30:23.945 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 25 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69e40a2c10 msgr2=0x7f69e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69e40a2c10 0x7f69e40a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009bd0 tx=0x7f69f0005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a001047e0 msgr2=0x7f6a0019a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a001047e0 0x7f6a0019a950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f69e800d950 tx=0x7f69e800de10 comp rx=0 tx=0).stop 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 shutdown_connections 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f69e40a2c10 0x7f69e40a50d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6a00108f60 0x7f6a0019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a001047e0 0x7f6a0019a950 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 --2- 172.21.15.40:0/3828434206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a00103e30 0x7f6a0019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.947+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 >> 172.21.15.40:0/3828434206 conn(0x7f6a000ff8d0 msgr2=0x7f6a00100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:23.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.948+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 shutdown_connections 2024-09-11T22:30:23.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:23.948+0000 7f69ffe00640 1 -- 172.21.15.40:0/3828434206 wait complete. 2024-09-11T22:30:24.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:30:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:24 smithi040 ceph-mon[30787]: pgmap v368: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:24.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:24 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3828434206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:25.131 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:25.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:24 smithi177 ceph-mon[35530]: pgmap v368: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:25.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:24 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3828434206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:25.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:24 smithi146 ceph-mon[34996]: pgmap v368: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:25.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:24 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3828434206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:25.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.697+0000 7f51f0e00640 1 -- 172.21.15.40:0/2353561085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51ec1019c0 msgr2=0x7f51ec101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.697+0000 7f51f0e00640 1 --2- 172.21.15.40:0/2353561085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51ec1019c0 0x7f51ec101e20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009890 tx=0x7f51d402a360 comp rx=0 tx=0).stop 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.697+0000 7f51f0e00640 1 -- 172.21.15.40:0/2353561085 shutdown_connections 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.697+0000 7f51f0e00640 1 --2- 172.21.15.40:0/2353561085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec102360 0x7f51ec10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.697+0000 7f51f0e00640 1 --2- 172.21.15.40:0/2353561085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51ec1019c0 0x7f51ec101e20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.697+0000 7f51f0e00640 1 --2- 172.21.15.40:0/2353561085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ec1079c0 0x7f51ec107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.697+0000 7f51f0e00640 1 -- 172.21.15.40:0/2353561085 >> 172.21.15.40:0/2353561085 conn(0x7f51ec0fd740 msgr2=0x7f51ec0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.697+0000 7f51f0e00640 1 -- 172.21.15.40:0/2353561085 shutdown_connections 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.697+0000 7f51f0e00640 1 -- 172.21.15.40:0/2353561085 wait complete. 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.698+0000 7f51f0e00640 1 Processor -- start 2024-09-11T22:30:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.698+0000 7f51f0e00640 1 -- start start 2024-09-11T22:30:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51f0e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51ec1019c0 0x7f51ec1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51f0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec102360 0x7f51ec198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51f0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ec1079c0 0x7f51ec19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51f0e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec111dc0 con 0x7f51ec102360 2024-09-11T22:30:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51f0e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec111c40 con 0x7f51ec1079c0 2024-09-11T22:30:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51f0e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec111f40 con 0x7f51ec1019c0 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51e3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec102360 0x7f51ec198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51eb400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51ec1019c0 0x7f51ec1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51e3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec102360 0x7f51ec198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57578/0 (socket says 172.21.15.40:57578) 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51e3e00640 1 -- 172.21.15.40:0/3490645420 learned_addr learned my addr 172.21.15.40:0/3490645420 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.699+0000 7f51ebe00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ec1079c0 0x7f51ec19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51e3e00640 1 -- 172.21.15.40:0/3490645420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51ec1019c0 msgr2=0x7f51ec1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51e3e00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51ec1019c0 0x7f51ec1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51e3e00640 1 -- 172.21.15.40:0/3490645420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ec1079c0 msgr2=0x7f51ec19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51e3e00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ec1079c0 0x7f51ec19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51e3e00640 1 -- 172.21.15.40:0/3490645420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ec19d290 con 0x7f51ec102360 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51e3e00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec102360 0x7f51ec198820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f51d4000c00 tx=0x7f51d4033d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51e8c00640 1 -- 172.21.15.40:0/3490645420 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d403f020 con 0x7f51ec102360 2024-09-11T22:30:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51e8c00640 1 -- 172.21.15.40:0/3490645420 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51d4032770 con 0x7f51ec102360 2024-09-11T22:30:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51e8c00640 1 -- 172.21.15.40:0/3490645420 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4037040 con 0x7f51ec102360 2024-09-11T22:30:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.700+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ec19d520 con 0x7f51ec102360 2024-09-11T22:30:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.701+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ec19d9b0 con 0x7f51ec102360 2024-09-11T22:30:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.702+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ec101e20 con 0x7f51ec102360 2024-09-11T22:30:25.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.704+0000 7f51e8c00640 1 -- 172.21.15.40:0/3490645420 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f51d4042020 con 0x7f51ec102360 2024-09-11T22:30:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.705+0000 7f51e8c00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f51d00a2c10 0x7f51d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.705+0000 7f51e8c00640 1 -- 172.21.15.40:0/3490645420 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f51d40ef130 con 0x7f51ec102360 2024-09-11T22:30:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.705+0000 7f51eb400640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f51d00a2c10 0x7f51d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.706+0000 7f51eb400640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f51d00a2c10 0x7f51d00a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009b50 tx=0x7f51dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:25.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.709+0000 7f51e8c00640 1 -- 172.21.15.40:0/3490645420 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51d4049030 con 0x7f51ec102360 2024-09-11T22:30:25.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.895+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51ec02d7c0 con 0x7f51ec102360 2024-09-11T22:30:25.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.896+0000 7f51e8c00640 1 -- 172.21.15.40:0/3490645420 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24848 (secure 0 0 0) 0x7f51d40bbcb0 con 0x7f51ec102360 2024-09-11T22:30:25.898 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:25.898 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":95,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:29:59.079781+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f51d00a2c10 msgr2=0x7f51d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f51d00a2c10 0x7f51d00a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009b50 tx=0x7f51dc005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec102360 msgr2=0x7f51ec198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec102360 0x7f51ec198820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f51d4000c00 tx=0x7f51d4033d10 comp rx=0 tx=0).stop 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 shutdown_connections 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f51d00a2c10 0x7f51d00a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51ec1079c0 0x7f51ec19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec102360 0x7f51ec198820 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 --2- 172.21.15.40:0/3490645420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51ec1019c0 0x7f51ec1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 >> 172.21.15.40:0/3490645420 conn(0x7f51ec0fd740 msgr2=0x7f51ec0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:25.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.899+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 shutdown_connections 2024-09-11T22:30:25.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:25.900+0000 7f51f0e00640 1 -- 172.21.15.40:0/3490645420 wait complete. 2024-09-11T22:30:26.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:30:26.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:26 smithi040 ceph-mon[30787]: pgmap v369: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:26.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:26 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3490645420' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:30:27.078 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:27.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:26 smithi177 ceph-mon[35530]: pgmap v369: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:27.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:26 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3490645420' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:30:27.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:26 smithi146 ceph-mon[34996]: pgmap v369: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:27.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:26 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3490645420' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:30:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.658+0000 7f6664800640 1 -- 172.21.15.40:0/1636646338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c109120 msgr2=0x7f665c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.658+0000 7f6664800640 1 --2- 172.21.15.40:0/1636646338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c109120 0x7f665c110ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6658009ca0 tx=0x7f665802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.658+0000 7f6664800640 1 -- 172.21.15.40:0/1636646338 shutdown_connections 2024-09-11T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.658+0000 7f6664800640 1 --2- 172.21.15.40:0/1636646338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c109120 0x7f665c110ca0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.658+0000 7f6664800640 1 --2- 172.21.15.40:0/1636646338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f665c1049a0 0x7f665c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.658+0000 7f6664800640 1 --2- 172.21.15.40:0/1636646338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f665c103ff0 0x7f665c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.658+0000 7f6664800640 1 -- 172.21.15.40:0/1636646338 >> 172.21.15.40:0/1636646338 conn(0x7f665c0ffa90 msgr2=0x7f665c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.658+0000 7f6664800640 1 -- 172.21.15.40:0/1636646338 shutdown_connections 2024-09-11T22:30:27.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.658+0000 7f6664800640 1 -- 172.21.15.40:0/1636646338 wait complete. 2024-09-11T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.659+0000 7f6664800640 1 Processor -- start 2024-09-11T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6664800640 1 -- start start 2024-09-11T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6664800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f665c103ff0 0x7f665c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6664800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c1049a0 0x7f665c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6664800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f665c109120 0x7f665c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6664800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f665c114180 con 0x7f665c1049a0 2024-09-11T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6664800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f665c114000 con 0x7f665c103ff0 2024-09-11T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6664800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f665c114300 con 0x7f665c109120 2024-09-11T22:30:27.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6661400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c1049a0 0x7f665c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6661400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c1049a0 0x7f665c19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57602/0 (socket says 172.21.15.40:57602) 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6661400640 1 -- 172.21.15.40:0/450394804 learned_addr learned my addr 172.21.15.40:0/450394804 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.660+0000 7f6661e00640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f665c103ff0 0x7f665c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6662800640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f665c109120 0x7f665c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6661400640 1 -- 172.21.15.40:0/450394804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f665c109120 msgr2=0x7f665c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6661400640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f665c109120 0x7f665c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6661400640 1 -- 172.21.15.40:0/450394804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f665c103ff0 msgr2=0x7f665c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6661400640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f665c103ff0 0x7f665c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6661400640 1 -- 172.21.15.40:0/450394804 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c19f5d0 con 0x7f665c1049a0 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6662800640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f665c109120 0x7f665c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6661400640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c1049a0 0x7f665c19ab60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f664c00e9f0 tx=0x7f664c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6656a00640 1 -- 172.21.15.40:0/450394804 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c00cd80 con 0x7f665c1049a0 2024-09-11T22:30:27.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c19f8c0 con 0x7f665c1049a0 2024-09-11T22:30:27.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.661+0000 7f6656a00640 1 -- 172.21.15.40:0/450394804 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f664c010910 con 0x7f665c1049a0 2024-09-11T22:30:27.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.662+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c1a71a0 con 0x7f665c1049a0 2024-09-11T22:30:27.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.662+0000 7f6656a00640 1 -- 172.21.15.40:0/450394804 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c018910 con 0x7f665c1049a0 2024-09-11T22:30:27.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.663+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6640005290 con 0x7f665c1049a0 2024-09-11T22:30:27.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.665+0000 7f6656a00640 1 -- 172.21.15.40:0/450394804 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f664c010430 con 0x7f665c1049a0 2024-09-11T22:30:27.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.666+0000 7f6656a00640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66440a2c10 0x7f66440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:27.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.666+0000 7f6656a00640 1 -- 172.21.15.40:0/450394804 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f664c0cf840 con 0x7f665c1049a0 2024-09-11T22:30:27.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.666+0000 7f6661e00640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66440a2c10 0x7f66440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:27.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.667+0000 7f6661e00640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66440a2c10 0x7f66440a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6650009bd0 tx=0x7f6650005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:27.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.670+0000 7f6656a00640 1 -- 172.21.15.40:0/450394804 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f664c09c250 con 0x7f665c1049a0 2024-09-11T22:30:27.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.892+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6640005850 con 0x7f665c1049a0 2024-09-11T22:30:27.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.893+0000 7f6656a00640 1 -- 172.21.15.40:0/450394804 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7f664c09bb50 con 0x7f665c1049a0 2024-09-11T22:30:27.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:27.893 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"btime":"2024-09-11T22:29:17:363470+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:29:16.869039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24517,"mds_2":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24499,24517,24527]},"id":1}]} 2024-09-11T22:30:27.894 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 25 2024-09-11T22:30:27.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66440a2c10 msgr2=0x7f66440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66440a2c10 0x7f66440a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6650009bd0 tx=0x7f6650005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c1049a0 msgr2=0x7f665c19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c1049a0 0x7f665c19ab60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f664c00e9f0 tx=0x7f664c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 shutdown_connections 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f66440a2c10 0x7f66440a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f665c109120 0x7f665c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f665c1049a0 0x7f665c19ab60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 --2- 172.21.15.40:0/450394804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f665c103ff0 0x7f665c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 >> 172.21.15.40:0/450394804 conn(0x7f665c0ffa90 msgr2=0x7f665c100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 shutdown_connections 2024-09-11T22:30:27.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:27.895+0000 7f6664800640 1 -- 172.21.15.40:0/450394804 wait complete. 2024-09-11T22:30:28.585 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T22:28:22.255886+0000', 'modified': '2024-09-11T22:29:16.869039+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24527, 'mds_1': 24517, 'mds_2': 24499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/2793379680', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2793379680}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2793379680}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6837/321001142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 321001142}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 321001142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6835/2874658115', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 2874658115}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 2874658115}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.177:6837/1976954611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6836', 'nonce': 1976954611}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 1976954611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.177:6839/2764150178', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6838', 'nonce': 2764150178}, {'type': 'v1', 'addr': '172.21.15.177:6839', 'nonce': 2764150178}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.146:6839/2365077357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 2365077357}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 2365077357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24527, 'qdb_cluster': [24499, 24517, 24527]} 2024-09-11T22:30:28.585 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T22:30:28.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T22:30:28.967 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:29.106 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:28 smithi040 ceph-mon[30787]: pgmap v370: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:29.106 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:28 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/450394804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:28 smithi177 ceph-mon[35530]: pgmap v370: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:28 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/450394804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:29.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:28 smithi146 ceph-mon[34996]: pgmap v370: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:29.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:28 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/450394804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:29.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.550+0000 7fa381600640 1 -- 172.21.15.40:0/1239973301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa37c1019c0 msgr2=0x7fa37c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:29.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.550+0000 7fa381600640 1 --2- 172.21.15.40:0/1239973301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa37c1019c0 0x7fa37c101e20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa364009930 tx=0x7fa36402a420 comp rx=0 tx=0).stop 2024-09-11T22:30:29.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.550+0000 7fa381600640 1 -- 172.21.15.40:0/1239973301 shutdown_connections 2024-09-11T22:30:29.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.550+0000 7fa381600640 1 --2- 172.21.15.40:0/1239973301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa37c102360 0x7fa37c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.550+0000 7fa381600640 1 --2- 172.21.15.40:0/1239973301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa37c1019c0 0x7fa37c101e20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.550+0000 7fa381600640 1 --2- 172.21.15.40:0/1239973301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c1079c0 0x7fa37c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.550+0000 7fa381600640 1 -- 172.21.15.40:0/1239973301 >> 172.21.15.40:0/1239973301 conn(0x7fa37c0fd740 msgr2=0x7fa37c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:29.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.550+0000 7fa381600640 1 -- 172.21.15.40:0/1239973301 shutdown_connections 2024-09-11T22:30:29.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.550+0000 7fa381600640 1 -- 172.21.15.40:0/1239973301 wait complete. 2024-09-11T22:30:29.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.551+0000 7fa381600640 1 Processor -- start 2024-09-11T22:30:29.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.551+0000 7fa381600640 1 -- start start 2024-09-11T22:30:29.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa381600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa37c1019c0 0x7fa37c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa381600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa37c102360 0x7fa37c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa381600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c1079c0 0x7fa37c19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa381600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c111e10 con 0x7fa37c102360 2024-09-11T22:30:29.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa381600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c111c90 con 0x7fa37c1019c0 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa381600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c111f90 con 0x7fa37c1079c0 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa37be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa37c1019c0 0x7fa37c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa37be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa37c1019c0 0x7fa37c19a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:37378/0 (socket says 172.21.15.40:37378) 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa37be00640 1 -- 172.21.15.40:0/223624508 learned_addr learned my addr 172.21.15.40:0/223624508 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa380c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c1079c0 0x7fa37c19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.552+0000 7fa373400640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa37c102360 0x7fa37c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa37be00640 1 -- 172.21.15.40:0/223624508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c1079c0 msgr2=0x7fa37c19ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa37be00640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c1079c0 0x7fa37c19ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa37be00640 1 -- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa37c102360 msgr2=0x7fa37c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:29.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa37be00640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa37c102360 0x7fa37c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa37be00640 1 -- 172.21.15.40:0/223624508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c19f4c0 con 0x7fa37c1019c0 2024-09-11T22:30:29.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa380c00640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c1079c0 0x7fa37c19ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:29.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa37be00640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa37c1019c0 0x7fa37c19a510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00eb90 tx=0x7fa36c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:29.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa379600640 1 -- 172.21.15.40:0/223624508 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c004d20 con 0x7fa37c1019c0 2024-09-11T22:30:29.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa381600640 1 -- 172.21.15.40:0/223624508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c19f7b0 con 0x7fa37c1019c0 2024-09-11T22:30:29.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa379600640 1 -- 172.21.15.40:0/223624508 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa36c00ee90 con 0x7fa37c1019c0 2024-09-11T22:30:29.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa379600640 1 -- 172.21.15.40:0/223624508 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c010830 con 0x7fa37c1019c0 2024-09-11T22:30:29.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.553+0000 7fa381600640 1 -- 172.21.15.40:0/223624508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37c1a7090 con 0x7fa37c1019c0 2024-09-11T22:30:29.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.556+0000 7fa38566e740 1 Processor -- start 2024-09-11T22:30:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.556+0000 7fa38566e740 1 -- start start 2024-09-11T22:30:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa38566e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9f4e0 0x563a5bd9f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa38566e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bdaa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa38566e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bdaa6c0 0x563a5bdacab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa38566e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563a5bd050b0 con 0x563a5bd9f4e0 2024-09-11T22:30:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa38566e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563a5bcacab0 con 0x563a5bd9fe00 2024-09-11T22:30:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa38566e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563a5bd01070 con 0x563a5bdaa6c0 2024-09-11T22:30:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa379600640 1 -- 172.21.15.40:0/223624508 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa36c005020 con 0x7fa37c1019c0 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa380c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9f4e0 0x563a5bd9f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa380c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9f4e0 0x563a5bd9f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57626/0 (socket says 172.21.15.40:57626) 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa380c00640 1 -- 172.21.15.40:0/1251549146 learned_addr learned my addr 172.21.15.40:0/1251549146 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa373400640 1 --2- 172.21.15.40:0/1251549146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bdaa6c0 0x563a5bdacab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.557+0000 7fa37be00640 1 --2- 172.21.15.40:0/1251549146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bdaa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.558+0000 7fa380c00640 1 -- 172.21.15.40:0/1251549146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bdaa6c0 msgr2=0x563a5bdacab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.558+0000 7fa380c00640 1 --2- 172.21.15.40:0/1251549146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bdaa6c0 0x563a5bdacab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.558+0000 7fa380c00640 1 -- 172.21.15.40:0/1251549146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 msgr2=0x563a5bdaa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.558+0000 7fa380c00640 1 --2- 172.21.15.40:0/1251549146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bdaa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.558+0000 7fa380c00640 1 -- 172.21.15.40:0/1251549146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5bcb94a0 con 0x563a5bd9f4e0 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.558+0000 7fa380c00640 1 --2- 172.21.15.40:0/1251549146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9f4e0 0x563a5bd9f8c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa374010400 tx=0x7fa3740108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b34cecbc3173d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.558+0000 7fa371200640 1 -- 172.21.15.40:0/1251549146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374004230 con 0x563a5bd9f4e0 2024-09-11T22:30:29.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.558+0000 7fa371200640 1 -- 172.21.15.40:0/1251549146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3740043d0 con 0x563a5bd9f4e0 2024-09-11T22:30:29.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.558+0000 7fa371200640 1 -- 172.21.15.40:0/1251549146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374003b70 con 0x563a5bd9f4e0 2024-09-11T22:30:29.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa379600640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3600a2c10 0x7fa3600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa379600640 1 -- 172.21.15.40:0/223624508 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fa36c0cfb80 con 0x7fa37c1019c0 2024-09-11T22:30:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa38566e740 1 -- 172.21.15.40:0/1251549146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9f4e0 msgr2=0x563a5bd9f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa37be00640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3600a2c10 0x7fa3600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa38566e740 1 --2- 172.21.15.40:0/1251549146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9f4e0 0x563a5bd9f8c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa374010400 tx=0x7fa3740108c0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa38566e740 1 -- 172.21.15.40:0/1251549146 shutdown_connections 2024-09-11T22:30:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa38566e740 1 --2- 172.21.15.40:0/1251549146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bdaa6c0 0x563a5bdacab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa38566e740 1 --2- 172.21.15.40:0/1251549146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bdaa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa38566e740 1 --2- 172.21.15.40:0/1251549146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9f4e0 0x563a5bd9f8c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa38566e740 1 -- 172.21.15.40:0/1251549146 >> 172.21.15.40:0/1251549146 conn(0x563a5bd9ba70 msgr2=0x563a5bd9be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa38566e740 1 -- 172.21.15.40:0/1251549146 shutdown_connections 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.559+0000 7fa38566e740 1 -- 172.21.15.40:0/1251549146 wait complete. 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.560+0000 7fa37be00640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3600a2c10 0x7fa3600a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa36c09be20 tx=0x7fa36c00cf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.560+0000 7fa38566e740 1 -- start start 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.560+0000 7fa38566e740 1 Processor -- start 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.560+0000 7fa38566e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa38566e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bda7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa38566e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bda7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa38566e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563a5bdad380 con 0x563a5bdaa6c0 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa38566e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563a5bc8d920 con 0x563a5bd9fe00 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa38566e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563a5bdad500 con 0x563a5bd9f4e0 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa38566e740 10 client.0 _ll_register_callbacks cb 0x563a5bcb18a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa380c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bda7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa380c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa373400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bda7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa380c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:60046/0 (socket says 172.21.15.40:60046) 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa373400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bda7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:37388/0 (socket says 172.21.15.40:37388) 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa380c00640 1 -- 172.21.15.40:0/2041491077 learned_addr learned my addr 172.21.15.40:0/2041491077 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa380c00640 1 -- 172.21.15.40:0/2041491077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 msgr2=0x563a5bda7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa380c00640 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bda7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa380c00640 1 -- 172.21.15.40:0/2041491077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 msgr2=0x563a5bda7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa380c00640 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bda7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.561+0000 7fa380c00640 1 -- 172.21.15.40:0/2041491077 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5ba762b0 con 0x563a5bd9f4e0 2024-09-11T22:30:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.562+0000 7fa380c00640 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda7540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa374010dc0 tx=0x7fa374000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd9175e1db621cae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.562+0000 7fa369600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-11T22:30:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.562+0000 7fa369600640 1 -- 172.21.15.40:0/2041491077 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374024040 con 0x563a5bd9f4e0 2024-09-11T22:30:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.562+0000 7fa38566e740 1 -- 172.21.15.40:0/2041491077 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3740043d0 con 0x563a5bd9f4e0 2024-09-11T22:30:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.562+0000 7fa369600640 1 -- 172.21.15.40:0/2041491077 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fa374003970 con 0x563a5bd9f4e0 2024-09-11T22:30:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.562+0000 7fa369600640 1 -- 172.21.15.40:0/2041491077 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa374033050 con 0x563a5bd9f4e0 2024-09-11T22:30:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa38566e740 10 client.24982 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa38566e740 1 -- 172.21.15.40:0/2041491077 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a5bdb9020 con 0x563a5bd9f4e0 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa369600640 1 -- 172.21.15.40:0/2041491077 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3740043d0 con 0x563a5bd9f4e0 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa369600640 1 -- 172.21.15.40:0/2041491077 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa37402b5f0 con 0x563a5bd9f4e0 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa38566e740 10 client.24982 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa38566e740 10 client.24982 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa38566e740 20 client.24982 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa38566e740 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x563a5bdbb380 0x563a5bdbc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa38566e740 4 client.24982 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.563+0000 7fa38566e740 1 -- 172.21.15.40:0/2041491077 --> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a5bd12620 con 0x563a5bdbb380 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.564+0000 7fa373400640 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x563a5bdbb380 0x563a5bdbc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.564+0000 7fa373400640 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x563a5bdbb380 0x563a5bdbc7f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b66641850d18c7bb server_cookie=8b671ce70f9aea4f in_seq=0 out_seq=0 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.564+0000 7fa369600640 10 client.24982 ms_handle_connect on v2:172.21.15.177:6836/1976954611 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.565+0000 7fa369600640 1 -- 172.21.15.40:0/2041491077 <== mds.2 v2:172.21.15.177:6836/1976954611 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a5bd12620 con 0x563a5bdbb380 2024-09-11T22:30:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.565+0000 7fa369600640 10 client.24982 handle_command_reply: tid=0 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.565+0000 7fa38566e740 1 client.24982 shutdown 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.565+0000 7fa38566e740 1 -- 172.21.15.40:0/2041491077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 msgr2=0x563a5bda7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.565+0000 7fa38566e740 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda7540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa374010dc0 tx=0x7fa374000bc0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa38566e740 1 -- 172.21.15.40:0/2041491077 shutdown_connections 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa38566e740 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x563a5bdbb380 0x563a5bdbc7f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa38566e740 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bda7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa38566e740 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bda7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa38566e740 1 --2- 172.21.15.40:0/2041491077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda7540 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa369600640 0 client.24982 ms_handle_reset on v2:172.21.15.177:6836/1976954611 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa38566e740 1 -- 172.21.15.40:0/2041491077 >> 172.21.15.40:0/2041491077 conn(0x563a5bd9ba70 msgr2=0x563a5bda17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa38566e740 1 -- 172.21.15.40:0/2041491077 shutdown_connections 2024-09-11T22:30:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa38566e740 1 -- 172.21.15.40:0/2041491077 wait complete. 2024-09-11T22:30:29.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.566+0000 7fa38566e740 20 client.24982 trim_cache size 0 max 16384 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.584+0000 7fa38566e740 1 Processor -- start 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa38566e740 1 -- start start 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa38566e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa38566e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9fe00 0x563a5bdb5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa38566e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bdaa6c0 0x563a5bdc4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa38566e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563a5bdbab30 con 0x563a5bd9fe00 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa38566e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563a5bdbb200 con 0x563a5bdaa6c0 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa38566e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563a5bdbb8d0 con 0x563a5bd9f4e0 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa373400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9fe00 0x563a5bdb5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa373400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9fe00 0x563a5bdb5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57642/0 (socket says 172.21.15.40:57642) 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa380c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa373400640 1 -- 172.21.15.40:0/942352691 learned_addr learned my addr 172.21.15.40:0/942352691 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:29.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.585+0000 7fa380c00640 1 --2- 172.21.15.40:0/942352691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bdaa6c0 0x563a5bdc4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.586+0000 7fa380c00640 1 -- 172.21.15.40:0/942352691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bdaa6c0 msgr2=0x563a5bdc4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.586+0000 7fa380c00640 1 --2- 172.21.15.40:0/942352691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bdaa6c0 0x563a5bdc4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.586+0000 7fa380c00640 1 -- 172.21.15.40:0/942352691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9fe00 msgr2=0x563a5bdb5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.586+0000 7fa380c00640 1 --2- 172.21.15.40:0/942352691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9fe00 0x563a5bdb5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.586+0000 7fa380c00640 1 -- 172.21.15.40:0/942352691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5bd9b8a0 con 0x563a5bd9f4e0 2024-09-11T22:30:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.586+0000 7fa380c00640 1 --2- 172.21.15.40:0/942352691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda1f00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa374011e90 tx=0x7fa374013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=140f225b8af5172d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.586+0000 7fa36be00640 1 -- 172.21.15.40:0/942352691 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37402f070 con 0x563a5bd9f4e0 2024-09-11T22:30:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.586+0000 7fa36be00640 1 -- 172.21.15.40:0/942352691 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa37400bc40 con 0x563a5bd9f4e0 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.586+0000 7fa36be00640 1 -- 172.21.15.40:0/942352691 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374003960 con 0x563a5bd9f4e0 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 -- 172.21.15.40:0/942352691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 msgr2=0x563a5bda1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 --2- 172.21.15.40:0/942352691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda1f00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa374011e90 tx=0x7fa374013040 comp rx=0 tx=0).stop 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 -- 172.21.15.40:0/942352691 shutdown_connections 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 --2- 172.21.15.40:0/942352691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bdaa6c0 0x563a5bdc4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 --2- 172.21.15.40:0/942352691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bd9fe00 0x563a5bdb5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 --2- 172.21.15.40:0/942352691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bda1f00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 -- 172.21.15.40:0/942352691 >> 172.21.15.40:0/942352691 conn(0x563a5bd9ba70 msgr2=0x563a5bdb5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 -- 172.21.15.40:0/942352691 shutdown_connections 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 -- 172.21.15.40:0/942352691 wait complete. 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.587+0000 7fa38566e740 1 -- start start 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa38566e740 1 Processor -- start 2024-09-11T22:30:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa38566e740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bdbe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa38566e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bdbeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa38566e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bdbf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa38566e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x563a5bdbc670 con 0x563a5bdaa6c0 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa38566e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563a5bdbbfa0 con 0x563a5bd9fe00 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa38566e740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x563a5bdbcd40 con 0x563a5bd9f4e0 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa38566e740 10 client.0 _ll_register_callbacks cb 0x7fa3740116f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa380c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bdbe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa380c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bdbf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa380c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bdbf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57652/0 (socket says 172.21.15.40:57652) 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa380c00640 1 -- 172.21.15.40:0/1989396592 learned_addr learned my addr 172.21.15.40:0/1989396592 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.588+0000 7fa373400640 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bdbeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa380c00640 1 -- 172.21.15.40:0/1989396592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 msgr2=0x563a5bdbe860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa380c00640 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bdbe860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa380c00640 1 -- 172.21.15.40:0/1989396592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 msgr2=0x563a5bdbeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa380c00640 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bdbeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa380c00640 1 -- 172.21.15.40:0/1989396592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5bdc3080 con 0x563a5bdaa6c0 2024-09-11T22:30:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa380c00640 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bdbf2e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa37400b4d0 tx=0x7fa374000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a39294854a87232 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa369600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T22:30:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa369600640 1 -- 172.21.15.40:0/1989396592 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37402f070 con 0x563a5bdaa6c0 2024-09-11T22:30:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa38566e740 1 -- 172.21.15.40:0/1989396592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa37400bc40 con 0x563a5bdaa6c0 2024-09-11T22:30:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.589+0000 7fa369600640 1 -- 172.21.15.40:0/1989396592 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fa37402b630 con 0x563a5bdaa6c0 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa369600640 1 -- 172.21.15.40:0/1989396592 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa37404b050 con 0x563a5bdaa6c0 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa38566e740 10 client.14970 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa38566e740 1 -- 172.21.15.40:0/1989396592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563a5be25db0 con 0x563a5bdaa6c0 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa369600640 1 -- 172.21.15.40:0/1989396592 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa37400bc40 con 0x563a5bdaa6c0 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa369600640 1 -- 172.21.15.40:0/1989396592 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fa37401b420 con 0x563a5bdaa6c0 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa38566e740 10 client.14970 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa38566e740 10 client.14970 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa38566e740 20 client.14970 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa38566e740 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x563a5be2a710 0x563a5be29420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa38566e740 4 client.14970 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.590+0000 7fa38566e740 1 -- 172.21.15.40:0/1989396592 --> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] -- command(tid 0: {"prefix": "status"}) -- 0x563a5bd0cb30 con 0x563a5be2a710 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.591+0000 7fa373400640 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x563a5be2a710 0x563a5be29420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.591+0000 7fa373400640 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x563a5be2a710 0x563a5be29420 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9bd8b55af1b1b2b server_cookie=1d2fbd455da7a62e in_seq=0 out_seq=0 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.591+0000 7fa369600640 10 client.14970 ms_handle_connect on v2:172.21.15.177:6836/1976954611 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa369600640 1 -- 172.21.15.40:0/1989396592 <== mds.2 v2:172.21.15.177:6836/1976954611 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563a5bd0cb30 con 0x563a5be2a710 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa369600640 10 client.14970 handle_command_reply: tid=0 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 client.14970 shutdown 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 -- 172.21.15.40:0/1989396592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 msgr2=0x563a5bdbf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bdbf2e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa37400b4d0 tx=0x7fa374000bc0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 -- 172.21.15.40:0/1989396592 shutdown_connections 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x563a5be2a710 0x563a5be29420 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563a5bdaa6c0 0x563a5bdbf2e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563a5bd9fe00 0x563a5bdbeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 --2- 172.21.15.40:0/1989396592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a5bd9f4e0 0x563a5bdbe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 -- 172.21.15.40:0/1989396592 >> 172.21.15.40:0/1989396592 conn(0x563a5bd9ba70 msgr2=0x563a5bdb5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa369600640 0 client.14970 ms_handle_reset on v2:172.21.15.177:6836/1976954611 2024-09-11T22:30:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 -- 172.21.15.40:0/1989396592 shutdown_connections 2024-09-11T22:30:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 1 -- 172.21.15.40:0/1989396592 wait complete. 2024-09-11T22:30:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.592+0000 7fa38566e740 20 client.14970 trim_cache size 0 max 16384 2024-09-11T22:30:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:30:29.597 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:30:29.597 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 2, 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24499, 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 76.239793614000007, 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 25, 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 95, 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 157.03823586600001 2024-09-11T22:30:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 -- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3600a2c10 msgr2=0x7fa3600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3600a2c10 0x7fa3600a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa36c09be20 tx=0x7fa36c00cf90 comp rx=0 tx=0).stop 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 -- 172.21.15.40:0/223624508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa37c1019c0 msgr2=0x7fa37c19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa37c1019c0 0x7fa37c19a510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00eb90 tx=0x7fa36c00c6a0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 -- 172.21.15.40:0/223624508 shutdown_connections 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa3600a2c10 0x7fa3600a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c1079c0 0x7fa37c19ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa37c102360 0x7fa37c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 --2- 172.21.15.40:0/223624508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa37c1019c0 0x7fa37c19a510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 -- 172.21.15.40:0/223624508 >> 172.21.15.40:0/223624508 conn(0x7fa37c0fd740 msgr2=0x7fa37c10d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 -- 172.21.15.40:0/223624508 shutdown_connections 2024-09-11T22:30:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:29.593+0000 7fa381600640 1 -- 172.21.15.40:0/223624508 wait complete. 2024-09-11T22:30:30.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T22:30:30.743 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:31.187 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:30 smithi040 ceph-mon[30787]: pgmap v371: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:31.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:30 smithi177 ceph-mon[35530]: pgmap v371: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.301+0000 7fddd0a00640 1 -- 172.21.15.40:0/3015832201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc109120 msgr2=0x7fddcc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.301+0000 7fddd0a00640 1 --2- 172.21.15.40:0/3015832201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc109120 0x7fddcc110ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009ca0 tx=0x7fddc402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.301+0000 7fddd0a00640 1 -- 172.21.15.40:0/3015832201 shutdown_connections 2024-09-11T22:30:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.301+0000 7fddd0a00640 1 --2- 172.21.15.40:0/3015832201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc109120 0x7fddcc110ca0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.301+0000 7fddd0a00640 1 --2- 172.21.15.40:0/3015832201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddcc1049a0 0x7fddcc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.301+0000 7fddd0a00640 1 --2- 172.21.15.40:0/3015832201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddcc103ff0 0x7fddcc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.301+0000 7fddd0a00640 1 -- 172.21.15.40:0/3015832201 >> 172.21.15.40:0/3015832201 conn(0x7fddcc0ffa90 msgr2=0x7fddcc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.301+0000 7fddd0a00640 1 -- 172.21.15.40:0/3015832201 shutdown_connections 2024-09-11T22:30:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.301+0000 7fddd0a00640 1 -- 172.21.15.40:0/3015832201 wait complete. 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.302+0000 7fddd0a00640 1 Processor -- start 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.302+0000 7fddd0a00640 1 -- start start 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.302+0000 7fddd0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc103ff0 0x7fddcc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddd0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddcc1049a0 0x7fddcc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddd0a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddcc109120 0x7fddcc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddd0a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc114180 con 0x7fddcc103ff0 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddd0a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc114000 con 0x7fddcc1049a0 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddd0a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc114300 con 0x7fddcc109120 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc103ff0 0x7fddcc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc103ff0 0x7fddcc19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57664/0 (socket says 172.21.15.40:57664) 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddc9e00640 1 -- 172.21.15.40:0/691919518 learned_addr learned my addr 172.21.15.40:0/691919518 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:31.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddc1400640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddcc1049a0 0x7fddcc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddca800640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddcc109120 0x7fddcc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddc1400640 1 -- 172.21.15.40:0/691919518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddcc109120 msgr2=0x7fddcc19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddc1400640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddcc109120 0x7fddcc19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddc1400640 1 -- 172.21.15.40:0/691919518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc103ff0 msgr2=0x7fddcc19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddc1400640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc103ff0 0x7fddcc19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddc1400640 1 -- 172.21.15.40:0/691919518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc19f590 con 0x7fddcc1049a0 2024-09-11T22:30:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.303+0000 7fddca800640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddcc109120 0x7fddcc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.304+0000 7fddc1400640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddcc1049a0 0x7fddcc19ab20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fddb400e9f0 tx=0x7fddb400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.304+0000 7fddc3400640 1 -- 172.21.15.40:0/691919518 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb400ccc0 con 0x7fddcc1049a0 2024-09-11T22:30:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.304+0000 7fddc3400640 1 -- 172.21.15.40:0/691919518 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddb4010910 con 0x7fddcc1049a0 2024-09-11T22:30:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.304+0000 7fddc3400640 1 -- 172.21.15.40:0/691919518 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4018960 con 0x7fddcc1049a0 2024-09-11T22:30:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.304+0000 7fddd0a00640 1 -- 172.21.15.40:0/691919518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddcc19f880 con 0x7fddcc1049a0 2024-09-11T22:30:31.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.304+0000 7fddd0a00640 1 -- 172.21.15.40:0/691919518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddcc1a7160 con 0x7fddcc1049a0 2024-09-11T22:30:31.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.307+0000 7fddd363d740 1 Processor -- start 2024-09-11T22:30:31.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.307+0000 7fddc3400640 1 -- 172.21.15.40:0/691919518 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fddb4010ac0 con 0x7fddcc1049a0 2024-09-11T22:30:31.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.307+0000 7fddd363d740 1 -- start start 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddd363d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca1c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddd363d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1cc50 0x56450ca26fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddd363d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca27510 0x56450ca29900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddd363d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56450c9820b0 con 0x56450ca1cc50 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddd363d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56450c929ab0 con 0x56450ca27510 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddd363d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56450c97e070 con 0x56450ca1c330 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1cc50 0x56450ca26fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddca800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca1c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddca800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca1c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:60102/0 (socket says 172.21.15.40:60102) 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddca800640 1 -- 172.21.15.40:0/627206165 learned_addr learned my addr 172.21.15.40:0/627206165 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:31.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.308+0000 7fddc1400640 1 --2- 172.21.15.40:0/627206165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca27510 0x56450ca29900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddca800640 1 -- 172.21.15.40:0/627206165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca27510 msgr2=0x56450ca29900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:31.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddca800640 1 --2- 172.21.15.40:0/627206165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca27510 0x56450ca29900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddca800640 1 -- 172.21.15.40:0/627206165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1cc50 msgr2=0x56450ca26fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:31.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddca800640 1 --2- 172.21.15.40:0/627206165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1cc50 0x56450ca26fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddca800640 1 -- 172.21.15.40:0/627206165 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56450c9364a0 con 0x56450ca1c330 2024-09-11T22:30:31.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddc1400640 1 --2- 172.21.15.40:0/627206165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca27510 0x56450ca29900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:31.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddca800640 1 --2- 172.21.15.40:0/627206165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca1c710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fddc4035000 tx=0x7fddc4009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59899a1b4ba400e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddc3400640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fddb00a2c10 0x7fddb00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddbb000640 1 -- 172.21.15.40:0/627206165 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4031db0 con 0x56450ca1c330 2024-09-11T22:30:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddc3400640 1 -- 172.21.15.40:0/691919518 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fddb40cf930 con 0x7fddcc1049a0 2024-09-11T22:30:31.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddbb000640 1 -- 172.21.15.40:0/627206165 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc4036040 con 0x56450ca1c330 2024-09-11T22:30:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddbb000640 1 -- 172.21.15.40:0/627206165 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40043c0 con 0x56450ca1c330 2024-09-11T22:30:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.309+0000 7fddc9e00640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fddb00a2c10 0x7fddb00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddd363d740 1 -- 172.21.15.40:0/627206165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 msgr2=0x56450ca1c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddd363d740 1 --2- 172.21.15.40:0/627206165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca1c710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fddc4035000 tx=0x7fddc4009800 comp rx=0 tx=0).stop 2024-09-11T22:30:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddc9e00640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fddb00a2c10 0x7fddb00a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56450ca19720 tx=0x7fddbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddd363d740 1 -- 172.21.15.40:0/627206165 shutdown_connections 2024-09-11T22:30:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddd363d740 1 --2- 172.21.15.40:0/627206165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca27510 0x56450ca29900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddd363d740 1 --2- 172.21.15.40:0/627206165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1cc50 0x56450ca26fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddd363d740 1 --2- 172.21.15.40:0/627206165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca1c710 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddd363d740 1 -- 172.21.15.40:0/627206165 >> 172.21.15.40:0/627206165 conn(0x56450ca188c0 msgr2=0x56450ca18ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddd363d740 1 -- 172.21.15.40:0/627206165 shutdown_connections 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.310+0000 7fddd363d740 1 -- 172.21.15.40:0/627206165 wait complete. 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.311+0000 7fddd363d740 1 -- start start 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.311+0000 7fddd363d740 1 Processor -- start 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.311+0000 7fddd363d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 0x56450ca245b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.311+0000 7fddd363d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.311+0000 7fddd363d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 0x56450ca25030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddd363d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56450ca2a060 con 0x56450ca1c330 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddd363d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56450c90a920 con 0x56450ca1cc50 2024-09-11T22:30:31.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddd363d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56450ca2a1e0 con 0x56450ca27510 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddd363d740 10 client.0 _ll_register_callbacks cb 0x56450c92e8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 0x56450ca245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddca800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 0x56450ca25030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 0x56450ca245b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57690/0 (socket says 172.21.15.40:57690) 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddc9e00640 1 -- 172.21.15.40:0/1785596049 learned_addr learned my addr 172.21.15.40:0/1785596049 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddc1400640 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddca800640 1 -- 172.21.15.40:0/1785596049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 msgr2=0x56450ca24af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddca800640 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddca800640 1 -- 172.21.15.40:0/1785596049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 msgr2=0x56450ca245b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddca800640 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 0x56450ca245b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.312+0000 7fddca800640 1 -- 172.21.15.40:0/1785596049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56450c6f32b0 con 0x56450ca27510 2024-09-11T22:30:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.313+0000 7fddca800640 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 0x56450ca25030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009ca0 tx=0x7fddc4031a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b096b3b829acbdc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.313+0000 7fddaf400640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-11T22:30:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.313+0000 7fddaf400640 1 -- 172.21.15.40:0/1785596049 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc404a040 con 0x56450ca27510 2024-09-11T22:30:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.313+0000 7fddd363d740 1 -- 172.21.15.40:0/1785596049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc4036040 con 0x56450ca27510 2024-09-11T22:30:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.313+0000 7fddaf400640 1 -- 172.21.15.40:0/1785596049 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fddc4031bb0 con 0x56450ca27510 2024-09-11T22:30:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.313+0000 7fddaf400640 1 -- 172.21.15.40:0/1785596049 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fddc4031650 con 0x56450ca27510 2024-09-11T22:30:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.313+0000 7fddd363d740 10 client.25000 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.313+0000 7fddd363d740 1 -- 172.21.15.40:0/1785596049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56450ca2a060 con 0x56450ca27510 2024-09-11T22:30:31.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.313+0000 7fddaf400640 1 -- 172.21.15.40:0/1785596049 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc4036040 con 0x56450ca27510 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.314+0000 7fddaf400640 1 -- 172.21.15.40:0/1785596049 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fddc404d070 con 0x56450ca27510 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.314+0000 7fddd363d740 10 client.25000 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.314+0000 7fddd363d740 10 client.25000 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.314+0000 7fddd363d740 20 client.25000 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.314+0000 7fddd363d740 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x56450ca37f50 0x56450ca393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.314+0000 7fddd363d740 4 client.25000 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.314+0000 7fddd363d740 1 -- 172.21.15.40:0/1785596049 --> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56450c98f620 con 0x56450ca37f50 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.314+0000 7fddc9e00640 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x56450ca37f50 0x56450ca393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.315+0000 7fddc9e00640 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x56450ca37f50 0x56450ca393c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=806ae44351b693a2 server_cookie=da40c235ba1d35f9 in_seq=0 out_seq=0 2024-09-11T22:30:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.315+0000 7fddaf400640 10 client.25000 ms_handle_connect on v2:172.21.15.177:6838/2764150178 2024-09-11T22:30:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddaf400640 1 -- 172.21.15.40:0/1785596049 <== mds.1 v2:172.21.15.177:6838/2764150178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56450c98f620 con 0x56450ca37f50 2024-09-11T22:30:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddaf400640 10 client.25000 handle_command_reply: tid=0 2024-09-11T22:30:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddd363d740 1 client.25000 shutdown 2024-09-11T22:30:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddd363d740 1 -- 172.21.15.40:0/1785596049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 msgr2=0x56450ca25030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddd363d740 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 0x56450ca25030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009ca0 tx=0x7fddc4031a80 comp rx=0 tx=0).stop 2024-09-11T22:30:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddd363d740 1 -- 172.21.15.40:0/1785596049 shutdown_connections 2024-09-11T22:30:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddd363d740 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x56450ca37f50 0x56450ca393c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddd363d740 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 0x56450ca25030 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddaf400640 0 client.25000 ms_handle_reset on v2:172.21.15.177:6838/2764150178 2024-09-11T22:30:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddd363d740 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddd363d740 1 --2- 172.21.15.40:0/1785596049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 0x56450ca245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.316+0000 7fddd363d740 1 -- 172.21.15.40:0/1785596049 >> 172.21.15.40:0/1785596049 conn(0x56450ca188c0 msgr2=0x56450ca1e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.317+0000 7fddd363d740 1 -- 172.21.15.40:0/1785596049 shutdown_connections 2024-09-11T22:30:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.317+0000 7fddd363d740 1 -- 172.21.15.40:0/1785596049 wait complete. 2024-09-11T22:30:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.317+0000 7fddd363d740 20 client.25000 trim_cache size 0 max 16384 2024-09-11T22:30:31.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:30 smithi146 ceph-mon[34996]: pgmap v371: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.335+0000 7fddd363d740 1 Processor -- start 2024-09-11T22:30:31.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.335+0000 7fddd363d740 1 -- start start 2024-09-11T22:30:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddd363d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 0x56450ca37880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddd363d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddd363d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 0x56450ca26520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddd363d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56450ca37700 con 0x56450ca1c330 2024-09-11T22:30:31.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddd363d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56450ca37dd0 con 0x56450ca1cc50 2024-09-11T22:30:31.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddd363d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56450ca384a0 con 0x56450ca27510 2024-09-11T22:30:31.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 0x56450ca37880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddc1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddca800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 0x56450ca26520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddc1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:37438/0 (socket says 172.21.15.40:37438) 2024-09-11T22:30:31.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddc1400640 1 -- 172.21.15.40:0/2917936615 learned_addr learned my addr 172.21.15.40:0/2917936615 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddc1400640 1 -- 172.21.15.40:0/2917936615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 msgr2=0x56450ca26520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddc1400640 1 --2- 172.21.15.40:0/2917936615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 0x56450ca26520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddc1400640 1 -- 172.21.15.40:0/2917936615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 msgr2=0x56450ca37880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddc1400640 1 --2- 172.21.15.40:0/2917936615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 0x56450ca37880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.336+0000 7fddc1400640 1 -- 172.21.15.40:0/2917936615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56450ca1ca80 con 0x56450ca1cc50 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.337+0000 7fddc1400640 1 --2- 172.21.15.40:0/2917936615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fddb400e9c0 tx=0x7fddb400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37a99c1661e75e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.337+0000 7fddba600640 1 -- 172.21.15.40:0/2917936615 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb409bca0 con 0x56450ca1cc50 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.337+0000 7fddba600640 1 -- 172.21.15.40:0/2917936615 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddb40a0050 con 0x56450ca1cc50 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.337+0000 7fddba600640 1 -- 172.21.15.40:0/2917936615 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4018b00 con 0x56450ca1cc50 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.337+0000 7fddd363d740 1 -- 172.21.15.40:0/2917936615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 msgr2=0x56450ca24e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.337+0000 7fddd363d740 1 --2- 172.21.15.40:0/2917936615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fddb400e9c0 tx=0x7fddb400cf60 comp rx=0 tx=0).stop 2024-09-11T22:30:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.338+0000 7fddd363d740 1 -- 172.21.15.40:0/2917936615 shutdown_connections 2024-09-11T22:30:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.338+0000 7fddd363d740 1 --2- 172.21.15.40:0/2917936615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca27510 0x56450ca26520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.338+0000 7fddd363d740 1 --2- 172.21.15.40:0/2917936615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca24e80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.338+0000 7fddd363d740 1 --2- 172.21.15.40:0/2917936615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca1c330 0x56450ca37880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.338+0000 7fddd363d740 1 -- 172.21.15.40:0/2917936615 >> 172.21.15.40:0/2917936615 conn(0x56450ca188c0 msgr2=0x56450ca25e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.338+0000 7fddd363d740 1 -- 172.21.15.40:0/2917936615 shutdown_connections 2024-09-11T22:30:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.338+0000 7fddd363d740 1 -- 172.21.15.40:0/2917936615 wait complete. 2024-09-11T22:30:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.338+0000 7fddd363d740 1 -- start start 2024-09-11T22:30:31.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.338+0000 7fddd363d740 1 Processor -- start 2024-09-11T22:30:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddd363d740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca21730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddd363d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca21c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddd363d740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca27510 0x56450ca221b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddd363d740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56450ca39240 con 0x56450ca27510 2024-09-11T22:30:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddd363d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56450ca38b70 con 0x56450ca1cc50 2024-09-11T22:30:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddd363d740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x56450ca39910 con 0x56450ca1c330 2024-09-11T22:30:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddd363d740 10 client.0 _ll_register_callbacks cb 0x7fddc4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddc1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca21c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddca800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca27510 0x56450ca221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca21730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddc1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca21c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:37454/0 (socket says 172.21.15.40:37454) 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddc1400640 1 -- 172.21.15.40:0/3887162473 learned_addr learned my addr 172.21.15.40:0/3887162473 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddc1400640 1 -- 172.21.15.40:0/3887162473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 msgr2=0x56450ca21730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddc1400640 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca21730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddc1400640 1 -- 172.21.15.40:0/3887162473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca27510 msgr2=0x56450ca221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddc1400640 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca27510 0x56450ca221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.339+0000 7fddc1400640 1 -- 172.21.15.40:0/3887162473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56450ca3fdd0 con 0x56450ca1cc50 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.340+0000 7fddc1400640 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca21c70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fddb40ccfd0 tx=0x7fddb40cfc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc94c173e201ba48 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.340+0000 7fddaf400640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-11T22:30:31.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.340+0000 7fddaf400640 1 -- 172.21.15.40:0/3887162473 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb409bca0 con 0x56450ca1cc50 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.340+0000 7fddd363d740 1 -- 172.21.15.40:0/3887162473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddb40a0050 con 0x56450ca1cc50 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.340+0000 7fddaf400640 1 -- 172.21.15.40:0/3887162473 <== mon.2 v2:172.21.15.146:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fddb40b3070 con 0x56450ca1cc50 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.340+0000 7fddaf400640 1 -- 172.21.15.40:0/3887162473 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fddb40a4910 con 0x56450ca1cc50 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.340+0000 7fddd363d740 10 client.24986 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.340+0000 7fddd363d740 1 -- 172.21.15.40:0/3887162473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56450caa2a30 con 0x56450ca1cc50 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.340+0000 7fddaf400640 1 -- 172.21.15.40:0/3887162473 <== mon.2 v2:172.21.15.146:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddb40a0050 con 0x56450ca1cc50 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.341+0000 7fddaf400640 1 -- 172.21.15.40:0/3887162473 <== mon.2 v2:172.21.15.146:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fddb4097bb0 con 0x56450ca1cc50 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.341+0000 7fddd363d740 10 client.24986 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.341+0000 7fddd363d740 10 client.24986 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:30:31.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.341+0000 7fddd363d740 20 client.24986 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.341+0000 7fddd363d740 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x56450caa7030 0x56450caa5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.341+0000 7fddd363d740 4 client.24986 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.341+0000 7fddd363d740 1 -- 172.21.15.40:0/3887162473 --> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] -- command(tid 0: {"prefix": "status"}) -- 0x56450c989b30 con 0x56450caa7030 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.341+0000 7fddc9e00640 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x56450caa7030 0x56450caa5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddc9e00640 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x56450caa7030 0x56450caa5d40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b109fba5c8ab72c6 server_cookie=607b08fc592b380d in_seq=0 out_seq=0 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddaf400640 10 client.24986 ms_handle_connect on v2:172.21.15.177:6838/2764150178 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddaf400640 1 -- 172.21.15.40:0/3887162473 <== mds.1 v2:172.21.15.177:6838/2764150178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56450c989b30 con 0x56450caa7030 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddaf400640 10 client.24986 handle_command_reply: tid=0 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddd363d740 1 client.24986 shutdown 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddd363d740 1 -- 172.21.15.40:0/3887162473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 msgr2=0x56450ca21c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddd363d740 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca21c70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fddb40ccfd0 tx=0x7fddb40cfc80 comp rx=0 tx=0).stop 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddd363d740 1 -- 172.21.15.40:0/3887162473 shutdown_connections 2024-09-11T22:30:31.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddd363d740 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x56450caa7030 0x56450caa5d40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddd363d740 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56450ca27510 0x56450ca221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddd363d740 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56450ca1cc50 0x56450ca21c70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddd363d740 1 --2- 172.21.15.40:0/3887162473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56450ca1c330 0x56450ca21730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddaf400640 0 client.24986 ms_handle_reset on v2:172.21.15.177:6838/2764150178 2024-09-11T22:30:31.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.342+0000 7fddd363d740 1 -- 172.21.15.40:0/3887162473 >> 172.21.15.40:0/3887162473 conn(0x56450ca188c0 msgr2=0x56450ca32c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:31.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd363d740 1 -- 172.21.15.40:0/3887162473 shutdown_connections 2024-09-11T22:30:31.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd363d740 1 -- 172.21.15.40:0/3887162473 wait complete. 2024-09-11T22:30:31.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd363d740 20 client.24986 trim_cache size 0 max 16384 2024-09-11T22:30:31.348 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:30:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:30:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2024-09-11T22:30:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24517, 2024-09-11T22:30:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-11T22:30:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-11T22:30:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-11T22:30:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 78.998140066000005, 2024-09-11T22:30:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 25, 2024-09-11T22:30:31.349 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 95, 2024-09-11T22:30:31.349 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T22:30:31.349 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 153.33173147400001 2024-09-11T22:30:31.349 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:30:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 -- 172.21.15.40:0/691919518 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fddb00a2c10 msgr2=0x7fddb00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fddb00a2c10 0x7fddb00a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56450ca19720 tx=0x7fddbc005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 -- 172.21.15.40:0/691919518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddcc1049a0 msgr2=0x7fddcc19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddcc1049a0 0x7fddcc19ab20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fddb400e9f0 tx=0x7fddb400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 -- 172.21.15.40:0/691919518 shutdown_connections 2024-09-11T22:30:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fddb00a2c10 0x7fddb00a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddcc109120 0x7fddcc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddcc1049a0 0x7fddcc19ab20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 --2- 172.21.15.40:0/691919518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc103ff0 0x7fddcc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:31.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.343+0000 7fddd0a00640 1 -- 172.21.15.40:0/691919518 >> 172.21.15.40:0/691919518 conn(0x7fddcc0ffa90 msgr2=0x7fddcc101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:31.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.344+0000 7fddd0a00640 1 -- 172.21.15.40:0/691919518 shutdown_connections 2024-09-11T22:30:31.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:31.344+0000 7fddd0a00640 1 -- 172.21.15.40:0/691919518 wait complete. 2024-09-11T22:30:32.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T22:30:32.469 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:32.897 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:32 smithi040 ceph-mon[30787]: pgmap v372: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.012+0000 7f1711600640 1 -- 172.21.15.40:0/2343493990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c103ff0 msgr2=0x7f170c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.012+0000 7f1711600640 1 --2- 172.21.15.40:0/2343493990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c103ff0 0x7f170c1043d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009900 tx=0x7f16fc02a3f0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.012+0000 7f1711600640 1 -- 172.21.15.40:0/2343493990 shutdown_connections 2024-09-11T22:30:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.012+0000 7f1711600640 1 --2- 172.21.15.40:0/2343493990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170c109120 0x7f170c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.012+0000 7f1711600640 1 --2- 172.21.15.40:0/2343493990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f170c1049a0 0x7f170c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.012+0000 7f1711600640 1 --2- 172.21.15.40:0/2343493990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c103ff0 0x7f170c1043d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.012+0000 7f1711600640 1 -- 172.21.15.40:0/2343493990 >> 172.21.15.40:0/2343493990 conn(0x7f170c0ffa90 msgr2=0x7f170c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.012+0000 7f1711600640 1 -- 172.21.15.40:0/2343493990 shutdown_connections 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.012+0000 7f1711600640 1 -- 172.21.15.40:0/2343493990 wait complete. 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.013+0000 7f1711600640 1 Processor -- start 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f1711600640 1 -- start start 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f1711600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170c103ff0 0x7f170c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f1711600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f170c1049a0 0x7f170c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f1711600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c109120 0x7f170c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f1711600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f170c114150 con 0x7f170c109120 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f1711600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f170c113fd0 con 0x7f170c1049a0 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f1711600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f170c1142d0 con 0x7f170c103ff0 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f170b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c109120 0x7f170c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f170b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c109120 0x7f170c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49130/0 (socket says 172.21.15.40:49130) 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f170b400640 1 -- 172.21.15.40:0/3956614160 learned_addr learned my addr 172.21.15.40:0/3956614160 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f170aa00640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170c103ff0 0x7f170c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.014+0000 7f170a000640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f170c1049a0 0x7f170c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f170b400640 1 -- 172.21.15.40:0/3956614160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170c103ff0 msgr2=0x7f170c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f170b400640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170c103ff0 0x7f170c19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f170b400640 1 -- 172.21.15.40:0/3956614160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f170c1049a0 msgr2=0x7f170c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f170b400640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f170c1049a0 0x7f170c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f170b400640 1 -- 172.21.15.40:0/3956614160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c19f5e0 con 0x7f170c109120 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f170a000640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f170c1049a0 0x7f170c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f170b400640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c109120 0x7f170c19ef00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f170400eaa0 tx=0x7f170400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f1703400640 1 -- 172.21.15.40:0/3956614160 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170400cdb0 con 0x7f170c109120 2024-09-11T22:30:33.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f1703400640 1 -- 172.21.15.40:0/3956614160 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1704005020 con 0x7f170c109120 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f1703400640 1 -- 172.21.15.40:0/3956614160 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17040116b0 con 0x7f170c109120 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.015+0000 7f1711600640 1 -- 172.21.15.40:0/3956614160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c19f8d0 con 0x7f170c109120 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.016+0000 7f1711600640 1 -- 172.21.15.40:0/3956614160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c1a71b0 con 0x7f170c109120 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f17141f9740 1 Processor -- start 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f1703400640 1 -- 172.21.15.40:0/3956614160 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1704005560 con 0x7f170c109120 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f17141f9740 1 -- start start 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f17141f9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f11027710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f17141f9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 0x557f11031fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f17141f9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11032510 0x557f11034900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f17141f9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557f10f8d0b0 con 0x557f11027330 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f17141f9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557f10f34ab0 con 0x557f11032510 2024-09-11T22:30:33.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f17141f9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557f10f89070 con 0x557f11027c50 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.019+0000 7f170a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f11027710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f11027710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49132/0 (socket says 172.21.15.40:49132) 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170a000640 1 -- 172.21.15.40:0/3541507982 learned_addr learned my addr 172.21.15.40:0/3541507982 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170aa00640 1 --2- 172.21.15.40:0/3541507982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 0x557f11031fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170a000640 1 --2- 172.21.15.40:0/3541507982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11032510 0x557f11034900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170a000640 1 -- 172.21.15.40:0/3541507982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 msgr2=0x557f11031fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170a000640 1 --2- 172.21.15.40:0/3541507982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 0x557f11031fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170a000640 1 -- 172.21.15.40:0/3541507982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11032510 msgr2=0x557f11034900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170a000640 1 --2- 172.21.15.40:0/3541507982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11032510 0x557f11034900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170a000640 1 -- 172.21.15.40:0/3541507982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f10f414a0 con 0x557f11027330 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.020+0000 7f170a000640 1 --2- 172.21.15.40:0/3541507982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f11027710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16f80058c0 tx=0x7f16f800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1092a9fbd79a992 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:33.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.021+0000 7f16f7400640 1 -- 172.21.15.40:0/3541507982 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8019030 con 0x557f11027330 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.021+0000 7f16f7400640 1 -- 172.21.15.40:0/3541507982 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f8011a20 con 0x557f11027330 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.021+0000 7f1703400640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16f00a2c10 0x7f16f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.021+0000 7f16f7400640 1 -- 172.21.15.40:0/3541507982 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f801da00 con 0x557f11027330 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.021+0000 7f1703400640 1 -- 172.21.15.40:0/3956614160 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f17040cf770 con 0x7f170c109120 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.021+0000 7f170aa00640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16f00a2c10 0x7f16f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.021+0000 7f17141f9740 1 -- 172.21.15.40:0/3541507982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 msgr2=0x557f11027710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.021+0000 7f17141f9740 1 --2- 172.21.15.40:0/3541507982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f11027710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16f80058c0 tx=0x7f16f800b730 comp rx=0 tx=0).stop 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f17141f9740 1 -- 172.21.15.40:0/3541507982 shutdown_connections 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f17141f9740 1 --2- 172.21.15.40:0/3541507982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11032510 0x557f11034900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f17141f9740 1 --2- 172.21.15.40:0/3541507982 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 0x557f11031fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f17141f9740 1 --2- 172.21.15.40:0/3541507982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f11027710 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f17141f9740 1 -- 172.21.15.40:0/3541507982 >> 172.21.15.40:0/3541507982 conn(0x557f110238c0 msgr2=0x557f11023ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f17141f9740 1 -- 172.21.15.40:0/3541507982 shutdown_connections 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f170aa00640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16f00a2c10 0x7f16f00a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009230 tx=0x7f16fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f17141f9740 1 -- 172.21.15.40:0/3541507982 wait complete. 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f17141f9740 1 -- start start 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.022+0000 7f17141f9740 1 Processor -- start 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f17141f9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 0x557f1102f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f17141f9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 0x557f1102fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f17141f9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11032510 0x557f1102ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f17141f9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557f11034fc0 con 0x557f11032510 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f17141f9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557f10f15920 con 0x557f11027330 2024-09-11T22:30:33.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f17141f9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557f11035140 con 0x557f11027c50 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f17141f9740 10 client.0 _ll_register_callbacks cb 0x557f10f398a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f170b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11032510 0x557f1102ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f170aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 0x557f1102f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f170b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11032510 0x557f1102ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49134/0 (socket says 172.21.15.40:49134) 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f170b400640 1 -- 172.21.15.40:0/3234442551 learned_addr learned my addr 172.21.15.40:0/3234442551 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.023+0000 7f170a000640 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 0x557f1102fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f170a000640 1 -- 172.21.15.40:0/3234442551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 msgr2=0x557f1102f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f170a000640 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 0x557f1102f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f170a000640 1 -- 172.21.15.40:0/3234442551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11032510 msgr2=0x557f1102ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f170a000640 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11032510 0x557f1102ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f170a000640 1 -- 172.21.15.40:0/3234442551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f10cfe2b0 con 0x557f11027c50 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f170b400640 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11032510 0x557f1102ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f170a000640 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 0x557f1102fa60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f16f801c000 tx=0x7f16f801d5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9de14cfbede436 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f16ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f16ebe00640 1 -- 172.21.15.40:0/3234442551 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8019040 con 0x557f11027c50 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f17141f9740 1 -- 172.21.15.40:0/3234442551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16f8011a20 con 0x557f11027c50 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.024+0000 7f16ebe00640 1 -- 172.21.15.40:0/3234442551 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f16f8011740 con 0x557f11027c50 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f16ebe00640 1 -- 172.21.15.40:0/3234442551 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16f802f050 con 0x557f11027c50 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f17141f9740 10 client.25018 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f17141f9740 1 -- 172.21.15.40:0/3234442551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557f11040df0 con 0x557f11027c50 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f16ebe00640 1 -- 172.21.15.40:0/3234442551 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f8011a20 con 0x557f11027c50 2024-09-11T22:30:33.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f16ebe00640 1 -- 172.21.15.40:0/3234442551 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f16f8004340 con 0x557f11027c50 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f17141f9740 10 client.25018 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f17141f9740 10 client.25018 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f17141f9740 20 client.25018 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f17141f9740 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x557f110431d0 0x557f11044640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f17141f9740 4 client.25018 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.025+0000 7f17141f9740 1 -- 172.21.15.40:0/3234442551 --> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f10f9a620 con 0x557f110431d0 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.026+0000 7f170aa00640 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x557f110431d0 0x557f11044640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.026+0000 7f170aa00640 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x557f110431d0 0x557f11044640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4e4d365025524a6 server_cookie=7f3276a9975115dc in_seq=0 out_seq=0 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.026+0000 7f16ebe00640 10 client.25018 ms_handle_connect on v2:172.21.15.146:6838/2365077357 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.027+0000 7f16ebe00640 1 -- 172.21.15.40:0/3234442551 <== mds.0 v2:172.21.15.146:6838/2365077357 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f10f9a620 con 0x557f110431d0 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.027+0000 7f16ebe00640 10 client.25018 handle_command_reply: tid=0 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.027+0000 7f17141f9740 1 client.25018 shutdown 2024-09-11T22:30:33.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 -- 172.21.15.40:0/3234442551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 msgr2=0x557f1102fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 0x557f1102fa60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f16f801c000 tx=0x7f16f801d5e0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 -- 172.21.15.40:0/3234442551 shutdown_connections 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11032510 0x557f1102ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11027c50 0x557f1102fa60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x557f110431d0 0x557f11044640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 --2- 172.21.15.40:0/3234442551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 0x557f1102f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 -- 172.21.15.40:0/3234442551 >> 172.21.15.40:0/3234442551 conn(0x557f110238c0 msgr2=0x557f110295f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f16ebe00640 0 client.25018 ms_handle_reset on v2:172.21.15.146:6838/2365077357 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 -- 172.21.15.40:0/3234442551 shutdown_connections 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 1 -- 172.21.15.40:0/3234442551 wait complete. 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.028+0000 7f17141f9740 20 client.25018 trim_cache size 0 max 16384 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.047+0000 7f17141f9740 1 Processor -- start 2024-09-11T22:30:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.047+0000 7f17141f9740 1 -- start start 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.047+0000 7f17141f9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 0x557f11023210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.047+0000 7f17141f9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027c50 0x557f11031490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f17141f9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f1102fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f17141f9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557f11042980 con 0x557f11027c50 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f17141f9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557f11043050 con 0x557f11027330 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f17141f9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557f11043720 con 0x557f11032510 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f1102fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027c50 0x557f11031490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f1102fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:45152/0 (socket says 172.21.15.40:45152) 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170b400640 1 -- 172.21.15.40:0/3393975370 learned_addr learned my addr 172.21.15.40:0/3393975370 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170aa00640 1 --2- 172.21.15.40:0/3393975370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 0x557f11023210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170b400640 1 -- 172.21.15.40:0/3393975370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 msgr2=0x557f11023210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170b400640 1 --2- 172.21.15.40:0/3393975370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 0x557f11023210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170b400640 1 -- 172.21.15.40:0/3393975370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027c50 msgr2=0x557f11031490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170b400640 1 --2- 172.21.15.40:0/3393975370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027c50 0x557f11031490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.048+0000 7f170b400640 1 -- 172.21.15.40:0/3393975370 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1102e4f0 con 0x557f11032510 2024-09-11T22:30:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.049+0000 7f170b400640 1 --2- 172.21.15.40:0/3393975370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f1102fdf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1704097e90 tx=0x7f170409bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=108ba902bfdbb67e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:33.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.049+0000 7f16f6a00640 1 -- 172.21.15.40:0/3393975370 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170401f030 con 0x557f11032510 2024-09-11T22:30:33.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.049+0000 7f16f6a00640 1 -- 172.21.15.40:0/3393975370 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17040b4070 con 0x557f11032510 2024-09-11T22:30:33.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.049+0000 7f16f6a00640 1 -- 172.21.15.40:0/3393975370 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17040a44c0 con 0x557f11032510 2024-09-11T22:30:33.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 -- 172.21.15.40:0/3393975370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 msgr2=0x557f1102fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 --2- 172.21.15.40:0/3393975370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f1102fdf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1704097e90 tx=0x7f170409bb40 comp rx=0 tx=0).stop 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 -- 172.21.15.40:0/3393975370 shutdown_connections 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 --2- 172.21.15.40:0/3393975370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f1102fdf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 --2- 172.21.15.40:0/3393975370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027c50 0x557f11031490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 --2- 172.21.15.40:0/3393975370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027330 0x557f11023210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 -- 172.21.15.40:0/3393975370 >> 172.21.15.40:0/3393975370 conn(0x557f110238c0 msgr2=0x557f11030d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 -- 172.21.15.40:0/3393975370 shutdown_connections 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 -- 172.21.15.40:0/3393975370 wait complete. 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.050+0000 7f17141f9740 1 -- start start 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f17141f9740 1 Processor -- start 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f17141f9740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f1104c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f17141f9740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027c50 0x557f1104ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f17141f9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f11047890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f17141f9740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x557f110444c0 con 0x557f11027330 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f17141f9740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557f11043df0 con 0x557f11027c50 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f17141f9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x557f11044b90 con 0x557f11032510 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f17141f9740 10 client.0 _ll_register_callbacks cb 0x7f16f8005690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f170aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f1104c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f170aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f1104c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49150/0 (socket says 172.21.15.40:49150) 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f170aa00640 1 -- 172.21.15.40:0/3563101800 learned_addr learned my addr 172.21.15.40:0/3563101800 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f170b400640 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f11047890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.051+0000 7f170a000640 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027c50 0x557f1104ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f170aa00640 1 -- 172.21.15.40:0/3563101800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 msgr2=0x557f11047890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f170aa00640 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f11047890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f170aa00640 1 -- 172.21.15.40:0/3563101800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027c50 msgr2=0x557f1104ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f170aa00640 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027c50 0x557f1104ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f170aa00640 1 -- 172.21.15.40:0/3563101800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f11047ed0 con 0x557f11027330 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f170b400640 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f11047890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f170aa00640 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f1104c8e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16fc054fd0 tx=0x7f16fc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a119be20bde1ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f16ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f16ebe00640 1 -- 172.21.15.40:0/3563101800 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc035040 con 0x557f11027330 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f17141f9740 1 -- 172.21.15.40:0/3563101800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17040b4070 con 0x557f11027330 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.052+0000 7f16ebe00640 1 -- 172.21.15.40:0/3563101800 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f16fc003dd0 con 0x557f11027330 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f16ebe00640 1 -- 172.21.15.40:0/3563101800 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f16fc066050 con 0x557f11027330 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f17141f9740 10 client.15006 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f17141f9740 1 -- 172.21.15.40:0/3563101800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557f110ae280 con 0x557f11027330 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f16ebe00640 1 -- 172.21.15.40:0/3563101800 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17040b4070 con 0x557f11027330 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f16ebe00640 1 -- 172.21.15.40:0/3563101800 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f16fc0545d0 con 0x557f11027330 2024-09-11T22:30:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f17141f9740 10 client.15006 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f17141f9740 10 client.15006 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f17141f9740 20 client.15006 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f17141f9740 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x557f110b2e50 0x557f110b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f17141f9740 4 client.15006 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.053+0000 7f17141f9740 1 -- 172.21.15.40:0/3563101800 --> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] -- command(tid 0: {"prefix": "status"}) -- 0x557f10f94b30 con 0x557f110b2e50 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.054+0000 7f170a000640 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x557f110b2e50 0x557f110b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.054+0000 7f170a000640 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x557f110b2e50 0x557f110b1b60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab5456b12ec05f18 server_cookie=f73e49ca57c7c3c8 in_seq=0 out_seq=0 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.054+0000 7f16ebe00640 10 client.15006 ms_handle_connect on v2:172.21.15.146:6838/2365077357 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.054+0000 7f16ebe00640 1 -- 172.21.15.40:0/3563101800 <== mds.0 v2:172.21.15.146:6838/2365077357 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x557f10f94b30 con 0x557f110b2e50 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.054+0000 7f16ebe00640 10 client.15006 handle_command_reply: tid=0 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.054+0000 7f17141f9740 1 client.15006 shutdown 2024-09-11T22:30:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 -- 172.21.15.40:0/3563101800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 msgr2=0x557f1104c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f1104c8e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16fc054fd0 tx=0x7f16fc009260 comp rx=0 tx=0).stop 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 -- 172.21.15.40:0/3563101800 shutdown_connections 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557f11032510 0x557f11047890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x557f110b2e50 0x557f110b1b60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f11027c50 0x557f1104ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 --2- 172.21.15.40:0/3563101800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557f11027330 0x557f1104c8e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 -- 172.21.15.40:0/3563101800 >> 172.21.15.40:0/3563101800 conn(0x557f110238c0 msgr2=0x557f1103dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f16ebe00640 0 client.15006 ms_handle_reset on v2:172.21.15.146:6838/2365077357 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 -- 172.21.15.40:0/3563101800 shutdown_connections 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 1 -- 172.21.15.40:0/3563101800 wait complete. 2024-09-11T22:30:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.055+0000 7f17141f9740 20 client.15006 trim_cache size 0 max 16384 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24527, 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 129.93266738, 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 25, 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 95, 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T22:30:33.070 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 145.27759405 2024-09-11T22:30:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:30:33.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 -- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16f00a2c10 msgr2=0x7f16f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16f00a2c10 0x7f16f00a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f16fc009230 tx=0x7f16fc0058d0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 -- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c109120 msgr2=0x7f170c19ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c109120 0x7f170c19ef00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f170400eaa0 tx=0x7f170400ef60 comp rx=0 tx=0).stop 2024-09-11T22:30:33.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 -- 172.21.15.40:0/3956614160 shutdown_connections 2024-09-11T22:30:33.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f16f00a2c10 0x7f16f00a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f170c109120 0x7f170c19ef00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f170c1049a0 0x7f170c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 --2- 172.21.15.40:0/3956614160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170c103ff0 0x7f170c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 -- 172.21.15.40:0/3956614160 >> 172.21.15.40:0/3956614160 conn(0x7f170c0ffa90 msgr2=0x7f170c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:33.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 -- 172.21.15.40:0/3956614160 shutdown_connections 2024-09-11T22:30:33.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:33.056+0000 7f1711600640 1 -- 172.21.15.40:0/3956614160 wait complete. 2024-09-11T22:30:33.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:32 smithi177 ceph-mon[35530]: pgmap v372: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:33.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:32 smithi146 ceph-mon[34996]: pgmap v372: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:33.798 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T22:30:33.798 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T22:30:33.808 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T22:30:33.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T22:30:34.190 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.746+0000 7f4422c00640 1 -- 172.21.15.40:0/1832822117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c103c50 msgr2=0x7f441c104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.746+0000 7f4422c00640 1 --2- 172.21.15.40:0/1832822117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c103c50 0x7f441c104050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4410009900 tx=0x7f441002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.746+0000 7f4422c00640 1 -- 172.21.15.40:0/1832822117 shutdown_connections 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.746+0000 7f4422c00640 1 --2- 172.21.15.40:0/1832822117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c105810 0x7f441c10c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.746+0000 7f4422c00640 1 --2- 172.21.15.40:0/1832822117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f441c104e50 0x7f441c1052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.746+0000 7f4422c00640 1 --2- 172.21.15.40:0/1832822117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c103c50 0x7f441c104050 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.746+0000 7f4422c00640 1 -- 172.21.15.40:0/1832822117 >> 172.21.15.40:0/1832822117 conn(0x7f441c0ff3e0 msgr2=0x7f441c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.746+0000 7f4422c00640 1 -- 172.21.15.40:0/1832822117 shutdown_connections 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.747+0000 7f4422c00640 1 -- 172.21.15.40:0/1832822117 wait complete. 2024-09-11T22:30:34.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.747+0000 7f4422c00640 1 Processor -- start 2024-09-11T22:30:34.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.747+0000 7f4422c00640 1 -- start start 2024-09-11T22:30:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4422c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f441c103c50 0x7f441c199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4422c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c104e50 0x7f441c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4422c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c105810 0x7f441c1a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4422c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f441c10f900 con 0x7f441c104e50 2024-09-11T22:30:34.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4422c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f441c10f780 con 0x7f441c105810 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4422c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f441c10fa80 con 0x7f441c103c50 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4420e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c104e50 0x7f441c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4421800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f441c103c50 0x7f441c199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4420e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c104e50 0x7f441c19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49160/0 (socket says 172.21.15.40:49160) 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4420e00640 1 -- 172.21.15.40:0/996306307 learned_addr learned my addr 172.21.15.40:0/996306307 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4421800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f441c103c50 0x7f441c199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:45182/0 (socket says 172.21.15.40:45182) 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.748+0000 7f4422200640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c105810 0x7f441c1a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f4421800640 1 -- 172.21.15.40:0/996306307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c105810 msgr2=0x7f441c1a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f4421800640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c105810 0x7f441c1a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f4421800640 1 -- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c104e50 msgr2=0x7f441c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f4421800640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c104e50 0x7f441c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f4421800640 1 -- 172.21.15.40:0/996306307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441c1a1b20 con 0x7f441c103c50 2024-09-11T22:30:34.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f4420e00640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c104e50 0x7f441c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f4421800640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f441c103c50 0x7f441c199ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4410009230 tx=0x7f4410032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f441a000640 1 -- 172.21.15.40:0/996306307 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441003f030 con 0x7f441c103c50 2024-09-11T22:30:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f441a000640 1 -- 172.21.15.40:0/996306307 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4410003ce0 con 0x7f441c103c50 2024-09-11T22:30:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441c1a1db0 con 0x7f441c103c50 2024-09-11T22:30:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.749+0000 7f441a000640 1 -- 172.21.15.40:0/996306307 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410035070 con 0x7f441c103c50 2024-09-11T22:30:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.750+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f441c1a21b0 con 0x7f441c103c50 2024-09-11T22:30:34.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.751+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441c10afa0 con 0x7f441c103c50 2024-09-11T22:30:34.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.753+0000 7f441a000640 1 -- 172.21.15.40:0/996306307 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4410042030 con 0x7f441c103c50 2024-09-11T22:30:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.754+0000 7f441a000640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f44040a2c40 0x7f44040a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.754+0000 7f441a000640 1 -- 172.21.15.40:0/996306307 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f44100efe90 con 0x7f441c103c50 2024-09-11T22:30:34.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.754+0000 7f4420e00640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f44040a2c40 0x7f44040a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.755+0000 7f4420e00640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f44040a2c40 0x7f44040a5100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f441c19b410 tx=0x7f440800b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.756+0000 7f441a000640 1 -- 172.21.15.40:0/996306307 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44100bc250 con 0x7f441c103c50 2024-09-11T22:30:34.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.964+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f441c062630 con 0x7f44040a2c40 2024-09-11T22:30:34.965 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:34 smithi040 ceph-mon[30787]: pgmap v373: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:34.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.965+0000 7f441a000640 1 -- 172.21.15.40:0/996306307 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f441c062630 con 0x7f44040a2c40 2024-09-11T22:30:34.965 INFO:teuthology.orchestra.run.smithi040.stdout:Backend: cephadm 2024-09-11T22:30:34.965 INFO:teuthology.orchestra.run.smithi040.stdout:Available: Yes 2024-09-11T22:30:34.966 INFO:teuthology.orchestra.run.smithi040.stdout:Paused: No 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f44040a2c40 msgr2=0x7f44040a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f44040a2c40 0x7f44040a5100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f441c19b410 tx=0x7f440800b4a0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f441c103c50 msgr2=0x7f441c199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f441c103c50 0x7f441c199ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4410009230 tx=0x7f4410032d50 comp rx=0 tx=0).stop 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 shutdown_connections 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f44040a2c40 0x7f44040a5100 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f441c105810 0x7f441c1a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f441c104e50 0x7f441c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 --2- 172.21.15.40:0/996306307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f441c103c50 0x7f441c199ef0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 >> 172.21.15.40:0/996306307 conn(0x7f441c0ff3e0 msgr2=0x7f441c108170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:34.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 shutdown_connections 2024-09-11T22:30:34.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:34.968+0000 7f4422c00640 1 -- 172.21.15.40:0/996306307 wait complete. 2024-09-11T22:30:35.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:34 smithi177 ceph-mon[35530]: pgmap v373: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:34 smithi146 ceph-mon[34996]: pgmap v373: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:35.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T22:30:35.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:35 smithi040 ceph-mon[30787]: from='client.25030 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:36.112 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:36.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:35 smithi177 ceph-mon[35530]: from='client.25030 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:36.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:35 smithi146 ceph-mon[34996]: from='client.25030 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:36.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.645+0000 7f9ab4800640 1 -- 172.21.15.40:0/512366663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac105920 msgr2=0x7f9aac10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:36.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.645+0000 7f9ab4800640 1 --2- 172.21.15.40:0/512366663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac105920 0x7f9aac10c240 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009ca0 tx=0x7f9aa802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.645+0000 7f9ab4800640 1 -- 172.21.15.40:0/512366663 shutdown_connections 2024-09-11T22:30:36.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.645+0000 7f9ab4800640 1 --2- 172.21.15.40:0/512366663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac105920 0x7f9aac10c240 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.645+0000 7f9ab4800640 1 --2- 172.21.15.40:0/512366663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac104f60 0x7f9aac1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.645+0000 7f9ab4800640 1 --2- 172.21.15.40:0/512366663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9aac103e00 0x7f9aac104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.645+0000 7f9ab4800640 1 -- 172.21.15.40:0/512366663 >> 172.21.15.40:0/512366663 conn(0x7f9aac0ff5b0 msgr2=0x7f9aac1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.645+0000 7f9ab4800640 1 -- 172.21.15.40:0/512366663 shutdown_connections 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.645+0000 7f9ab4800640 1 -- 172.21.15.40:0/512366663 wait complete. 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.646+0000 7f9ab4800640 1 Processor -- start 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab4800640 1 -- start start 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab4800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac103e00 0x7f9aac19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab4800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac104f60 0x7f9aac19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab4800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9aac105920 0x7f9aac1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab4800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac10fae0 con 0x7f9aac103e00 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab4800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac10f960 con 0x7f9aac105920 2024-09-11T22:30:36.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab4800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac10fc60 con 0x7f9aac104f60 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac103e00 0x7f9aac19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab1e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac103e00 0x7f9aac19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49178/0 (socket says 172.21.15.40:49178) 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab1e00640 1 -- 172.21.15.40:0/1455266167 learned_addr learned my addr 172.21.15.40:0/1455266167 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab1400640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac104f60 0x7f9aac19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.647+0000 7f9ab2800640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9aac105920 0x7f9aac1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9ab1e00640 1 -- 172.21.15.40:0/1455266167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac104f60 msgr2=0x7f9aac19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9ab1e00640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac104f60 0x7f9aac19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9ab1e00640 1 -- 172.21.15.40:0/1455266167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9aac105920 msgr2=0x7f9aac1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9ab1e00640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9aac105920 0x7f9aac1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9ab1e00640 1 -- 172.21.15.40:0/1455266167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac1a1c80 con 0x7f9aac103e00 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9ab1e00640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac103e00 0x7f9aac19a050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000ea60 tx=0x7f9aa000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9aa6a00640 1 -- 172.21.15.40:0/1455266167 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000cde0 con 0x7f9aac103e00 2024-09-11T22:30:36.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9aa6a00640 1 -- 172.21.15.40:0/1455266167 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9aa00035f0 con 0x7f9aac103e00 2024-09-11T22:30:36.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac1a1f70 con 0x7f9aac103e00 2024-09-11T22:30:36.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.648+0000 7f9aa6a00640 1 -- 172.21.15.40:0/1455266167 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0010670 con 0x7f9aac103e00 2024-09-11T22:30:36.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.649+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac1a2420 con 0x7f9aac103e00 2024-09-11T22:30:36.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.650+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aac10b120 con 0x7f9aac103e00 2024-09-11T22:30:36.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.651+0000 7f9aa6a00640 1 -- 172.21.15.40:0/1455266167 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9aa00037a0 con 0x7f9aac103e00 2024-09-11T22:30:36.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.653+0000 7f9aa6a00640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9a940a2cc0 0x7f9a940a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:36.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.653+0000 7f9aa6a00640 1 -- 172.21.15.40:0/1455266167 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f9aa00cf960 con 0x7f9aac103e00 2024-09-11T22:30:36.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.653+0000 7f9ab1400640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9a940a2cc0 0x7f9a940a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:36.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.654+0000 7f9ab1400640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9a940a2cc0 0x7f9a940a5180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9aac19b570 tx=0x7f9a9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:36.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.657+0000 7f9aa6a00640 1 -- 172.21.15.40:0/1455266167 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9aa009c370 con 0x7f9aac103e00 2024-09-11T22:30:36.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.847+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9aac062630 con 0x7f9a940a2cc0 2024-09-11T22:30:36.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.860+0000 7f9aa6a00640 1 -- 172.21.15.40:0/1455266167 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7f9aac062630 con 0x7f9a940a2cc0 2024-09-11T22:30:36.861 INFO:teuthology.orchestra.run.smithi040.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T22:30:36.861 INFO:teuthology.orchestra.run.smithi040.stdout:mds.a smithi040 running (2m) 15s ago 2m 13.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 89711e74356d 2024-09-11T22:30:36.861 INFO:teuthology.orchestra.run.smithi040.stdout:mds.b smithi146 running (2m) 17s ago 2m 26.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 6535afd86785 2024-09-11T22:30:36.861 INFO:teuthology.orchestra.run.smithi040.stdout:mds.c smithi177 running (2m) 17s ago 2m 18.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 3a8cf4e39455 2024-09-11T22:30:36.861 INFO:teuthology.orchestra.run.smithi040.stdout:mds.d smithi040 running (2m) 15s ago 2m 13.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 836bb32fe9f8 2024-09-11T22:30:36.861 INFO:teuthology.orchestra.run.smithi040.stdout:mds.e smithi146 running (2m) 17s ago 2m 20.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 e47700b248b4 2024-09-11T22:30:36.861 INFO:teuthology.orchestra.run.smithi040.stdout:mds.f smithi177 running (2m) 17s ago 2m 19.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 3b1966b007ed 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mds.g smithi040 running (2m) 15s ago 2m 13.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 939eed789834 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mds.h smithi146 running (2m) 17s ago 2m 19.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 d022d5eb845a 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mds.i smithi177 running (2m) 17s ago 2m 17.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 30220e6a438c 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mds.j smithi040 running (2m) 15s ago 2m 13.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 f94cfae72b89 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mds.k smithi146 running (3m) 17s ago 3m 16.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 6e2864040c28 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mds.l smithi177 running (3m) 17s ago 3m 17.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 987ae185b57c 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.x smithi040 *:9283,8765 running (10m) 15s ago 10m 509M - 19.1.1-298-gb53b6d3e 54467abc55f8 1eadf4c36052 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.y smithi146 *:8443,8765 running (8m) 17s ago 8m 444M - 19.1.1-298-gb53b6d3e 54467abc55f8 a87c00a9e03a 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mgr.z smithi177 *:8443,8765 running (8m) 17s ago 8m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 85c43e128374 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mon.a smithi040 running (10m) 15s ago 10m 49.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 7e01a1771198 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mon.b smithi146 running (8m) 17s ago 8m 40.9M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f8bd6c8361dc 2024-09-11T22:30:36.862 INFO:teuthology.orchestra.run.smithi040.stdout:mon.c smithi177 running (9m) 17s ago 9m 41.2M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 4dbf9b00d293 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 smithi040 running (8m) 15s ago 8m 45.5M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 e79de3861541 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 smithi146 running (7m) 17s ago 7m 48.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 77def46e5bb2 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 smithi177 running (7m) 17s ago 7m 56.9M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 3932567ceb09 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 smithi040 running (7m) 15s ago 7m 51.5M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 d2260919c676 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 smithi146 running (6m) 17s ago 6m 42.6M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 ccef8da24d69 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 smithi177 running (6m) 17s ago 6m 45.6M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 1c1e57e5f596 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 smithi040 running (5m) 15s ago 5m 48.4M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 c2ef69988d58 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 smithi146 running (5m) 17s ago 5m 46.1M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 df1008553292 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.8 smithi177 running (4m) 17s ago 4m 43.7M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 1f94ac969a9d 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.9 smithi040 running (4m) 15s ago 4m 40.8M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 374feb031536 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.10 smithi146 running (3m) 17s ago 3m 51.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 bb47f59b0346 2024-09-11T22:30:36.863 INFO:teuthology.orchestra.run.smithi040.stdout:osd.11 smithi177 running (3m) 17s ago 3m 42.8M 4271M 19.1.1-298-gb53b6d3e 54467abc55f8 11f556fb7657 2024-09-11T22:30:36.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.862+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9a940a2cc0 msgr2=0x7f9a940a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:36.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.862+0000 7f9ab4800640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9a940a2cc0 0x7f9a940a5180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9aac19b570 tx=0x7f9a9c005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:36.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.862+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac103e00 msgr2=0x7f9aac19a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:36.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.862+0000 7f9ab4800640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac103e00 0x7f9aac19a050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000ea60 tx=0x7f9aa000ef20 comp rx=0 tx=0).stop 2024-09-11T22:30:36.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.863+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 shutdown_connections 2024-09-11T22:30:36.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.863+0000 7f9ab4800640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f9a940a2cc0 0x7f9a940a5180 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.863+0000 7f9ab4800640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9aac105920 0x7f9aac1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.863+0000 7f9ab4800640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9aac104f60 0x7f9aac19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.863+0000 7f9ab4800640 1 --2- 172.21.15.40:0/1455266167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9aac103e00 0x7f9aac19a050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:36.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.863+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 >> 172.21.15.40:0/1455266167 conn(0x7f9aac0ff5b0 msgr2=0x7f9aac1082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:36.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.863+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 shutdown_connections 2024-09-11T22:30:36.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:36.863+0000 7f9ab4800640 1 -- 172.21.15.40:0/1455266167 wait complete. 2024-09-11T22:30:37.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:36 smithi040 ceph-mon[30787]: pgmap v374: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:37.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:36 smithi177 ceph-mon[35530]: pgmap v374: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:37.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:36 smithi146 ceph-mon[34996]: pgmap v374: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:37.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T22:30:37.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:37 smithi040 ceph-mon[30787]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:38.041 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:38.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:37 smithi177 ceph-mon[35530]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:38.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:37 smithi146 ceph-mon[34996]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.607+0000 7fd88a800640 1 -- 172.21.15.40:0/575789703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd884076ba0 msgr2=0x7fd884076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.607+0000 7fd88a800640 1 --2- 172.21.15.40:0/575789703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd884076ba0 0x7fd884076fa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd874009900 tx=0x7fd87402a3f0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.607+0000 7fd88a800640 1 -- 172.21.15.40:0/575789703 shutdown_connections 2024-09-11T22:30:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.607+0000 7fd88a800640 1 --2- 172.21.15.40:0/575789703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd884078790 0x7fd884079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.607+0000 7fd88a800640 1 --2- 172.21.15.40:0/575789703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd884077df0 0x7fd884078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.607+0000 7fd88a800640 1 --2- 172.21.15.40:0/575789703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd884076ba0 0x7fd884076fa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.607+0000 7fd88a800640 1 -- 172.21.15.40:0/575789703 >> 172.21.15.40:0/575789703 conn(0x7fd8840ff5b0 msgr2=0x7fd8841019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:38.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.607+0000 7fd88a800640 1 -- 172.21.15.40:0/575789703 shutdown_connections 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.607+0000 7fd88a800640 1 -- 172.21.15.40:0/575789703 wait complete. 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.608+0000 7fd88a800640 1 Processor -- start 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.608+0000 7fd88a800640 1 -- start start 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.608+0000 7fd88a800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd884076ba0 0x7fd88419e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.608+0000 7fd88a800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd884077df0 0x7fd88419e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.608+0000 7fd88a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd884078790 0x7fd8841a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.608+0000 7fd88a800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd884113f10 con 0x7fd884076ba0 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.608+0000 7fd88a800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd884113d90 con 0x7fd884077df0 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.608+0000 7fd88a800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd884114090 con 0x7fd884078790 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd884076ba0 0x7fd88419e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd884076ba0 0x7fd88419e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49192/0 (socket says 172.21.15.40:49192) 2024-09-11T22:30:38.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883400640 1 -- 172.21.15.40:0/2687467544 learned_addr learned my addr 172.21.15.40:0/2687467544 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883e00640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd884078790 0x7fd8841a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd87be00640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd884077df0 0x7fd88419e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883e00640 1 -- 172.21.15.40:0/2687467544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd884077df0 msgr2=0x7fd88419e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883e00640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd884077df0 0x7fd88419e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883e00640 1 -- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd884076ba0 msgr2=0x7fd88419e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883e00640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd884076ba0 0x7fd88419e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883e00640 1 -- 172.21.15.40:0/2687467544 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8841a60e0 con 0x7fd884078790 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883400640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd884076ba0 0x7fd88419e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.609+0000 7fd883e00640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd884078790 0x7fd8841a5a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009fd0 tx=0x7fd87c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.610+0000 7fd880c00640 1 -- 172.21.15.40:0/2687467544 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00ce20 con 0x7fd884078790 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.610+0000 7fd880c00640 1 -- 172.21.15.40:0/2687467544 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd87c005020 con 0x7fd884078790 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.610+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8841a63d0 con 0x7fd884078790 2024-09-11T22:30:38.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.610+0000 7fd880c00640 1 -- 172.21.15.40:0/2687467544 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c010720 con 0x7fd884078790 2024-09-11T22:30:38.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.610+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8841a6910 con 0x7fd884078790 2024-09-11T22:30:38.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.611+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd884110780 con 0x7fd884078790 2024-09-11T22:30:38.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.613+0000 7fd880c00640 1 -- 172.21.15.40:0/2687467544 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd87c005540 con 0x7fd884078790 2024-09-11T22:30:38.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.614+0000 7fd880c00640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd8680a2c40 0x7fd8680a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:38.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.614+0000 7fd880c00640 1 -- 172.21.15.40:0/2687467544 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fd87c0cfbc0 con 0x7fd884078790 2024-09-11T22:30:38.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.615+0000 7fd883400640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd8680a2c40 0x7fd8680a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:38.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.615+0000 7fd883400640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd8680a2c40 0x7fd8680a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd8740096c0 tx=0x7fd8740315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:38.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.616+0000 7fd880c00640 1 -- 172.21.15.40:0/2687467544 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd87c09c5d0 con 0x7fd884078790 2024-09-11T22:30:38.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.811+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd884062630 con 0x7fd8680a2c40 2024-09-11T22:30:38.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.817+0000 7fd880c00640 1 -- 172.21.15.40:0/2687467544 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd884062630 con 0x7fd8680a2c40 2024-09-11T22:30:38.817 INFO:teuthology.orchestra.run.smithi040.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T22:30:38.817 INFO:teuthology.orchestra.run.smithi040.stdout:mds.all 12/12 19s ago 3m smithi040=a;smithi040=d;smithi040=g;smithi040=j;smithi146=b;smithi146=e;smithi146=h;smithi146=k;smithi177=c;smithi177=f;smithi177=i;smithi177=l;count:12 2024-09-11T22:30:38.817 INFO:teuthology.orchestra.run.smithi040.stdout:mgr 3/3 19s ago 8m smithi040=x;smithi146=y;smithi177=z;count:3 2024-09-11T22:30:38.817 INFO:teuthology.orchestra.run.smithi040.stdout:mon 3/3 19s ago 9m smithi040:172.21.15.40=a;smithi146:172.21.15.146=b;smithi177:172.21.15.177=c;count:3 2024-09-11T22:30:38.818 INFO:teuthology.orchestra.run.smithi040.stdout:osd 12 19s ago - 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd8680a2c40 msgr2=0x7fd8680a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd8680a2c40 0x7fd8680a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd8740096c0 tx=0x7fd8740315b0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd884078790 msgr2=0x7fd8841a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd884078790 0x7fd8841a5a70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009fd0 tx=0x7fd87c00ef10 comp rx=0 tx=0).stop 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 shutdown_connections 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd8680a2c40 0x7fd8680a5100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd884078790 0x7fd8841a5a70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd884077df0 0x7fd88419e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 --2- 172.21.15.40:0/2687467544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd884076ba0 0x7fd88419e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 >> 172.21.15.40:0/2687467544 conn(0x7fd8840ff5b0 msgr2=0x7fd884101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 shutdown_connections 2024-09-11T22:30:38.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:38.819+0000 7fd88a800640 1 -- 172.21.15.40:0/2687467544 wait complete. 2024-09-11T22:30:39.188 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:38 smithi040 ceph-mon[30787]: pgmap v375: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:39.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:38 smithi177 ceph-mon[35530]: pgmap v375: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:39.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:38 smithi146 ceph-mon[34996]: pgmap v375: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:39.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T22:30:39.987 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:40.164 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:39 smithi040 ceph-mon[30787]: from='client.25042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:40.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:39 smithi177 ceph-mon[35530]: from='client.25042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:40.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:39 smithi146 ceph-mon[34996]: from='client.25042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:40.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.574+0000 7fb538000640 1 -- 172.21.15.40:0/2022193895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5301037c0 msgr2=0x7fb53010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:40.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.574+0000 7fb538000640 1 --2- 172.21.15.40:0/2022193895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5301037c0 0x7fb53010a050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb528009ca0 tx=0x7fb52802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.574+0000 7fb538000640 1 -- 172.21.15.40:0/2022193895 shutdown_connections 2024-09-11T22:30:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.575+0000 7fb538000640 1 --2- 172.21.15.40:0/2022193895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5301037c0 0x7fb53010a050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.575+0000 7fb538000640 1 --2- 172.21.15.40:0/2022193895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb530102e00 0x7fb530103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.575+0000 7fb538000640 1 --2- 172.21.15.40:0/2022193895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb530101c00 0x7fb530102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.575+0000 7fb538000640 1 -- 172.21.15.40:0/2022193895 >> 172.21.15.40:0/2022193895 conn(0x7fb5300fd390 msgr2=0x7fb5300ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.575+0000 7fb538000640 1 -- 172.21.15.40:0/2022193895 shutdown_connections 2024-09-11T22:30:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.575+0000 7fb538000640 1 -- 172.21.15.40:0/2022193895 wait complete. 2024-09-11T22:30:40.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb538000640 1 Processor -- start 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb538000640 1 -- start start 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb538000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb530101c00 0x7fb53019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb538000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb530102e00 0x7fb53019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb538000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5301037c0 0x7fb5301a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb538000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb53010d860 con 0x7fb530102e00 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb538000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb53010d6e0 con 0x7fb5301037c0 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb538000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb53010d9e0 con 0x7fb530101c00 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb535600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb530101c00 0x7fb53019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb535600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb530101c00 0x7fb53019a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:45240/0 (socket says 172.21.15.40:45240) 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.576+0000 7fb535600640 1 -- 172.21.15.40:0/2230531704 learned_addr learned my addr 172.21.15.40:0/2230531704 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.577+0000 7fb536000640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5301037c0 0x7fb5301a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:40.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.577+0000 7fb534c00640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb530102e00 0x7fb53019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.577+0000 7fb535600640 1 -- 172.21.15.40:0/2230531704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5301037c0 msgr2=0x7fb5301a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.577+0000 7fb535600640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5301037c0 0x7fb5301a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.577+0000 7fb535600640 1 -- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb530102e00 msgr2=0x7fb53019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.577+0000 7fb535600640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb530102e00 0x7fb53019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.577+0000 7fb535600640 1 -- 172.21.15.40:0/2230531704 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5301a1cc0 con 0x7fb530101c00 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.577+0000 7fb535600640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb530101c00 0x7fb53019a090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb52400e9c0 tx=0x7fb52400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.578+0000 7fb52e000640 1 -- 172.21.15.40:0/2230531704 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52400cd80 con 0x7fb530101c00 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.578+0000 7fb52e000640 1 -- 172.21.15.40:0/2230531704 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5240035f0 con 0x7fb530101c00 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.578+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5301a1fb0 con 0x7fb530101c00 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.578+0000 7fb52e000640 1 -- 172.21.15.40:0/2230531704 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524010690 con 0x7fb530101c00 2024-09-11T22:30:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.578+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5301a2400 con 0x7fb530101c00 2024-09-11T22:30:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.579+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5301a26c0 con 0x7fb530101c00 2024-09-11T22:30:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.581+0000 7fb52e000640 1 -- 172.21.15.40:0/2230531704 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb5240037a0 con 0x7fb530101c00 2024-09-11T22:30:40.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.582+0000 7fb52e000640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5180a2c40 0x7fb5180a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:40.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.582+0000 7fb52e000640 1 -- 172.21.15.40:0/2230531704 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fb5240cfaa0 con 0x7fb530101c00 2024-09-11T22:30:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.582+0000 7fb534c00640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5180a2c40 0x7fb5180a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.583+0000 7fb534c00640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5180a2c40 0x7fb5180a5100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb53019b5b0 tx=0x7fb51c00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.584+0000 7fb52e000640 1 -- 172.21.15.40:0/2230531704 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb52409c540 con 0x7fb530101c00 2024-09-11T22:30:40.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.777+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fb530075b40 con 0x7fb5180a2c40 2024-09-11T22:30:40.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.779+0000 7fb52e000640 1 -- 172.21.15.40:0/2230531704 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fb530075b40 con 0x7fb5180a2c40 2024-09-11T22:30:40.779 INFO:teuthology.orchestra.run.smithi040.stdout:HOST ADDR LABELS STATUS 2024-09-11T22:30:40.779 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040 172.21.15.40 2024-09-11T22:30:40.780 INFO:teuthology.orchestra.run.smithi040.stdout:smithi146 172.21.15.146 2024-09-11T22:30:40.780 INFO:teuthology.orchestra.run.smithi040.stdout:smithi177 172.21.15.177 2024-09-11T22:30:40.780 INFO:teuthology.orchestra.run.smithi040.stdout:3 hosts in cluster 2024-09-11T22:30:40.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5180a2c40 msgr2=0x7fb5180a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:40.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5180a2c40 0x7fb5180a5100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb53019b5b0 tx=0x7fb51c00b590 comp rx=0 tx=0).stop 2024-09-11T22:30:40.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb530101c00 msgr2=0x7fb53019a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:40.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb530101c00 0x7fb53019a090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb52400e9c0 tx=0x7fb52400ee80 comp rx=0 tx=0).stop 2024-09-11T22:30:40.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 shutdown_connections 2024-09-11T22:30:40.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fb5180a2c40 0x7fb5180a5100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5301037c0 0x7fb5301a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb530102e00 0x7fb53019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 --2- 172.21.15.40:0/2230531704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb530101c00 0x7fb53019a090 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:40.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 >> 172.21.15.40:0/2230531704 conn(0x7fb5300fd390 msgr2=0x7fb530074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:40.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 shutdown_connections 2024-09-11T22:30:40.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:40.781+0000 7fb538000640 1 -- 172.21.15.40:0/2230531704 wait complete. 2024-09-11T22:30:41.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:40 smithi040 ceph-mon[30787]: pgmap v376: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:40 smithi177 ceph-mon[35530]: pgmap v376: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:41.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:40 smithi146 ceph-mon[34996]: pgmap v376: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:41.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T22:30:41.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:41 smithi040 ceph-mon[30787]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:42.134 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:42.183 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:41 smithi177 ceph-mon[35530]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:42.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:41 smithi146 ceph-mon[34996]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:42.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.694+0000 7fbf15c00640 1 -- 172.21.15.40:0/1466401611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10105920 msgr2=0x7fbf1010c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:42.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.694+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1466401611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10105920 0x7fbf1010c240 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009be0 tx=0x7fbf0802a6d0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.694+0000 7fbf15c00640 1 -- 172.21.15.40:0/1466401611 shutdown_connections 2024-09-11T22:30:42.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.694+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1466401611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10105920 0x7fbf1010c240 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.694+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1466401611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf10104f60 0x7fbf101053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.694+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1466401611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf10103e00 0x7fbf10104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.694+0000 7fbf15c00640 1 -- 172.21.15.40:0/1466401611 >> 172.21.15.40:0/1466401611 conn(0x7fbf100ff5b0 msgr2=0x7fbf101019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:42.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.694+0000 7fbf15c00640 1 -- 172.21.15.40:0/1466401611 shutdown_connections 2024-09-11T22:30:42.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.694+0000 7fbf15c00640 1 -- 172.21.15.40:0/1466401611 wait complete. 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.695+0000 7fbf15c00640 1 Processor -- start 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.695+0000 7fbf15c00640 1 -- start start 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf15c00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf10103e00 0x7fbf1019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf15c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf10104f60 0x7fbf1019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf15c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10105920 0x7fbf101a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf15c00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1010fa60 con 0x7fbf10103e00 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf15c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1010f8e0 con 0x7fbf10104f60 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf15c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1010fbe0 con 0x7fbf10105920 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf10103e00 0x7fbf1019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10105920 0x7fbf101a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0ea00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf10103e00 0x7fbf1019a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52718/0 (socket says 172.21.15.40:52718) 2024-09-11T22:30:42.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0ea00640 1 -- 172.21.15.40:0/1495630411 learned_addr learned my addr 172.21.15.40:0/1495630411 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0e000640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf10104f60 0x7fbf1019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0ea00640 1 -- 172.21.15.40:0/1495630411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10105920 msgr2=0x7fbf101a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0ea00640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10105920 0x7fbf101a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0ea00640 1 -- 172.21.15.40:0/1495630411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf10104f60 msgr2=0x7fbf1019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0ea00640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf10104f60 0x7fbf1019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.696+0000 7fbf0ea00640 1 -- 172.21.15.40:0/1495630411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf101a1c80 con 0x7fbf10103e00 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.697+0000 7fbf0ea00640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf10103e00 0x7fbf1019a050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000e9f0 tx=0x7fbf0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.697+0000 7fbf07400640 1 -- 172.21.15.40:0/1495630411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0000cd80 con 0x7fbf10103e00 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.697+0000 7fbf07400640 1 -- 172.21.15.40:0/1495630411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf00005500 con 0x7fbf10103e00 2024-09-11T22:30:42.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.697+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf101a1f70 con 0x7fbf10103e00 2024-09-11T22:30:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.697+0000 7fbf07400640 1 -- 172.21.15.40:0/1495630411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00010690 con 0x7fbf10103e00 2024-09-11T22:30:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.697+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf101a23c0 con 0x7fbf10103e00 2024-09-11T22:30:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.698+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf1010b1a0 con 0x7fbf10103e00 2024-09-11T22:30:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.700+0000 7fbf07400640 1 -- 172.21.15.40:0/1495630411 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbf000046c0 con 0x7fbf10103e00 2024-09-11T22:30:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.701+0000 7fbf07400640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbef40a2c40 0x7fbef40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.701+0000 7fbf07400640 1 -- 172.21.15.40:0/1495630411 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fbf000cf9c0 con 0x7fbf10103e00 2024-09-11T22:30:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.702+0000 7fbf0e000640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbef40a2c40 0x7fbef40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.702+0000 7fbf0e000640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbef40a2c40 0x7fbef40a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbf1019b570 tx=0x7fbefc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:42.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.706+0000 7fbf07400640 1 -- 172.21.15.40:0/1495630411 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf0009c3d0 con 0x7fbf10103e00 2024-09-11T22:30:42.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.900+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 --> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fbf10062630 con 0x7fbef40a2c40 2024-09-11T22:30:42.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.901+0000 7fbf07400640 1 -- 172.21.15.40:0/1495630411 <== mgr.14150 v2:172.21.15.40:6800/3905506167 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fbf10062630 con 0x7fbef40a2c40 2024-09-11T22:30:42.902 INFO:teuthology.orchestra.run.smithi040.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T22:30:42.902 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009J400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-11T22:30:42.902 INFO:teuthology.orchestra.run.smithi040.stdout:smithi146 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GB400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T22:30:42.902 INFO:teuthology.orchestra.run.smithi040.stdout:smithi177 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233007S400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T22:30:42.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbef40a2c40 msgr2=0x7fbef40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:42.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbef40a2c40 0x7fbef40a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbf1019b570 tx=0x7fbefc009260 comp rx=0 tx=0).stop 2024-09-11T22:30:42.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf10103e00 msgr2=0x7fbf1019a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:42.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf10103e00 0x7fbf1019a050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000e9f0 tx=0x7fbf0000edf0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 shutdown_connections 2024-09-11T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fbef40a2c40 0x7fbef40a5100 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10105920 0x7fbf101a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf10104f60 0x7fbf1019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 --2- 172.21.15.40:0/1495630411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf10103e00 0x7fbf1019a050 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 >> 172.21.15.40:0/1495630411 conn(0x7fbf100ff5b0 msgr2=0x7fbf10108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 shutdown_connections 2024-09-11T22:30:42.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:42.904+0000 7fbf15c00640 1 -- 172.21.15.40:0/1495630411 wait complete. 2024-09-11T22:30:43.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:42 smithi040 ceph-mon[30787]: pgmap v377: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:42 smithi177 ceph-mon[35530]: pgmap v377: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:43.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:42 smithi146 ceph-mon[34996]: pgmap v377: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:43.655 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T22:30:43.664 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T22:30:43.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T22:30:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:44.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:43 smithi040 ceph-mon[30787]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:44.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:43 smithi177 ceph-mon[35530]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:44.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:43 smithi146 ceph-mon[34996]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T22:30:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.659+0000 7f1323e00640 1 -- 172.21.15.40:0/1115013790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 msgr2=0x7f131c104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.659+0000 7f1323e00640 1 --2- 172.21.15.40:0/1115013790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 0x7f131c104200 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1310009900 tx=0x7f131002a410 comp rx=0 tx=0).stop 2024-09-11T22:30:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.660+0000 7f1323e00640 1 -- 172.21.15.40:0/1115013790 shutdown_connections 2024-09-11T22:30:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.660+0000 7f1323e00640 1 --2- 172.21.15.40:0/1115013790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f131c105920 0x7f131c10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.660+0000 7f1323e00640 1 --2- 172.21.15.40:0/1115013790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f131c104f60 0x7f131c1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.660+0000 7f1323e00640 1 --2- 172.21.15.40:0/1115013790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 0x7f131c104200 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.660+0000 7f1323e00640 1 -- 172.21.15.40:0/1115013790 >> 172.21.15.40:0/1115013790 conn(0x7f131c0ff5b0 msgr2=0x7f131c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.660+0000 7f1323e00640 1 -- 172.21.15.40:0/1115013790 shutdown_connections 2024-09-11T22:30:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.660+0000 7f1323e00640 1 -- 172.21.15.40:0/1115013790 wait complete. 2024-09-11T22:30:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.661+0000 7f1323e00640 1 Processor -- start 2024-09-11T22:30:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.661+0000 7f1323e00640 1 -- start start 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1323e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 0x7f131c19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1323e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f131c104f60 0x7f131c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1323e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f131c105920 0x7f131c1a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1323e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f131c10fae0 con 0x7f131c103e00 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1323e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f131c10f960 con 0x7f131c104f60 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1323e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f131c10fc60 con 0x7f131c105920 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1321400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 0x7f131c19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1321400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 0x7f131c19a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52746/0 (socket says 172.21.15.40:52746) 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1321400640 1 -- 172.21.15.40:0/1001544740 learned_addr learned my addr 172.21.15.40:0/1001544740 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1320a00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f131c104f60 0x7f131c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.662+0000 7f1321e00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f131c105920 0x7f131c1a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f1321400640 1 -- 172.21.15.40:0/1001544740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f131c105920 msgr2=0x7f131c1a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f1321400640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f131c105920 0x7f131c1a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f1321400640 1 -- 172.21.15.40:0/1001544740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f131c104f60 msgr2=0x7f131c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f1321400640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f131c104f60 0x7f131c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f1321400640 1 -- 172.21.15.40:0/1001544740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c1a1cd0 con 0x7f131c103e00 2024-09-11T22:30:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f1320a00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f131c104f60 0x7f131c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f1321400640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 0x7f131c19a0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1310031440 tx=0x7f1310032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f131a000640 1 -- 172.21.15.40:0/1001544740 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131003f030 con 0x7f131c103e00 2024-09-11T22:30:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f131a000640 1 -- 172.21.15.40:0/1001544740 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1310003ce0 con 0x7f131c103e00 2024-09-11T22:30:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131c1a1f60 con 0x7f131c103e00 2024-09-11T22:30:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.663+0000 7f131a000640 1 -- 172.21.15.40:0/1001544740 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310035070 con 0x7f131c103e00 2024-09-11T22:30:44.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.664+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131c1a23b0 con 0x7f131c103e00 2024-09-11T22:30:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.665+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c10b1a0 con 0x7f131c103e00 2024-09-11T22:30:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.666+0000 7f131a000640 1 -- 172.21.15.40:0/1001544740 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1310042030 con 0x7f131c103e00 2024-09-11T22:30:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.668+0000 7f131a000640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f13040a2cc0 0x7f13040a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.669+0000 7f131a000640 1 -- 172.21.15.40:0/1001544740 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f13100efa70 con 0x7f131c103e00 2024-09-11T22:30:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.669+0000 7f1320a00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f13040a2cc0 0x7f13040a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:44.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.669+0000 7f1320a00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f13040a2cc0 0x7f13040a5180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f131c19b5c0 tx=0x7f130800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:44.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.673+0000 7f131a000640 1 -- 172.21.15.40:0/1001544740 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13100bbe30 con 0x7f131c103e00 2024-09-11T22:30:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.893+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f131c02da30 con 0x7f131c103e00 2024-09-11T22:30:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.894+0000 7f131a000640 1 -- 172.21.15.40:0/1001544740 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3096 (secure 0 0 0) 0x7f13100c0130 con 0x7f131c103e00 2024-09-11T22:30:44.895 INFO:teuthology.orchestra.run.smithi040.stdout:e25 2024-09-11T22:30:44.895 INFO:teuthology.orchestra.run.smithi040.stdout:btime 2024-09-11T22:29:17:363470+0000 2024-09-11T22:30:44.895 INFO:teuthology.orchestra.run.smithi040.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:legacy client fscid: 1 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:Filesystem 'cephfs' (1) 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:fs_name cephfs 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 25 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-09-11T22:28:22.255886+0000 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:modified 2024-09-11T22:29:16.869039+0000 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:tableserver 0 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:root 0 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:session_timeout 300 2024-09-11T22:30:44.896 INFO:teuthology.orchestra.run.smithi040.stdout:session_autoclose 300 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:max_file_size 1099511627776 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:max_xattr_size 65536 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:required_client_features {} 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:last_failure 0 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:last_failure_osd_epoch 0 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:max_mds 3 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:in 0,1,2 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:up {0=24527,1=24517,2=24499} 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:failed 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:damaged 2024-09-11T22:30:44.897 INFO:teuthology.orchestra.run.smithi040.stdout:stopped 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:data_pools [3,4] 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:metadata_pool 2 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:inline_data disabled 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:balancer 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:bal_rank_mask -1 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:standby_count_wanted 0 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:qdb_cluster leader: 24527 members: 24499,24517,24527 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b{0:24527} state up:active seq 5 addr [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.f{0:24493} state up:standby-replay seq 1 addr [v2:172.21.15.177:6834/2874658115,v1:172.21.15.177:6835/2874658115] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.i{1:24517} state up:active seq 20 addr [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.h{1:24488} state up:standby-replay seq 1 addr [v2:172.21.15.146:6836/321001142,v1:172.21.15.146:6837/321001142] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c{2:24499} state up:active seq 22 addr [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.898 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.e{2:24464} state up:standby-replay seq 1 addr [v2:172.21.15.146:6834/2793379680,v1:172.21.15.146:6835/2793379680] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout:Standby daemons: 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.j{-1:14445} state up:standby seq 1 addr [v2:172.21.15.40:6834/756098246,v1:172.21.15.40:6835/756098246] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d{-1:14457} state up:standby seq 1 addr [v2:172.21.15.40:6836/2129624525,v1:172.21.15.40:6837/2129624525] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.g{-1:14499} state up:standby seq 1 addr [v2:172.21.15.40:6838/3846797192,v1:172.21.15.40:6839/3846797192] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a{-1:14511} state up:standby seq 1 addr [v2:172.21.15.40:6840/3832269180,v1:172.21.15.40:6841/3832269180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.k{-1:24428} state up:standby seq 1 addr [v2:172.21.15.146:6832/3511870643,v1:172.21.15.146:6833/3511870643] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.899 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.l{-1:24445} state up:standby seq 1 addr [v2:172.21.15.177:6832/2871952691,v1:172.21.15.177:6833/2871952691] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T22:30:44.900 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 25 2024-09-11T22:30:44.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f13040a2cc0 msgr2=0x7f13040a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f13040a2cc0 0x7f13040a5180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f131c19b5c0 tx=0x7f130800b410 comp rx=0 tx=0).stop 2024-09-11T22:30:44.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 msgr2=0x7f131c19a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:44.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 0x7f131c19a0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1310031440 tx=0x7f1310032e20 comp rx=0 tx=0).stop 2024-09-11T22:30:44.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 shutdown_connections 2024-09-11T22:30:44.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f13040a2cc0 0x7f13040a5180 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f131c105920 0x7f131c1a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f131c104f60 0x7f131c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 --2- 172.21.15.40:0/1001544740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131c103e00 0x7f131c19a0a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 >> 172.21.15.40:0/1001544740 conn(0x7f131c0ff5b0 msgr2=0x7f131c108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 shutdown_connections 2024-09-11T22:30:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:44.898+0000 7f1323e00640 1 -- 172.21.15.40:0/1001544740 wait complete. 2024-09-11T22:30:45.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:44 smithi040 ceph-mon[30787]: pgmap v378: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:44 smithi177 ceph-mon[35530]: pgmap v378: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:45.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:44 smithi146 ceph-mon[34996]: pgmap v378: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:45.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T22:30:45.998 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:46.168 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:45 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1001544740' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T22:30:46.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:45 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1001544740' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T22:30:46.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:45 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1001544740' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T22:30:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.576+0000 7f60f6800640 1 -- 172.21.15.40:0/2233683770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0104f60 msgr2=0x7f60f01053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.576+0000 7f60f6800640 1 --2- 172.21.15.40:0/2233683770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0104f60 0x7f60f01053e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009900 tx=0x7f60dc02a400 comp rx=0 tx=0).stop 2024-09-11T22:30:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.576+0000 7f60f6800640 1 -- 172.21.15.40:0/2233683770 shutdown_connections 2024-09-11T22:30:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.576+0000 7f60f6800640 1 --2- 172.21.15.40:0/2233683770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f0105920 0x7f60f010c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.576+0000 7f60f6800640 1 --2- 172.21.15.40:0/2233683770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0104f60 0x7f60f01053e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.576+0000 7f60f6800640 1 --2- 172.21.15.40:0/2233683770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f0103e00 0x7f60f0104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.576+0000 7f60f6800640 1 -- 172.21.15.40:0/2233683770 >> 172.21.15.40:0/2233683770 conn(0x7f60f00ff5b0 msgr2=0x7f60f01019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:46.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.576+0000 7f60f6800640 1 -- 172.21.15.40:0/2233683770 shutdown_connections 2024-09-11T22:30:46.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.576+0000 7f60f6800640 1 -- 172.21.15.40:0/2233683770 wait complete. 2024-09-11T22:30:46.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.577+0000 7f60f6800640 1 Processor -- start 2024-09-11T22:30:46.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.577+0000 7f60f6800640 1 -- start start 2024-09-11T22:30:46.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60f6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0103e00 0x7f60f019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60f6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f0104f60 0x7f60f019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60f6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f0105920 0x7f60f01a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60f6800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f60f010fab0 con 0x7f60f0103e00 2024-09-11T22:30:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60f6800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f60f010f930 con 0x7f60f0105920 2024-09-11T22:30:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60f6800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f60f010fc30 con 0x7f60f0104f60 2024-09-11T22:30:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0103e00 0x7f60f019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60eea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f0104f60 0x7f60f019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60ef400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0103e00 0x7f60f019a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52762/0 (socket says 172.21.15.40:52762) 2024-09-11T22:30:46.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60ef400640 1 -- 172.21.15.40:0/3056791027 learned_addr learned my addr 172.21.15.40:0/3056791027 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60efe00640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f0105920 0x7f60f01a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60ef400640 1 -- 172.21.15.40:0/3056791027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f0104f60 msgr2=0x7f60f019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60ef400640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f0104f60 0x7f60f019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60ef400640 1 -- 172.21.15.40:0/3056791027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f0105920 msgr2=0x7f60f01a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60ef400640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f0105920 0x7f60f01a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60ef400640 1 -- 172.21.15.40:0/3056791027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f01a1d30 con 0x7f60f0103e00 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60eea00640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f0104f60 0x7f60f019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.578+0000 7f60efe00640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f0105920 0x7f60f01a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.579+0000 7f60ef400640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0103e00 0x7f60f019a100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e9f0 tx=0x7f60e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.579+0000 7f60e7e00640 1 -- 172.21.15.40:0/3056791027 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e000cd80 con 0x7f60f0103e00 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.579+0000 7f60e7e00640 1 -- 172.21.15.40:0/3056791027 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60e0010910 con 0x7f60f0103e00 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.579+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f01a1fc0 con 0x7f60f0103e00 2024-09-11T22:30:46.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.579+0000 7f60e7e00640 1 -- 172.21.15.40:0/3056791027 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0018990 con 0x7f60f0103e00 2024-09-11T22:30:46.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.579+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f01a2470 con 0x7f60f0103e00 2024-09-11T22:30:46.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.580+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f010b1c0 con 0x7f60f0103e00 2024-09-11T22:30:46.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.582+0000 7f60e7e00640 1 -- 172.21.15.40:0/3056791027 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f60e0010ac0 con 0x7f60f0103e00 2024-09-11T22:30:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.583+0000 7f60e7e00640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f60d40a2c40 0x7f60d40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.584+0000 7f60e7e00640 1 -- 172.21.15.40:0/3056791027 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f60e00cfc80 con 0x7f60f0103e00 2024-09-11T22:30:46.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.584+0000 7f60eea00640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f60d40a2c40 0x7f60d40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:46.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.585+0000 7f60eea00640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f60d40a2c40 0x7f60d40a5100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f60dc005ab0 tx=0x7f60dc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:46.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.586+0000 7f60e7e00640 1 -- 172.21.15.40:0/3056791027 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60e009c040 con 0x7f60f0103e00 2024-09-11T22:30:46.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.777+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f60f0062e20 con 0x7f60f0103e00 2024-09-11T22:30:46.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.778+0000 7f60e7e00640 1 -- 172.21.15.40:0/3056791027 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v95) ==== 56+0+5642 (secure 0 0 0) 0x7f60e00a0340 con 0x7f60f0103e00 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 95 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:fsid c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-09-11T22:20:05.625066+0000 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:modified 2024-09-11T22:29:59.079781+0000 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:crush_version 27 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:full_ratio 0.95 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:backfillfull_ratio 0.9 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:nearfull_ratio 0.85 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:require_min_compat_client luminous 2024-09-11T22:30:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:min_compat_client luminous 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:require_osd_release squid 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:stretch_mode_enabled false 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 91 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:max_osd 12 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.40:6802/3907265678,v1:172.21.15.40:6803/3907265678] [v2:172.21.15.40:6804/3907265678,v1:172.21.15.40:6805/3907265678] exists,up 82d9fecb-4353-4e63-991f-ef618ea5ae21 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 up in weight 1 up_from 13 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6800/2916155681,v1:172.21.15.146:6801/2916155681] [v2:172.21.15.146:6802/2916155681,v1:172.21.15.146:6803/2916155681] exists,up 7b36cbf5-f4e4-462a-bbb9-81d2853f01bc 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6800/3950599839,v1:172.21.15.177:6801/3950599839] [v2:172.21.15.177:6802/3950599839,v1:172.21.15.177:6803/3950599839] exists,up 58cf9867-bceb-454d-9fce-95755e4ab2fb 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 up in weight 1 up_from 25 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.40:6810/3405850528,v1:172.21.15.40:6811/3405850528] [v2:172.21.15.40:6812/3405850528,v1:172.21.15.40:6813/3405850528] exists,up 194a6e6d-dc39-44b3-9e96-2b0420de5f53 2024-09-11T22:30:46.780 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 up in weight 1 up_from 32 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6808/1955239185,v1:172.21.15.146:6809/1955239185] [v2:172.21.15.146:6810/1955239185,v1:172.21.15.146:6811/1955239185] exists,up 6b8f7992-9ad7-4a0c-82eb-5e56257c79d2 2024-09-11T22:30:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 up in weight 1 up_from 37 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6808/4157148249,v1:172.21.15.177:6809/4157148249] [v2:172.21.15.177:6810/4157148249,v1:172.21.15.177:6811/4157148249] exists,up 30dda4ee-fb76-4fc6-accf-c8e15cef504b 2024-09-11T22:30:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 up in weight 1 up_from 45 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.40:6818/3328210363,v1:172.21.15.40:6819/3328210363] [v2:172.21.15.40:6820/3328210363,v1:172.21.15.40:6821/3328210363] exists,up e2f90ba7-c6f0-4dab-be23-4ee01254e8e7 2024-09-11T22:30:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 up in weight 1 up_from 50 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6816/3017121713,v1:172.21.15.146:6817/3017121713] [v2:172.21.15.146:6818/3017121713,v1:172.21.15.146:6819/3017121713] exists,up aa3c1448-5e50-42c5-8ec9-d4415f3612e5 2024-09-11T22:30:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:osd.8 up in weight 1 up_from 57 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6816/323204474,v1:172.21.15.177:6817/323204474] [v2:172.21.15.177:6818/323204474,v1:172.21.15.177:6819/323204474] exists,up d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5 2024-09-11T22:30:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:osd.9 up in weight 1 up_from 65 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.40:6826/4209555544,v1:172.21.15.40:6827/4209555544] [v2:172.21.15.40:6828/4209555544,v1:172.21.15.40:6829/4209555544] exists,up afd5d9ce-baf0-4331-b5f2-5803295060c4 2024-09-11T22:30:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:osd.10 up in weight 1 up_from 70 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.146:6824/3331275182,v1:172.21.15.146:6825/3331275182] [v2:172.21.15.146:6826/3331275182,v1:172.21.15.146:6827/3331275182] exists,up 7de50dd1-146c-445f-8825-345170538fe1 2024-09-11T22:30:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:osd.11 up in weight 1 up_from 77 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.177:6824/153711058,v1:172.21.15.177:6825/153711058] [v2:172.21.15.177:6826/153711058,v1:172.21.15.177:6827/153711058] exists,up bd819162-017f-4323-b587-1ed164135d62 2024-09-11T22:30:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 2.b [8,11,2,1] 2024-09-11T22:30:46.781 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 2.e [2,4] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 2.1c [8,11] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 3.3 [4,9] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 3.11 [4,6,5,9] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 3.1e [3,9] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 3.27 [4,8] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 4.a [5,8] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 4.12 [9,10] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 4.17 [9,8] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:pg_upmap_items 4.1f [9,8] 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/3768094180 expires 2024-09-12T22:20:56.889250+0000 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/2421714119 expires 2024-09-12T22:20:56.889250+0000 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/3054635908 expires 2024-09-12T22:20:56.889250+0000 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:6801/2835470410 expires 2024-09-12T22:20:56.889250+0000 2024-09-11T22:30:46.782 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/2148182783 expires 2024-09-12T22:20:29.708392+0000 2024-09-11T22:30:46.783 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/3034121439 expires 2024-09-12T22:20:29.708392+0000 2024-09-11T22:30:46.783 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:6801/2370914626 expires 2024-09-12T22:20:29.708392+0000 2024-09-11T22:30:46.783 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:6800/2370914626 expires 2024-09-12T22:20:29.708392+0000 2024-09-11T22:30:46.783 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:6800/2835470410 expires 2024-09-12T22:20:56.889250+0000 2024-09-11T22:30:46.783 INFO:teuthology.orchestra.run.smithi040.stdout:blocklist 172.21.15.40:0/2543187724 expires 2024-09-12T22:20:29.708392+0000 2024-09-11T22:30:46.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f60d40a2c40 msgr2=0x7f60d40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f60d40a2c40 0x7f60d40a5100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f60dc005ab0 tx=0x7f60dc000bc0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0103e00 msgr2=0x7f60f019a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0103e00 0x7f60f019a100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e9f0 tx=0x7f60e000eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 shutdown_connections 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f60d40a2c40 0x7f60d40a5100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f0105920 0x7f60f01a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f0104f60 0x7f60f019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 --2- 172.21.15.40:0/3056791027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f0103e00 0x7f60f019a100 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 >> 172.21.15.40:0/3056791027 conn(0x7f60f00ff5b0 msgr2=0x7f60f0108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 shutdown_connections 2024-09-11T22:30:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:46.780+0000 7f60f6800640 1 -- 172.21.15.40:0/3056791027 wait complete. 2024-09-11T22:30:47.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:46 smithi040 ceph-mon[30787]: pgmap v379: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:47.134 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:46 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3056791027' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T22:30:47.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:46 smithi177 ceph-mon[35530]: pgmap v379: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:47.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:46 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3056791027' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T22:30:47.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:46 smithi146 ceph-mon[34996]: pgmap v379: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:47.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:46 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3056791027' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T22:30:47.551 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T22:30:47.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:30:47.945 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.501+0000 7ff7bfc00640 1 -- 172.21.15.40:0/1893531969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b80ffe80 msgr2=0x7ff7b8100260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.501+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/1893531969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b80ffe80 0x7ff7b8100260 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009930 tx=0x7ff7ac02a4d0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.501+0000 7ff7bfc00640 1 -- 172.21.15.40:0/1893531969 shutdown_connections 2024-09-11T22:30:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.501+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/1893531969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7b810a350 0x7ff7b8110d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.501+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/1893531969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b81007a0 0x7ff7b8109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.501+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/1893531969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b80ffe80 0x7ff7b8100260 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.501+0000 7ff7bfc00640 1 -- 172.21.15.40:0/1893531969 >> 172.21.15.40:0/1893531969 conn(0x7ff7b80fba90 msgr2=0x7ff7b80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.501+0000 7ff7bfc00640 1 -- 172.21.15.40:0/1893531969 shutdown_connections 2024-09-11T22:30:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.501+0000 7ff7bfc00640 1 -- 172.21.15.40:0/1893531969 wait complete. 2024-09-11T22:30:48.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.502+0000 7ff7bfc00640 1 Processor -- start 2024-09-11T22:30:48.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.502+0000 7ff7bfc00640 1 -- start start 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.502+0000 7ff7bfc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b80ffe80 0x7ff7b819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.502+0000 7ff7bfc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b81007a0 0x7ff7b819acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.502+0000 7ff7bfc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7b810a350 0x7ff7b819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.502+0000 7ff7bfc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81141b0 con 0x7ff7b80ffe80 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.502+0000 7ff7bfc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8114030 con 0x7ff7b81007a0 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.502+0000 7ff7bfc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8114330 con 0x7ff7b810a350 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7b7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b81007a0 0x7ff7b819acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7bd200640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b80ffe80 0x7ff7b819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7b7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b81007a0 0x7ff7b819acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:41536/0 (socket says 172.21.15.40:41536) 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7b7e00640 1 -- 172.21.15.40:0/24975297 learned_addr learned my addr 172.21.15.40:0/24975297 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7bdc00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7b810a350 0x7ff7b819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7bd200640 1 -- 172.21.15.40:0/24975297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7b810a350 msgr2=0x7ff7b819dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7bd200640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7b810a350 0x7ff7b819dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7bd200640 1 -- 172.21.15.40:0/24975297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b81007a0 msgr2=0x7ff7b819acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7bd200640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b81007a0 0x7ff7b819acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7bd200640 1 -- 172.21.15.40:0/24975297 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b819e6d0 con 0x7ff7b80ffe80 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.503+0000 7ff7b7e00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b81007a0 0x7ff7b819acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.504+0000 7ff7bd200640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b80ffe80 0x7ff7b819a780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac02a9f0 tx=0x7ff7ac003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.504+0000 7ff7b5600640 1 -- 172.21.15.40:0/24975297 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac03f070 con 0x7ff7b80ffe80 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.504+0000 7ff7b5600640 1 -- 172.21.15.40:0/24975297 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7ac031c90 con 0x7ff7b80ffe80 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.504+0000 7ff7b5600640 1 -- 172.21.15.40:0/24975297 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac035030 con 0x7ff7b80ffe80 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.504+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b819e960 con 0x7ff7b80ffe80 2024-09-11T22:30:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.504+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b81a7330 con 0x7ff7b80ffe80 2024-09-11T22:30:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.505+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b8100260 con 0x7ff7b80ffe80 2024-09-11T22:30:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.507+0000 7ff7b5600640 1 -- 172.21.15.40:0/24975297 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff7ac042070 con 0x7ff7b80ffe80 2024-09-11T22:30:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.509+0000 7ff7b5600640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff7a00a2c10 0x7ff7a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.510+0000 7ff7b5600640 1 -- 172.21.15.40:0/24975297 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7ff7ac0f00d0 con 0x7ff7b80ffe80 2024-09-11T22:30:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.510+0000 7ff7b7e00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff7a00a2c10 0x7ff7a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.510+0000 7ff7b7e00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff7a00a2c10 0x7ff7a00a50d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80fdf80 tx=0x7ff7a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.512+0000 7ff7b5600640 1 -- 172.21.15.40:0/24975297 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7ac0bc490 con 0x7ff7b80ffe80 2024-09-11T22:30:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.732+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7b819bae0 con 0x7ff7b80ffe80 2024-09-11T22:30:48.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.733+0000 7ff7b5600640 1 -- 172.21.15.40:0/24975297 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7ff7ac0c0790 con 0x7ff7b80ffe80 2024-09-11T22:30:48.734 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:48.734 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"btime":"2024-09-11T22:29:17:363470+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:29:16.869039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24517,"mds_2":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24499,24517,24527]},"id":1}]} 2024-09-11T22:30:48.734 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 25 2024-09-11T22:30:48.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.735+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff7a00a2c10 msgr2=0x7ff7a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:48.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.735+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff7a00a2c10 0x7ff7a00a50d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80fdf80 tx=0x7ff7a4005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:48.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.735+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b80ffe80 msgr2=0x7ff7b819a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:48.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.735+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b80ffe80 0x7ff7b819a780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac02a9f0 tx=0x7ff7ac003b90 comp rx=0 tx=0).stop 2024-09-11T22:30:48.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.735+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 shutdown_connections 2024-09-11T22:30:48.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.736+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff7a00a2c10 0x7ff7a00a50d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.736+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7b810a350 0x7ff7b819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.736+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b81007a0 0x7ff7b819acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.736+0000 7ff7bfc00640 1 --2- 172.21.15.40:0/24975297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b80ffe80 0x7ff7b819a780 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.736+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 >> 172.21.15.40:0/24975297 conn(0x7ff7b80fba90 msgr2=0x7ff7b8107e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.736+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 shutdown_connections 2024-09-11T22:30:48.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:48.736+0000 7ff7bfc00640 1 -- 172.21.15.40:0/24975297 wait complete. 2024-09-11T22:30:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:48 smithi040 ceph-mon[30787]: pgmap v380: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:48.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:48 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/24975297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:49.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:48 smithi177 ceph-mon[35530]: pgmap v380: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:49.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:48 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/24975297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:49.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:48 smithi146 ceph-mon[34996]: pgmap v380: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:49.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:48 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/24975297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:49.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:30:49.871 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:50.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.458+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2370716522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f0103ff0 msgr2=0x7fd6f01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:50.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.458+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2370716522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f0103ff0 0x7fd6f01043d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009900 tx=0x7fd6e002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.458+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2370716522 shutdown_connections 2024-09-11T22:30:50.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.458+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2370716522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f0109120 0x7fd6f0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.458+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2370716522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f01049a0 0x7fd6f01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.458+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2370716522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f0103ff0 0x7fd6f01043d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.458+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2370716522 >> 172.21.15.40:0/2370716522 conn(0x7fd6f00ffa90 msgr2=0x7fd6f0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:50.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.458+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2370716522 shutdown_connections 2024-09-11T22:30:50.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.458+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2370716522 wait complete. 2024-09-11T22:30:50.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.459+0000 7fd6f5e00640 1 Processor -- start 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.459+0000 7fd6f5e00640 1 -- start start 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6f5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f0103ff0 0x7fd6f019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6f5e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f01049a0 0x7fd6f019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6f5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f0109120 0x7fd6f019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6f5e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0114190 con 0x7fd6f01049a0 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6f5e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0114010 con 0x7fd6f0103ff0 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6f5e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0114310 con 0x7fd6f0109120 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6eea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f0103ff0 0x7fd6f019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6eea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f0103ff0 0x7fd6f019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:41544/0 (socket says 172.21.15.40:41544) 2024-09-11T22:30:50.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6eea00640 1 -- 172.21.15.40:0/2372580199 learned_addr learned my addr 172.21.15.40:0/2372580199 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6e7e00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f01049a0 0x7fd6f019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.460+0000 7fd6ef400640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f0109120 0x7fd6f019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6eea00640 1 -- 172.21.15.40:0/2372580199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f0109120 msgr2=0x7fd6f019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6eea00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f0109120 0x7fd6f019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6eea00640 1 -- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f01049a0 msgr2=0x7fd6f019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6eea00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f01049a0 0x7fd6f019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6eea00640 1 -- 172.21.15.40:0/2372580199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f019f640 con 0x7fd6f0103ff0 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6ef400640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f0109120 0x7fd6f019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6eea00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f0103ff0 0x7fd6f019a690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0004770 tx=0x7fd6e0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6f4a00640 1 -- 172.21.15.40:0/2372580199 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e003f070 con 0x7fd6f0103ff0 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6f4a00640 1 -- 172.21.15.40:0/2372580199 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6e0031ca0 con 0x7fd6f0103ff0 2024-09-11T22:30:50.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f019f8d0 con 0x7fd6f0103ff0 2024-09-11T22:30:50.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6f4a00640 1 -- 172.21.15.40:0/2372580199 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0035030 con 0x7fd6f0103ff0 2024-09-11T22:30:50.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.461+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f01a7210 con 0x7fd6f0103ff0 2024-09-11T22:30:50.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.462+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f01054d0 con 0x7fd6f0103ff0 2024-09-11T22:30:50.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.464+0000 7fd6f4a00640 1 -- 172.21.15.40:0/2372580199 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd6e0042070 con 0x7fd6f0103ff0 2024-09-11T22:30:50.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.465+0000 7fd6f4a00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd6d40a2c10 0x7fd6d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:50.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.466+0000 7fd6f4a00640 1 -- 172.21.15.40:0/2372580199 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fd6e00efc50 con 0x7fd6f0103ff0 2024-09-11T22:30:50.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.466+0000 7fd6e7e00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd6d40a2c10 0x7fd6d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:50.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.466+0000 7fd6e7e00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd6d40a2c10 0x7fd6d40a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00fffb0 tx=0x7fd6d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:50.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.469+0000 7fd6f4a00640 1 -- 172.21.15.40:0/2372580199 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6e00bc720 con 0x7fd6f0103ff0 2024-09-11T22:30:50.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.689+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6f010c300 con 0x7fd6f0103ff0 2024-09-11T22:30:50.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.690+0000 7fd6f4a00640 1 -- 172.21.15.40:0/2372580199 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11924 (secure 0 0 0) 0x7fd6e00bc020 con 0x7fd6f0103ff0 2024-09-11T22:30:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:50.691 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 25 2024-09-11T22:30:50.691 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"btime":"2024-09-11T22:29:17:363470+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:29:16.869039+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24517,"mds_2":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24499,24517,24527]},"id":1}]} 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd6d40a2c10 msgr2=0x7fd6d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd6d40a2c10 0x7fd6d40a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00fffb0 tx=0x7fd6d8005f90 comp rx=0 tx=0).stop 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f0103ff0 msgr2=0x7fd6f019a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f0103ff0 0x7fd6f019a690 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0004770 tx=0x7fd6e0003c10 comp rx=0 tx=0).stop 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 shutdown_connections 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fd6d40a2c10 0x7fd6d40a50d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f0109120 0x7fd6f019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f01049a0 0x7fd6f019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 --2- 172.21.15.40:0/2372580199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6f0103ff0 0x7fd6f019a690 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:50.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 >> 172.21.15.40:0/2372580199 conn(0x7fd6f00ffa90 msgr2=0x7fd6f0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:50.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 shutdown_connections 2024-09-11T22:30:50.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:50.692+0000 7fd6f5e00640 1 -- 172.21.15.40:0/2372580199 wait complete. 2024-09-11T22:30:50.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:50 smithi040 ceph-mon[30787]: pgmap v381: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:50.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:50 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2372580199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:50 smithi177 ceph-mon[35530]: pgmap v381: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:50 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2372580199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:51.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:50 smithi146 ceph-mon[34996]: pgmap v381: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:30:51.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:50 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2372580199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:30:51.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:30:51.865 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.433+0000 7f263ec00640 1 -- 172.21.15.40:0/1628254864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2638074f40 msgr2=0x7f263810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.433+0000 7f263ec00640 1 --2- 172.21.15.40:0/1628254864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2638074f40 0x7f263810de80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2620009860 tx=0x7f262002a3d0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.433+0000 7f263ec00640 1 -- 172.21.15.40:0/1628254864 shutdown_connections 2024-09-11T22:30:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.433+0000 7f263ec00640 1 --2- 172.21.15.40:0/1628254864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f263810e3c0 0x7f2638110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.433+0000 7f263ec00640 1 --2- 172.21.15.40:0/1628254864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2638074f40 0x7f263810de80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.433+0000 7f263ec00640 1 --2- 172.21.15.40:0/1628254864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2638074620 0x7f2638074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.433+0000 7f263ec00640 1 -- 172.21.15.40:0/1628254864 >> 172.21.15.40:0/1628254864 conn(0x7f26380fd8c0 msgr2=0x7f26380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.433+0000 7f263ec00640 1 -- 172.21.15.40:0/1628254864 shutdown_connections 2024-09-11T22:30:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.433+0000 7f263ec00640 1 -- 172.21.15.40:0/1628254864 wait complete. 2024-09-11T22:30:52.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.434+0000 7f263ec00640 1 Processor -- start 2024-09-11T22:30:52.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.434+0000 7f263ec00640 1 -- start start 2024-09-11T22:30:52.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.434+0000 7f263ec00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2638074620 0x7f263819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:52.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.434+0000 7f263ec00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2638074f40 0x7f263819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.434+0000 7f263ec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f263810e3c0 0x7f263819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.434+0000 7f263ec00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2638114160 con 0x7f2638074620 2024-09-11T22:30:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.434+0000 7f263ec00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2638113fe0 con 0x7f2638074f40 2024-09-11T22:30:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.434+0000 7f263ec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f26381142e0 con 0x7f263810e3c0 2024-09-11T22:30:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f2637e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2638074620 0x7f263819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f2637e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2638074620 0x7f263819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54674/0 (socket says 172.21.15.40:54674) 2024-09-11T22:30:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f2637e00640 1 -- 172.21.15.40:0/3424631003 learned_addr learned my addr 172.21.15.40:0/3424631003 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f262fe00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2638074f40 0x7f263819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f263cc00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f263810e3c0 0x7f263819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f2637e00640 1 -- 172.21.15.40:0/3424631003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f263810e3c0 msgr2=0x7f263819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:52.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f2637e00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f263810e3c0 0x7f263819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f2637e00640 1 -- 172.21.15.40:0/3424631003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2638074f40 msgr2=0x7f263819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f2637e00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2638074f40 0x7f263819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.435+0000 7f2637e00640 1 -- 172.21.15.40:0/3424631003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263819f660 con 0x7f2638074620 2024-09-11T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.436+0000 7f2637e00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2638074620 0x7f263819a6b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f262800e9f0 tx=0x7f262800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.436+0000 7f2635600640 1 -- 172.21.15.40:0/3424631003 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262800cd80 con 0x7f2638074620 2024-09-11T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.436+0000 7f2635600640 1 -- 172.21.15.40:0/3424631003 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2628005500 con 0x7f2638074620 2024-09-11T22:30:52.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.436+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263819f950 con 0x7f2638074620 2024-09-11T22:30:52.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.436+0000 7f2635600640 1 -- 172.21.15.40:0/3424631003 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628010690 con 0x7f2638074620 2024-09-11T22:30:52.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.436+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26381a7230 con 0x7f2638074620 2024-09-11T22:30:52.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.437+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2638074a00 con 0x7f2638074620 2024-09-11T22:30:52.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.439+0000 7f2635600640 1 -- 172.21.15.40:0/3424631003 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f26280046c0 con 0x7f2638074620 2024-09-11T22:30:52.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.440+0000 7f2635600640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f261c0a2c90 0x7f261c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:52.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.441+0000 7f2635600640 1 -- 172.21.15.40:0/3424631003 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f26280cf990 con 0x7f2638074620 2024-09-11T22:30:52.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.441+0000 7f262fe00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f261c0a2c90 0x7f261c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:52.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.441+0000 7f262fe00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f261c0a2c90 0x7f261c0a5150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f263810f8b0 tx=0x7f26200094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:52.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.445+0000 7f2635600640 1 -- 172.21.15.40:0/3424631003 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f262809c3a0 con 0x7f2638074620 2024-09-11T22:30:52.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.632+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26381095a0 con 0x7f2638074620 2024-09-11T22:30:52.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.634+0000 7f2635600640 1 -- 172.21.15.40:0/3424631003 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24848 (secure 0 0 0) 0x7f262809bca0 con 0x7f2638074620 2024-09-11T22:30:52.635 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:30:52.635 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":95,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:29:59.079781+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:30:52.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.636+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f261c0a2c90 msgr2=0x7f261c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:52.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.636+0000 7f263ec00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f261c0a2c90 0x7f261c0a5150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f263810f8b0 tx=0x7f26200094d0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.636+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2638074620 msgr2=0x7f263819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:52.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.636+0000 7f263ec00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2638074620 0x7f263819a6b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f262800e9f0 tx=0x7f262800edf0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.637+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 shutdown_connections 2024-09-11T22:30:52.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.637+0000 7f263ec00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f261c0a2c90 0x7f261c0a5150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.637+0000 7f263ec00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f263810e3c0 0x7f263819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.637+0000 7f263ec00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2638074f40 0x7f263819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.637+0000 7f263ec00640 1 --2- 172.21.15.40:0/3424631003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2638074620 0x7f263819a6b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:52.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.637+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 >> 172.21.15.40:0/3424631003 conn(0x7f26380fd8c0 msgr2=0x7f26380fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:52.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.637+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 shutdown_connections 2024-09-11T22:30:52.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:52.637+0000 7f263ec00640 1 -- 172.21.15.40:0/3424631003 wait complete. 2024-09-11T22:30:53.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:52 smithi040 ceph-mon[30787]: pgmap v382: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:53.182 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:52 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3424631003' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:30:53.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:52 smithi177 ceph-mon[35530]: pgmap v382: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:53.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:52 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3424631003' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:30:53.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:52 smithi146 ceph-mon[34996]: pgmap v382: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:53.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:52 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3424631003' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:30:53.389 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T22:28:22.255886+0000', 'modified': '2024-09-11T22:29:16.869039+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24527, 'mds_1': 24517, 'mds_2': 24499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24464': {'gid': 24464, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/2793379680', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2793379680}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2793379680}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6837/321001142', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 321001142}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 321001142}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.177:6835/2874658115', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 2874658115}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 2874658115}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.177:6837/1976954611', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6836', 'nonce': 1976954611}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 1976954611}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.177:6839/2764150178', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6838', 'nonce': 2764150178}, {'type': 'v1', 'addr': '172.21.15.177:6839', 'nonce': 2764150178}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.146:6839/2365077357', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6838', 'nonce': 2365077357}, {'type': 'v1', 'addr': '172.21.15.146:6839', 'nonce': 2365077357}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24527, 'qdb_cluster': [24499, 24517, 24527]} 2024-09-11T22:30:53.389 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T22:30:53.389 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T22:30:53.767 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:54.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.358+0000 7f258ee00640 1 -- 172.21.15.40:0/2959552755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2588103ff0 msgr2=0x7f25881043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.358+0000 7f258ee00640 1 --2- 172.21.15.40:0/2959552755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2588103ff0 0x7f25881043d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2578009860 tx=0x7f257802a340 comp rx=0 tx=0).stop 2024-09-11T22:30:54.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.358+0000 7f258ee00640 1 -- 172.21.15.40:0/2959552755 shutdown_connections 2024-09-11T22:30:54.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.358+0000 7f258ee00640 1 --2- 172.21.15.40:0/2959552755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2588109120 0x7f2588110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.358+0000 7f258ee00640 1 --2- 172.21.15.40:0/2959552755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25881049a0 0x7f25881089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.358+0000 7f258ee00640 1 --2- 172.21.15.40:0/2959552755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2588103ff0 0x7f25881043d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.358+0000 7f258ee00640 1 -- 172.21.15.40:0/2959552755 >> 172.21.15.40:0/2959552755 conn(0x7f25880ffa90 msgr2=0x7f2588101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:54.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.358+0000 7f258ee00640 1 -- 172.21.15.40:0/2959552755 shutdown_connections 2024-09-11T22:30:54.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.359+0000 7f258ee00640 1 -- 172.21.15.40:0/2959552755 wait complete. 2024-09-11T22:30:54.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.359+0000 7f258ee00640 1 Processor -- start 2024-09-11T22:30:54.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f258ee00640 1 -- start start 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f258ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2588103ff0 0x7f258819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f258ee00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25881049a0 0x7f258819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f258ee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2588109120 0x7f258819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f258ee00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2588114140 con 0x7f25881049a0 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f258ee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2588113fc0 con 0x7f2588109120 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f258ee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f25881142c0 con 0x7f2588103ff0 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f2587400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25881049a0 0x7f258819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f2587e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2588103ff0 0x7f258819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f2587e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2588103ff0 0x7f258819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:41846/0 (socket says 172.21.15.40:41846) 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.360+0000 7f2587e00640 1 -- 172.21.15.40:0/3041907857 learned_addr learned my addr 172.21.15.40:0/3041907857 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.361+0000 7f258ce00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2588109120 0x7f258819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.361+0000 7f2587400640 1 -- 172.21.15.40:0/3041907857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2588103ff0 msgr2=0x7f258819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.361+0000 7f2587400640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2588103ff0 0x7f258819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.361+0000 7f2587400640 1 -- 172.21.15.40:0/3041907857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2588109120 msgr2=0x7f258819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.361+0000 7f2587400640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2588109120 0x7f258819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.361+0000 7f2587400640 1 -- 172.21.15.40:0/3041907857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258819f5d0 con 0x7f25881049a0 2024-09-11T22:30:54.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.361+0000 7f258ce00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2588109120 0x7f258819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:54.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.361+0000 7f2587400640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25881049a0 0x7f258819ab60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f257400e9f0 tx=0x7f257400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:54.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.362+0000 7f2584c00640 1 -- 172.21.15.40:0/3041907857 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257400ccc0 con 0x7f25881049a0 2024-09-11T22:30:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.362+0000 7f2584c00640 1 -- 172.21.15.40:0/3041907857 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2574005020 con 0x7f25881049a0 2024-09-11T22:30:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.362+0000 7f2584c00640 1 -- 172.21.15.40:0/3041907857 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25740049e0 con 0x7f25881049a0 2024-09-11T22:30:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.362+0000 7f258ee00640 1 -- 172.21.15.40:0/3041907857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258819f8c0 con 0x7f25881049a0 2024-09-11T22:30:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.362+0000 7f258ee00640 1 -- 172.21.15.40:0/3041907857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25881a71a0 con 0x7f25881049a0 2024-09-11T22:30:54.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.365+0000 7f259188f740 1 Processor -- start 2024-09-11T22:30:54.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.365+0000 7f259188f740 1 -- start start 2024-09-11T22:30:54.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.365+0000 7f259188f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e926eb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f2584c00640 1 -- 172.21.15.40:0/3041907857 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2574005560 con 0x7f25881049a0 2024-09-11T22:30:54.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f259188f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 0x555e926f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f259188f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e926f8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f259188f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555e926510b0 con 0x555e926ebc50 2024-09-11T22:30:54.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f259188f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555e925f8ab0 con 0x555e926eb330 2024-09-11T22:30:54.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f259188f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555e9264d070 con 0x555e926f6510 2024-09-11T22:30:54.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f258ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e926eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f2587e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 0x555e926f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f258ce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e926eb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:41542/0 (socket says 172.21.15.40:41542) 2024-09-11T22:30:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f258ce00640 1 -- 172.21.15.40:0/1197197444 learned_addr learned my addr 172.21.15.40:0/1197197444 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f2587400640 1 --2- 172.21.15.40:0/1197197444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e926f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f258ce00640 1 -- 172.21.15.40:0/1197197444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 msgr2=0x555e926f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f258ce00640 1 --2- 172.21.15.40:0/1197197444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e926f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f258ce00640 1 -- 172.21.15.40:0/1197197444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 msgr2=0x555e926f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f258ce00640 1 --2- 172.21.15.40:0/1197197444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 0x555e926f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.366+0000 7f258ce00640 1 -- 172.21.15.40:0/1197197444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e926054a0 con 0x555e926eb330 2024-09-11T22:30:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.367+0000 7f2587400640 1 --2- 172.21.15.40:0/1197197444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e926f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.367+0000 7f258ce00640 1 --2- 172.21.15.40:0/1197197444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e926eb710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2580009fc0 tx=0x7f258000ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fbe47190b650946 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.367+0000 7f257d600640 1 -- 172.21.15.40:0/1197197444 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258001d070 con 0x555e926eb330 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.367+0000 7f257d600640 1 -- 172.21.15.40:0/1197197444 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2580003e50 con 0x555e926eb330 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.367+0000 7f257d600640 1 -- 172.21.15.40:0/1197197444 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580004750 con 0x555e926eb330 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f2584c00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f256c0a2c90 0x7f256c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f259188f740 1 -- 172.21.15.40:0/1197197444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 msgr2=0x555e926eb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f259188f740 1 --2- 172.21.15.40:0/1197197444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e926eb710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2580009fc0 tx=0x7f258000ec30 comp rx=0 tx=0).stop 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f2584c00640 1 -- 172.21.15.40:0/3041907857 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f25740cf4d0 con 0x7f25881049a0 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f259188f740 1 -- 172.21.15.40:0/1197197444 shutdown_connections 2024-09-11T22:30:54.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f259188f740 1 --2- 172.21.15.40:0/1197197444 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e926f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f259188f740 1 --2- 172.21.15.40:0/1197197444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 0x555e926f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f259188f740 1 --2- 172.21.15.40:0/1197197444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e926eb710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f259188f740 1 -- 172.21.15.40:0/1197197444 >> 172.21.15.40:0/1197197444 conn(0x555e926e78c0 msgr2=0x555e926e7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f259188f740 1 -- 172.21.15.40:0/1197197444 shutdown_connections 2024-09-11T22:30:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f2587e00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f256c0a2c90 0x7f256c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.368+0000 7f259188f740 1 -- 172.21.15.40:0/1197197444 wait complete. 2024-09-11T22:30:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.369+0000 7f259188f740 1 -- start start 2024-09-11T22:30:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.369+0000 7f2587e00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f256c0a2c90 0x7f256c0a5150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f25780057c0 tx=0x7f25780056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.369+0000 7f259188f740 1 Processor -- start 2024-09-11T22:30:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f259188f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926eb330 0x555e926f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f259188f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 0x555e926f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f259188f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926f6510 0x555e926f4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f259188f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555e926f9060 con 0x555e926f6510 2024-09-11T22:30:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f259188f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555e925d9920 con 0x555e926ebc50 2024-09-11T22:30:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f259188f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555e926f91e0 con 0x555e926eb330 2024-09-11T22:30:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f259188f740 10 client.0 _ll_register_callbacks cb 0x555e925fd8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f2587e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926eb330 0x555e926f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f258ce00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926f6510 0x555e926f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f2587e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926eb330 0x555e926f35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:41854/0 (socket says 172.21.15.40:41854) 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f2587e00640 1 -- 172.21.15.40:0/2443566422 learned_addr learned my addr 172.21.15.40:0/2443566422 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.370+0000 7f2587400640 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 0x555e926f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f2587e00640 1 -- 172.21.15.40:0/2443566422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 msgr2=0x555e926f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f2587e00640 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 0x555e926f3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f2587e00640 1 -- 172.21.15.40:0/2443566422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926f6510 msgr2=0x555e926f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f2587e00640 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926f6510 0x555e926f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f2587e00640 1 -- 172.21.15.40:0/2443566422 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e923c22b0 con 0x555e926eb330 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f2587e00640 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926eb330 0x555e926f35d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2578000c00 tx=0x7f257802a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d6d935ad414eb9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f2572000640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-11T22:30:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f2572000640 1 -- 172.21.15.40:0/2443566422 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578037040 con 0x555e926eb330 2024-09-11T22:30:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f259188f740 1 -- 172.21.15.40:0/2443566422 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2580003e50 con 0x555e926eb330 2024-09-11T22:30:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.371+0000 7f2572000640 1 -- 172.21.15.40:0/2443566422 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f25780037f0 con 0x555e926eb330 2024-09-11T22:30:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f2572000640 1 -- 172.21.15.40:0/2443566422 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2578057050 con 0x555e926eb330 2024-09-11T22:30:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f259188f740 10 client.25093 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f259188f740 1 -- 172.21.15.40:0/2443566422 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555e92704e20 con 0x555e926eb330 2024-09-11T22:30:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f2572000640 1 -- 172.21.15.40:0/2443566422 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2580003e50 con 0x555e926eb330 2024-09-11T22:30:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f2572000640 1 -- 172.21.15.40:0/2443566422 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f2578049b90 con 0x555e926eb330 2024-09-11T22:30:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f259188f740 10 client.25093 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f259188f740 10 client.25093 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:30:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f259188f740 20 client.25093 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f259188f740 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x555e92707450 0x555e927088c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f259188f740 4 client.25093 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.372+0000 7f259188f740 1 -- 172.21.15.40:0/2443566422 --> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e9265e620 con 0x555e92707450 2024-09-11T22:30:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.373+0000 7f2587400640 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x555e92707450 0x555e927088c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.373+0000 7f2587400640 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x555e92707450 0x555e927088c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e4e4718d1027b6ae server_cookie=f3ba27ed3641df4b in_seq=0 out_seq=0 2024-09-11T22:30:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.373+0000 7f2572000640 10 client.25093 ms_handle_connect on v2:172.21.15.177:6836/1976954611 2024-09-11T22:30:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.374+0000 7f2572000640 1 -- 172.21.15.40:0/2443566422 <== mds.2 v2:172.21.15.177:6836/1976954611 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e9265e620 con 0x555e92707450 2024-09-11T22:30:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.374+0000 7f2572000640 10 client.25093 handle_command_reply: tid=0 2024-09-11T22:30:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.374+0000 7f259188f740 1 client.25093 shutdown 2024-09-11T22:30:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.374+0000 7f259188f740 1 -- 172.21.15.40:0/2443566422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926eb330 msgr2=0x555e926f35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.374+0000 7f259188f740 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926eb330 0x555e926f35d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2578000c00 tx=0x7f257802a340 comp rx=0 tx=0).stop 2024-09-11T22:30:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.374+0000 7f259188f740 1 -- 172.21.15.40:0/2443566422 shutdown_connections 2024-09-11T22:30:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.375+0000 7f259188f740 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x555e92707450 0x555e927088c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.375+0000 7f259188f740 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926f6510 0x555e926f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.375+0000 7f259188f740 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 0x555e926f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.375+0000 7f259188f740 1 --2- 172.21.15.40:0/2443566422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926eb330 0x555e926f35d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.375+0000 7f259188f740 1 -- 172.21.15.40:0/2443566422 >> 172.21.15.40:0/2443566422 conn(0x555e926e78c0 msgr2=0x555e926ed640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.375+0000 7f2572000640 0 client.25093 ms_handle_reset on v2:172.21.15.177:6836/1976954611 2024-09-11T22:30:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.375+0000 7f259188f740 1 -- 172.21.15.40:0/2443566422 shutdown_connections 2024-09-11T22:30:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.375+0000 7f259188f740 1 -- 172.21.15.40:0/2443566422 wait complete. 2024-09-11T22:30:54.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.375+0000 7f259188f740 20 client.25093 trim_cache size 0 max 16384 2024-09-11T22:30:54.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f259188f740 1 Processor -- start 2024-09-11T22:30:54.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f259188f740 1 -- start start 2024-09-11T22:30:54.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f259188f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e92706d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f259188f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 0x555e926ee980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f259188f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e926ed530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f259188f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555e92706c00 con 0x555e926ebc50 2024-09-11T22:30:54.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f259188f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555e927072d0 con 0x555e926eb330 2024-09-11T22:30:54.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f259188f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555e927079a0 con 0x555e926f6510 2024-09-11T22:30:54.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f2587400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 0x555e926ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f2587e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e92706d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f2587e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e92706d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:41550/0 (socket says 172.21.15.40:41550) 2024-09-11T22:30:54.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.394+0000 7f2587e00640 1 -- 172.21.15.40:0/1192781040 learned_addr learned my addr 172.21.15.40:0/1192781040 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:54.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.395+0000 7f258ce00640 1 --2- 172.21.15.40:0/1192781040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e926ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.395+0000 7f2587e00640 1 -- 172.21.15.40:0/1192781040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 msgr2=0x555e926ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.395+0000 7f2587e00640 1 --2- 172.21.15.40:0/1192781040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e926ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.395+0000 7f2587e00640 1 -- 172.21.15.40:0/1192781040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 msgr2=0x555e926ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.395+0000 7f2587e00640 1 --2- 172.21.15.40:0/1192781040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 0x555e926ee980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.395+0000 7f2587e00640 1 -- 172.21.15.40:0/1192781040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e926f25e0 con 0x555e926eb330 2024-09-11T22:30:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.395+0000 7f2587e00640 1 --2- 172.21.15.40:0/1192781040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e92706d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2578009980 tx=0x7f2578030420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb2ba3cd4f76dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.395+0000 7f257cc00640 1 -- 172.21.15.40:0/1192781040 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257805f070 con 0x555e926eb330 2024-09-11T22:30:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.396+0000 7f257cc00640 1 -- 172.21.15.40:0/1192781040 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f257804e070 con 0x555e926eb330 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.396+0000 7f257cc00640 1 -- 172.21.15.40:0/1192781040 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578037040 con 0x555e926eb330 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.396+0000 7f259188f740 1 -- 172.21.15.40:0/1192781040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 msgr2=0x555e92706d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.396+0000 7f259188f740 1 --2- 172.21.15.40:0/1192781040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e92706d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2578009980 tx=0x7f2578030420 comp rx=0 tx=0).stop 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.396+0000 7f259188f740 1 -- 172.21.15.40:0/1192781040 shutdown_connections 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.396+0000 7f259188f740 1 --2- 172.21.15.40:0/1192781040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e926ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.396+0000 7f259188f740 1 --2- 172.21.15.40:0/1192781040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926ebc50 0x555e926ee980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.396+0000 7f259188f740 1 --2- 172.21.15.40:0/1192781040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926eb330 0x555e92706d80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.396+0000 7f259188f740 1 -- 172.21.15.40:0/1192781040 >> 172.21.15.40:0/1192781040 conn(0x555e926e78c0 msgr2=0x555e926ece20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.397+0000 7f259188f740 1 -- 172.21.15.40:0/1192781040 shutdown_connections 2024-09-11T22:30:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.397+0000 7f259188f740 1 -- 172.21.15.40:0/1192781040 wait complete. 2024-09-11T22:30:54.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.397+0000 7f259188f740 1 -- start start 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.397+0000 7f259188f740 1 Processor -- start 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f259188f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926eb330 0x555e92710a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f259188f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 0x555e92710f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f259188f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e927114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f259188f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x555e92708740 con 0x555e926eb330 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f259188f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555e92708070 con 0x555e926ebc50 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f259188f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x555e92708e10 con 0x555e926f6510 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f259188f740 10 client.0 _ll_register_callbacks cb 0x7f2578004400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f2587e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926eb330 0x555e92710a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f2587e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926eb330 0x555e92710a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54726/0 (socket says 172.21.15.40:54726) 2024-09-11T22:30:54.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f2587e00640 1 -- 172.21.15.40:0/1606510099 learned_addr learned my addr 172.21.15.40:0/1606510099 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f258ce00640 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e927114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.398+0000 7f2587400640 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 0x555e92710f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f2587e00640 1 -- 172.21.15.40:0/1606510099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 msgr2=0x555e927114b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f2587e00640 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e927114b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f2587e00640 1 -- 172.21.15.40:0/1606510099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 msgr2=0x555e92710f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f2587e00640 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 0x555e92710f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f2587e00640 1 -- 172.21.15.40:0/1606510099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e9270bcd0 con 0x555e926eb330 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f2587e00640 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926eb330 0x555e92710a30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2578009830 tx=0x7f257803d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c639c9e0df27b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f2572000640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f2572000640 1 -- 172.21.15.40:0/1606510099 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2578069060 con 0x555e926eb330 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f2572000640 1 -- 172.21.15.40:0/1606510099 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f25780035f0 con 0x555e926eb330 2024-09-11T22:30:54.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.399+0000 7f259188f740 1 -- 172.21.15.40:0/1606510099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f257804e070 con 0x555e926eb330 2024-09-11T22:30:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f2572000640 1 -- 172.21.15.40:0/1606510099 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2578037070 con 0x555e926eb330 2024-09-11T22:30:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f259188f740 10 client.15084 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f259188f740 1 -- 172.21.15.40:0/1606510099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555e92772150 con 0x555e926eb330 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f2572000640 1 -- 172.21.15.40:0/1606510099 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f257804e070 con 0x555e926eb330 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f2572000640 1 -- 172.21.15.40:0/1606510099 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f2578049920 con 0x555e926eb330 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f259188f740 10 client.15084 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f259188f740 10 client.15084 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f259188f740 20 client.15084 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f259188f740 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x555e927767b0 0x555e927754c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f259188f740 4 client.15084 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.400+0000 7f259188f740 1 -- 172.21.15.40:0/1606510099 --> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] -- command(tid 0: {"prefix": "status"}) -- 0x555e92658b30 con 0x555e927767b0 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.401+0000 7f2587400640 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x555e927767b0 0x555e927754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.401+0000 7f2587400640 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x555e927767b0 0x555e927754c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aff14693d2dee472 server_cookie=52817c349bfe1fe7 in_seq=0 out_seq=0 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.401+0000 7f2572000640 10 client.15084 ms_handle_connect on v2:172.21.15.177:6836/1976954611 2024-09-11T22:30:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.401+0000 7f2572000640 1 -- 172.21.15.40:0/1606510099 <== mds.2 v2:172.21.15.177:6836/1976954611 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555e92658b30 con 0x555e927767b0 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.401+0000 7f2572000640 10 client.15084 handle_command_reply: tid=0 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.401+0000 7f259188f740 1 client.15084 shutdown 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 -- 172.21.15.40:0/1606510099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926eb330 msgr2=0x555e92710a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926eb330 0x555e92710a30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2578009830 tx=0x7f257803d770 comp rx=0 tx=0).stop 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 -- 172.21.15.40:0/1606510099 shutdown_connections 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.177:6836/1976954611,v1:172.21.15.177:6837/1976954611] conn(0x555e927767b0 0x555e927754c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e926f6510 0x555e927114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555e926ebc50 0x555e92710f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f2572000640 0 client.15084 ms_handle_reset on v2:172.21.15.177:6836/1976954611 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 --2- 172.21.15.40:0/1606510099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x555e926eb330 0x555e92710a30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 -- 172.21.15.40:0/1606510099 >> 172.21.15.40:0/1606510099 conn(0x555e926e78c0 msgr2=0x555e926e6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 -- 172.21.15.40:0/1606510099 shutdown_connections 2024-09-11T22:30:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 1 -- 172.21.15.40:0/1606510099 wait complete. 2024-09-11T22:30:54.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.402+0000 7f259188f740 20 client.15084 trim_cache size 0 max 16384 2024-09-11T22:30:54.406 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:30:54.406 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:30:54.406 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 2, 2024-09-11T22:30:54.406 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24499, 2024-09-11T22:30:54.406 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-11T22:30:54.406 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-11T22:30:54.406 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-11T22:30:54.406 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 101.049622211, 2024-09-11T22:30:54.407 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 25, 2024-09-11T22:30:54.407 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 95, 2024-09-11T22:30:54.407 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T22:30:54.407 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 181.84806476899999 2024-09-11T22:30:54.407 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:30:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 -- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f256c0a2c90 msgr2=0x7f256c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f256c0a2c90 0x7f256c0a5150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f25780057c0 tx=0x7f25780056d0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 -- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25881049a0 msgr2=0x7f258819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25881049a0 0x7f258819ab60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f257400e9f0 tx=0x7f257400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 -- 172.21.15.40:0/3041907857 shutdown_connections 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f256c0a2c90 0x7f256c0a5150 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2588109120 0x7f258819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25881049a0 0x7f258819ab60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 --2- 172.21.15.40:0/3041907857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2588103ff0 0x7f258819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 -- 172.21.15.40:0/3041907857 >> 172.21.15.40:0/3041907857 conn(0x7f25880ffa90 msgr2=0x7f2588100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 -- 172.21.15.40:0/3041907857 shutdown_connections 2024-09-11T22:30:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:54.403+0000 7f258ee00640 1 -- 172.21.15.40:0/3041907857 wait complete. 2024-09-11T22:30:55.215 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:54 smithi040 ceph-mon[30787]: pgmap v383: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:55.253 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T22:30:55.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:54 smithi177 ceph-mon[35530]: pgmap v383: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:55.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:54 smithi146 ceph-mon[34996]: pgmap v383: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:30:55.645 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.211+0000 7f0282600640 1 -- 172.21.15.40:0/1476806504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f027c104010 msgr2=0x7f027c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.212+0000 7f0282600640 1 --2- 172.21.15.40:0/1476806504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f027c104010 0x7f027c1043f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f026c009860 tx=0x7f026c02a340 comp rx=0 tx=0).stop 2024-09-11T22:30:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.212+0000 7f0282600640 1 -- 172.21.15.40:0/1476806504 shutdown_connections 2024-09-11T22:30:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.212+0000 7f0282600640 1 --2- 172.21.15.40:0/1476806504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c109140 0x7f027c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.212+0000 7f0282600640 1 --2- 172.21.15.40:0/1476806504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027c1049c0 0x7f027c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.212+0000 7f0282600640 1 --2- 172.21.15.40:0/1476806504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f027c104010 0x7f027c1043f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.212+0000 7f0282600640 1 -- 172.21.15.40:0/1476806504 >> 172.21.15.40:0/1476806504 conn(0x7f027c0ffa50 msgr2=0x7f027c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.212+0000 7f0282600640 1 -- 172.21.15.40:0/1476806504 shutdown_connections 2024-09-11T22:30:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.212+0000 7f0282600640 1 -- 172.21.15.40:0/1476806504 wait complete. 2024-09-11T22:30:56.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.213+0000 7f0282600640 1 Processor -- start 2024-09-11T22:30:56.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.213+0000 7f0282600640 1 -- start start 2024-09-11T22:30:56.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f0282600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c104010 0x7f027c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f0282600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027c1049c0 0x7f027c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f0282600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f027c109140 0x7f027c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f0282600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f027c114140 con 0x7f027c104010 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f0282600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f027c113fc0 con 0x7f027c1049c0 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f0282600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f027c1142c0 con 0x7f027c109140 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f027b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c104010 0x7f027c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f027b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c104010 0x7f027c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54746/0 (socket says 172.21.15.40:54746) 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f027b400640 1 -- 172.21.15.40:0/3690638362 learned_addr learned my addr 172.21.15.40:0/3690638362 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f027aa00640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027c1049c0 0x7f027c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f027be00640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f027c109140 0x7f027c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.214+0000 7f027b400640 1 -- 172.21.15.40:0/3690638362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f027c109140 msgr2=0x7f027c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f027b400640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f027c109140 0x7f027c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f027b400640 1 -- 172.21.15.40:0/3690638362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027c1049c0 msgr2=0x7f027c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f027b400640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027c1049c0 0x7f027c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f027b400640 1 -- 172.21.15.40:0/3690638362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c19f5b0 con 0x7f027c104010 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f027be00640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f027c109140 0x7f027c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f027aa00640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027c1049c0 0x7f027c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f027b400640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c104010 0x7f027c19a600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f026c035040 tx=0x7f026c033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f0273e00640 1 -- 172.21.15.40:0/3690638362 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c03f020 con 0x7f027c104010 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f0273e00640 1 -- 172.21.15.40:0/3690638362 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f026c032770 con 0x7f027c104010 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f0273e00640 1 -- 172.21.15.40:0/3690638362 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c037040 con 0x7f027c104010 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.215+0000 7f0282600640 1 -- 172.21.15.40:0/3690638362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027c19f840 con 0x7f027c104010 2024-09-11T22:30:56.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.216+0000 7f0282600640 1 -- 172.21.15.40:0/3690638362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027c1a7180 con 0x7f027c104010 2024-09-11T22:30:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.219+0000 7f0273e00640 1 -- 172.21.15.40:0/3690638362 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f026c042020 con 0x7f027c104010 2024-09-11T22:30:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.219+0000 7f028506b740 1 Processor -- start 2024-09-11T22:30:56.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.219+0000 7f028506b740 1 -- start start 2024-09-11T22:30:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.219+0000 7f028506b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db48710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.219+0000 7f028506b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db48c50 0x55cf4db52fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.219+0000 7f028506b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db53510 0x55cf4db55900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.219+0000 7f028506b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55cf4daae0b0 con 0x55cf4db53510 2024-09-11T22:30:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f028506b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cf4da55ab0 con 0x55cf4db48c50 2024-09-11T22:30:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f028506b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cf4daaa070 con 0x55cf4db48330 2024-09-11T22:30:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db53510 0x55cf4db55900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db48c50 0x55cf4db52fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db53510 0x55cf4db55900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54754/0 (socket says 172.21.15.40:54754) 2024-09-11T22:30:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027aa00640 1 -- 172.21.15.40:0/2109477197 learned_addr learned my addr 172.21.15.40:0/2109477197 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:56.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027be00640 1 --2- 172.21.15.40:0/2109477197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db48710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027aa00640 1 -- 172.21.15.40:0/2109477197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 msgr2=0x55cf4db48710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027aa00640 1 --2- 172.21.15.40:0/2109477197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db48710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027aa00640 1 -- 172.21.15.40:0/2109477197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db48c50 msgr2=0x55cf4db52fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027aa00640 1 --2- 172.21.15.40:0/2109477197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db48c50 0x55cf4db52fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.220+0000 7f027aa00640 1 -- 172.21.15.40:0/2109477197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf4da624a0 con 0x55cf4db53510 2024-09-11T22:30:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.221+0000 7f027aa00640 1 --2- 172.21.15.40:0/2109477197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db53510 0x55cf4db55900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f02680114f0 tx=0x7f02680119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c104e18f6488e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.221+0000 7f0273e00640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f02600a2c90 0x7f02600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.221+0000 7f0270c00640 1 -- 172.21.15.40:0/2109477197 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268005020 con 0x55cf4db53510 2024-09-11T22:30:56.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.221+0000 7f0270c00640 1 -- 172.21.15.40:0/2109477197 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02680047a0 con 0x55cf4db53510 2024-09-11T22:30:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.221+0000 7f0270c00640 1 -- 172.21.15.40:0/2109477197 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026800f9e0 con 0x55cf4db53510 2024-09-11T22:30:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.221+0000 7f0273e00640 1 -- 172.21.15.40:0/3690638362 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f026c0ef320 con 0x7f027c104010 2024-09-11T22:30:56.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.221+0000 7f027be00640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f02600a2c90 0x7f02600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f028506b740 1 -- 172.21.15.40:0/2109477197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db53510 msgr2=0x55cf4db55900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f028506b740 1 --2- 172.21.15.40:0/2109477197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db53510 0x55cf4db55900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f02680114f0 tx=0x7f02680119b0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f027be00640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f02600a2c90 0x7f02600a5150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0274005fd0 tx=0x7f0274009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f028506b740 1 -- 172.21.15.40:0/2109477197 shutdown_connections 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f028506b740 1 --2- 172.21.15.40:0/2109477197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db53510 0x55cf4db55900 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f028506b740 1 --2- 172.21.15.40:0/2109477197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db48c50 0x55cf4db52fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f028506b740 1 --2- 172.21.15.40:0/2109477197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db48710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f028506b740 1 -- 172.21.15.40:0/2109477197 >> 172.21.15.40:0/2109477197 conn(0x55cf4db448c0 msgr2=0x55cf4db44ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f028506b740 1 -- 172.21.15.40:0/2109477197 shutdown_connections 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.222+0000 7f028506b740 1 -- 172.21.15.40:0/2109477197 wait complete. 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.223+0000 7f028506b740 1 -- start start 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.223+0000 7f028506b740 1 Processor -- start 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.223+0000 7f028506b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48330 0x55cf4db50550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.223+0000 7f028506b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48c50 0x55cf4db50a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.223+0000 7f028506b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db50fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.223+0000 7f028506b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55cf4db56060 con 0x55cf4db48330 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.223+0000 7f028506b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cf4da36920 con 0x55cf4db53510 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.223+0000 7f028506b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cf4db561e0 con 0x55cf4db48c50 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.223+0000 7f028506b740 10 client.0 _ll_register_callbacks cb 0x55cf4da5a8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48330 0x55cf4db50550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48c50 0x55cf4db50a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48330 0x55cf4db50550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54770/0 (socket says 172.21.15.40:54770) 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027b400640 1 -- 172.21.15.40:0/1745954296 learned_addr learned my addr 172.21.15.40:0/1745954296 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027be00640 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db50fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027aa00640 1 -- 172.21.15.40:0/1745954296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 msgr2=0x55cf4db50fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027aa00640 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db50fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027aa00640 1 -- 172.21.15.40:0/1745954296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48330 msgr2=0x55cf4db50550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027aa00640 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48330 0x55cf4db50550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027aa00640 1 -- 172.21.15.40:0/1745954296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf4d81f2b0 con 0x55cf4db48c50 2024-09-11T22:30:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.224+0000 7f027b400640 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48330 0x55cf4db50550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.225+0000 7f027aa00640 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48c50 0x55cf4db50a90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0268000c00 tx=0x7f0268005160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=404e6d52389dd843 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.225+0000 7f0265600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-09-11T22:30:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.225+0000 7f0265600640 1 -- 172.21.15.40:0/1745954296 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268028070 con 0x55cf4db48c50 2024-09-11T22:30:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.225+0000 7f028506b740 1 -- 172.21.15.40:0/1745954296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02680047a0 con 0x55cf4db48c50 2024-09-11T22:30:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.225+0000 7f0265600640 1 -- 172.21.15.40:0/1745954296 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f02680054e0 con 0x55cf4db48c50 2024-09-11T22:30:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.225+0000 7f0265600640 1 -- 172.21.15.40:0/1745954296 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0268034050 con 0x55cf4db48c50 2024-09-11T22:30:56.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.225+0000 7f028506b740 10 client.25111 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.225+0000 7f028506b740 1 -- 172.21.15.40:0/1745954296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cf4db61e50 con 0x55cf4db48c50 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.226+0000 7f0265600640 1 -- 172.21.15.40:0/1745954296 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02680047a0 con 0x55cf4db48c50 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.226+0000 7f0265600640 1 -- 172.21.15.40:0/1745954296 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f026802d600 con 0x55cf4db48c50 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.226+0000 7f028506b740 10 client.25111 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.226+0000 7f028506b740 10 client.25111 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.226+0000 7f028506b740 20 client.25111 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.226+0000 7f028506b740 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x55cf4db641e0 0x55cf4db65650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.226+0000 7f028506b740 4 client.25111 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.226+0000 7f028506b740 1 -- 172.21.15.40:0/1745954296 --> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf4dabb620 con 0x55cf4db641e0 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.226+0000 7f027b400640 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x55cf4db641e0 0x55cf4db65650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.227+0000 7f027b400640 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x55cf4db641e0 0x55cf4db65650 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b54ee313c703a70 server_cookie=d929d6a2aef0e35d in_seq=0 out_seq=0 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.227+0000 7f0265600640 10 client.25111 ms_handle_connect on v2:172.21.15.177:6838/2764150178 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f0265600640 1 -- 172.21.15.40:0/1745954296 <== mds.1 v2:172.21.15.177:6838/2764150178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf4dabb620 con 0x55cf4db641e0 2024-09-11T22:30:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f0265600640 10 client.25111 handle_command_reply: tid=0 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 client.25111 shutdown 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 -- 172.21.15.40:0/1745954296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48c50 msgr2=0x55cf4db50a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48c50 0x55cf4db50a90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0268000c00 tx=0x7f0268005160 comp rx=0 tx=0).stop 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 -- 172.21.15.40:0/1745954296 shutdown_connections 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x55cf4db641e0 0x55cf4db65650 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db50fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48c50 0x55cf4db50a90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 --2- 172.21.15.40:0/1745954296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48330 0x55cf4db50550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f0265600640 0 client.25111 ms_handle_reset on v2:172.21.15.177:6838/2764150178 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 -- 172.21.15.40:0/1745954296 >> 172.21.15.40:0/1745954296 conn(0x55cf4db448c0 msgr2=0x55cf4db4a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 -- 172.21.15.40:0/1745954296 shutdown_connections 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 1 -- 172.21.15.40:0/1745954296 wait complete. 2024-09-11T22:30:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.228+0000 7f028506b740 20 client.25111 trim_cache size 0 max 16384 2024-09-11T22:30:56.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.247+0000 7f028506b740 1 Processor -- start 2024-09-11T22:30:56.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.247+0000 7f028506b740 1 -- start start 2024-09-11T22:30:56.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.247+0000 7f028506b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db64f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.247+0000 7f028506b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db50e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.247+0000 7f028506b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db4d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.247+0000 7f028506b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55cf4db63990 con 0x55cf4db48c50 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.247+0000 7f028506b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cf4db64060 con 0x55cf4db53510 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.247+0000 7f028506b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cf4db64730 con 0x55cf4db48330 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db50e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db50e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54784/0 (socket says 172.21.15.40:54784) 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027aa00640 1 -- 172.21.15.40:0/2855137629 learned_addr learned my addr 172.21.15.40:0/2855137629 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027be00640 1 --2- 172.21.15.40:0/2855137629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db4d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027b400640 1 --2- 172.21.15.40:0/2855137629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db64f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027aa00640 1 -- 172.21.15.40:0/2855137629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 msgr2=0x55cf4db64f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027aa00640 1 --2- 172.21.15.40:0/2855137629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db64f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027aa00640 1 -- 172.21.15.40:0/2855137629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 msgr2=0x55cf4db4d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:56.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027aa00640 1 --2- 172.21.15.40:0/2855137629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db4d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027aa00640 1 -- 172.21.15.40:0/2855137629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf4db4eb00 con 0x55cf4db48c50 2024-09-11T22:30:56.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.248+0000 7f027aa00640 1 --2- 172.21.15.40:0/2855137629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db50e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0268006010 tx=0x7f02680119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf74301bcc370dab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:56.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f0267e00640 1 -- 172.21.15.40:0/2855137629 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268028040 con 0x55cf4db48c50 2024-09-11T22:30:56.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f0267e00640 1 -- 172.21.15.40:0/2855137629 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0268016070 con 0x55cf4db48c50 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f0267e00640 1 -- 172.21.15.40:0/2855137629 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02680042a0 con 0x55cf4db48c50 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f028506b740 1 -- 172.21.15.40:0/2855137629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 msgr2=0x55cf4db50e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f028506b740 1 --2- 172.21.15.40:0/2855137629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db50e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0268006010 tx=0x7f02680119b0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f028506b740 1 -- 172.21.15.40:0/2855137629 shutdown_connections 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f028506b740 1 --2- 172.21.15.40:0/2855137629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db4d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f028506b740 1 --2- 172.21.15.40:0/2855137629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db50e40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f028506b740 1 --2- 172.21.15.40:0/2855137629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db64f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.249+0000 7f028506b740 1 -- 172.21.15.40:0/2855137629 >> 172.21.15.40:0/2855137629 conn(0x55cf4db448c0 msgr2=0x55cf4db4ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.250+0000 7f028506b740 1 -- 172.21.15.40:0/2855137629 shutdown_connections 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.250+0000 7f028506b740 1 -- 172.21.15.40:0/2855137629 wait complete. 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.250+0000 7f028506b740 1 -- start start 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.250+0000 7f028506b740 1 Processor -- start 2024-09-11T22:30:56.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f028506b740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db6e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f028506b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db4d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f028506b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db4d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f028506b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55cf4db654d0 con 0x55cf4db48c50 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f028506b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cf4db64e00 con 0x55cf4db53510 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f028506b740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55cf4db65ba0 con 0x55cf4db48330 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f028506b740 10 client.0 _ll_register_callbacks cb 0x7f0268009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db4d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db6e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db4d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54790/0 (socket says 172.21.15.40:54790) 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027aa00640 1 -- 172.21.15.40:0/1680343658 learned_addr learned my addr 172.21.15.40:0/1680343658 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:56.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027be00640 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db4d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027aa00640 1 -- 172.21.15.40:0/1680343658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 msgr2=0x55cf4db6e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027aa00640 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db6e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027aa00640 1 -- 172.21.15.40:0/1680343658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 msgr2=0x55cf4db4d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027aa00640 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db4d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027aa00640 1 -- 172.21.15.40:0/1680343658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf4db4e1a0 con 0x55cf4db48c50 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.251+0000 7f027b400640 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db6e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.252+0000 7f027aa00640 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db4d3c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0268001eb0 tx=0x7f026802dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6c843233062a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.252+0000 7f0265600640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.252+0000 7f0265600640 1 -- 172.21.15.40:0/1680343658 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0268028040 con 0x55cf4db48c50 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.252+0000 7f0265600640 1 -- 172.21.15.40:0/1680343658 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f026802d640 con 0x55cf4db48c50 2024-09-11T22:30:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.252+0000 7f028506b740 1 -- 172.21.15.40:0/1680343658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0268016070 con 0x55cf4db48c50 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.252+0000 7f0265600640 1 -- 172.21.15.40:0/1680343658 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f02680047a0 con 0x55cf4db48c50 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.252+0000 7f028506b740 10 client.15102 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.252+0000 7f028506b740 1 -- 172.21.15.40:0/1680343658 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cf4dbce950 con 0x55cf4db48c50 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.253+0000 7f0265600640 1 -- 172.21.15.40:0/1680343658 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0268016070 con 0x55cf4db48c50 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.253+0000 7f0265600640 1 -- 172.21.15.40:0/1680343658 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f02680037f0 con 0x55cf4db48c50 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.253+0000 7f028506b740 10 client.15102 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.253+0000 7f028506b740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.253+0000 7f028506b740 20 client.15102 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.253+0000 7f028506b740 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x55cf4dbd3160 0x55cf4dbd1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.253+0000 7f028506b740 4 client.15102 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.253+0000 7f028506b740 1 -- 172.21.15.40:0/1680343658 --> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] -- command(tid 0: {"prefix": "status"}) -- 0x55cf4dab5b30 con 0x55cf4dbd3160 2024-09-11T22:30:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.253+0000 7f027b400640 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x55cf4dbd3160 0x55cf4dbd1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.254+0000 7f027b400640 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x55cf4dbd3160 0x55cf4dbd1e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b97d0a8e9aa92df server_cookie=598bacb1dbc063e7 in_seq=0 out_seq=0 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.254+0000 7f0265600640 10 client.15102 ms_handle_connect on v2:172.21.15.177:6838/2764150178 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.254+0000 7f0265600640 1 -- 172.21.15.40:0/1680343658 <== mds.1 v2:172.21.15.177:6838/2764150178 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cf4dab5b30 con 0x55cf4dbd3160 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.254+0000 7f0265600640 10 client.15102 handle_command_reply: tid=0 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.254+0000 7f028506b740 1 client.15102 shutdown 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.254+0000 7f028506b740 1 -- 172.21.15.40:0/1680343658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 msgr2=0x55cf4db4d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.254+0000 7f028506b740 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db4d3c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0268001eb0 tx=0x7f026802dc60 comp rx=0 tx=0).stop 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f028506b740 1 -- 172.21.15.40:0/1680343658 shutdown_connections 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f028506b740 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.177:6838/2764150178,v1:172.21.15.177:6839/2764150178] conn(0x55cf4dbd3160 0x55cf4dbd1e70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f028506b740 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cf4db53510 0x55cf4db4d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f028506b740 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55cf4db48c50 0x55cf4db4d3c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f028506b740 1 --2- 172.21.15.40:0/1680343658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cf4db48330 0x55cf4db6e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f028506b740 1 -- 172.21.15.40:0/1680343658 >> 172.21.15.40:0/1680343658 conn(0x55cf4db448c0 msgr2=0x55cf4db5e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f0265600640 0 client.15102 ms_handle_reset on v2:172.21.15.177:6838/2764150178 2024-09-11T22:30:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f028506b740 1 -- 172.21.15.40:0/1680343658 shutdown_connections 2024-09-11T22:30:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f028506b740 1 -- 172.21.15.40:0/1680343658 wait complete. 2024-09-11T22:30:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f028506b740 20 client.15102 trim_cache size 0 max 16384 2024-09-11T22:30:56.259 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:30:56.259 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:30:56.259 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 1, 2024-09-11T22:30:56.259 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24517, 2024-09-11T22:30:56.260 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-11T22:30:56.260 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-11T22:30:56.260 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-11T22:30:56.260 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 103.91030027799999, 2024-09-11T22:30:56.260 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 25, 2024-09-11T22:30:56.260 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 95, 2024-09-11T22:30:56.260 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T22:30:56.260 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 178.24389235500001 2024-09-11T22:30:56.260 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:30:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f0282600640 1 -- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f02600a2c90 msgr2=0x7f02600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f0282600640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f02600a2c90 0x7f02600a5150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0274005fd0 tx=0x7f0274009500 comp rx=0 tx=0).stop 2024-09-11T22:30:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f0282600640 1 -- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c104010 msgr2=0x7f027c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.255+0000 7f0282600640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c104010 0x7f027c19a600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f026c035040 tx=0x7f026c033d90 comp rx=0 tx=0).stop 2024-09-11T22:30:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.256+0000 7f0282600640 1 -- 172.21.15.40:0/3690638362 shutdown_connections 2024-09-11T22:30:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.256+0000 7f0282600640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f02600a2c90 0x7f02600a5150 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.256+0000 7f0282600640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f027c109140 0x7f027c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.256+0000 7f0282600640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027c1049c0 0x7f027c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.256+0000 7f0282600640 1 --2- 172.21.15.40:0/3690638362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c104010 0x7f027c19a600 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.256+0000 7f0282600640 1 -- 172.21.15.40:0/3690638362 >> 172.21.15.40:0/3690638362 conn(0x7f027c0ffa50 msgr2=0x7f027c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.256+0000 7f0282600640 1 -- 172.21.15.40:0/3690638362 shutdown_connections 2024-09-11T22:30:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:56.256+0000 7f0282600640 1 -- 172.21.15.40:0/3690638362 wait complete. 2024-09-11T22:30:57.139 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T22:30:57.189 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:56 smithi040 ceph-mon[30787]: pgmap v384: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:57.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:56 smithi177 ceph-mon[35530]: pgmap v384: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:57.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:56 smithi146 ceph-mon[34996]: pgmap v384: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:30:57.525 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:30:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.139+0000 7ff131e00640 1 -- 172.21.15.40:0/2873385172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c106f10 msgr2=0x7ff12c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.139+0000 7ff131e00640 1 --2- 172.21.15.40:0/2873385172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c106f10 0x7ff12c10ea90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff124009ca0 tx=0x7ff12402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.140+0000 7ff131e00640 1 -- 172.21.15.40:0/2873385172 shutdown_connections 2024-09-11T22:30:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.140+0000 7ff131e00640 1 --2- 172.21.15.40:0/2873385172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c106f10 0x7ff12c10ea90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.140+0000 7ff131e00640 1 --2- 172.21.15.40:0/2873385172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c102790 0x7ff12c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.140+0000 7ff131e00640 1 --2- 172.21.15.40:0/2873385172 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff12c101de0 0x7ff12c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.140+0000 7ff131e00640 1 -- 172.21.15.40:0/2873385172 >> 172.21.15.40:0/2873385172 conn(0x7ff12c0fd8c0 msgr2=0x7ff12c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.140+0000 7ff131e00640 1 -- 172.21.15.40:0/2873385172 shutdown_connections 2024-09-11T22:30:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.140+0000 7ff131e00640 1 -- 172.21.15.40:0/2873385172 wait complete. 2024-09-11T22:30:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.141+0000 7ff131e00640 1 Processor -- start 2024-09-11T22:30:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.141+0000 7ff131e00640 1 -- start start 2024-09-11T22:30:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.141+0000 7ff131e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c101de0 0x7ff12c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.141+0000 7ff131e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c102790 0x7ff12c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.141+0000 7ff131e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff12c106f10 0x7ff12c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.141+0000 7ff131e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c111f70 con 0x7ff12c101de0 2024-09-11T22:30:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.141+0000 7ff131e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c111df0 con 0x7ff12c102790 2024-09-11T22:30:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.141+0000 7ff131e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1120f0 con 0x7ff12c106f10 2024-09-11T22:30:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c101de0 0x7ff12c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12aa00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c101de0 0x7ff12c19a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54808/0 (socket says 172.21.15.40:54808) 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12aa00640 1 -- 172.21.15.40:0/741764763 learned_addr learned my addr 172.21.15.40:0/741764763 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12a000640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c102790 0x7ff12c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12b400640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff12c106f10 0x7ff12c19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12a000640 1 -- 172.21.15.40:0/741764763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff12c106f10 msgr2=0x7ff12c19eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12a000640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff12c106f10 0x7ff12c19eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12a000640 1 -- 172.21.15.40:0/741764763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c101de0 msgr2=0x7ff12c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12a000640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c101de0 0x7ff12c19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12a000640 1 -- 172.21.15.40:0/741764763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c19f580 con 0x7ff12c102790 2024-09-11T22:30:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.142+0000 7ff12a000640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c102790 0x7ff12c19ab10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff11800e9f0 tx=0x7ff11800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.143+0000 7ff130a00640 1 -- 172.21.15.40:0/741764763 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11800ccc0 con 0x7ff12c102790 2024-09-11T22:30:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.143+0000 7ff130a00640 1 -- 172.21.15.40:0/741764763 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff118010910 con 0x7ff12c102790 2024-09-11T22:30:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.143+0000 7ff131e00640 1 -- 172.21.15.40:0/741764763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c19f870 con 0x7ff12c102790 2024-09-11T22:30:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.143+0000 7ff130a00640 1 -- 172.21.15.40:0/741764763 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118018960 con 0x7ff12c102790 2024-09-11T22:30:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.143+0000 7ff131e00640 1 -- 172.21.15.40:0/741764763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c1a7150 con 0x7ff12c102790 2024-09-11T22:30:58.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.146+0000 7ff134a0a740 1 Processor -- start 2024-09-11T22:30:58.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.146+0000 7ff130a00640 1 -- 172.21.15.40:0/741764763 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff118010ac0 con 0x7ff12c102790 2024-09-11T22:30:58.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.146+0000 7ff134a0a740 1 -- start start 2024-09-11T22:30:58.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.146+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222f330 0x55898222f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.146+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 0x558982239fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898223a510 0x55898223c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff134a0a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5589821950b0 con 0x55898222f330 2024-09-11T22:30:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff134a0a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55898213cab0 con 0x55898222fc50 2024-09-11T22:30:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff134a0a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x558982191070 con 0x55898223a510 2024-09-11T22:30:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222f330 0x55898222f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222f330 0x55898222f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54814/0 (socket says 172.21.15.40:54814) 2024-09-11T22:30:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898223a510 0x55898223c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12b400640 1 -- 172.21.15.40:0/453718232 learned_addr learned my addr 172.21.15.40:0/453718232 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:58.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12aa00640 1 --2- 172.21.15.40:0/453718232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 0x558982239fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12b400640 1 -- 172.21.15.40:0/453718232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898223a510 msgr2=0x55898223c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12b400640 1 --2- 172.21.15.40:0/453718232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898223a510 0x55898223c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12b400640 1 -- 172.21.15.40:0/453718232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 msgr2=0x558982239fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12b400640 1 --2- 172.21.15.40:0/453718232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 0x558982239fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12b400640 1 -- 172.21.15.40:0/453718232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589821494a0 con 0x55898222f330 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.147+0000 7ff12aa00640 1 --2- 172.21.15.40:0/453718232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 0x558982239fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.148+0000 7ff12b400640 1 --2- 172.21.15.40:0/453718232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222f330 0x55898222f710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff124009ca0 tx=0x7ff124009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1305b24c69e304c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.148+0000 7ff117e00640 1 -- 172.21.15.40:0/453718232 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124031db0 con 0x55898222f330 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.148+0000 7ff130a00640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff1100a2b80 0x7ff1100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.148+0000 7ff117e00640 1 -- 172.21.15.40:0/453718232 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff124036040 con 0x55898222f330 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.148+0000 7ff117e00640 1 -- 172.21.15.40:0/453718232 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124004330 con 0x55898222f330 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.148+0000 7ff130a00640 1 -- 172.21.15.40:0/741764763 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7ff1180cf750 con 0x7ff12c102790 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.148+0000 7ff12aa00640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff1100a2b80 0x7ff1100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.149+0000 7ff134a0a740 1 -- 172.21.15.40:0/453718232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222f330 msgr2=0x55898222f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.149+0000 7ff12aa00640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff1100a2b80 0x7ff1100a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55898222c720 tx=0x7ff11c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.149+0000 7ff134a0a740 1 --2- 172.21.15.40:0/453718232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222f330 0x55898222f710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff124009ca0 tx=0x7ff124009800 comp rx=0 tx=0).stop 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.149+0000 7ff134a0a740 1 -- 172.21.15.40:0/453718232 shutdown_connections 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.149+0000 7ff134a0a740 1 --2- 172.21.15.40:0/453718232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898223a510 0x55898223c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.149+0000 7ff134a0a740 1 --2- 172.21.15.40:0/453718232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 0x558982239fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.149+0000 7ff134a0a740 1 --2- 172.21.15.40:0/453718232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222f330 0x55898222f710 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.149+0000 7ff134a0a740 1 -- 172.21.15.40:0/453718232 >> 172.21.15.40:0/453718232 conn(0x55898222b8c0 msgr2=0x55898222bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.149+0000 7ff134a0a740 1 -- 172.21.15.40:0/453718232 shutdown_connections 2024-09-11T22:30:58.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.150+0000 7ff134a0a740 1 -- 172.21.15.40:0/453718232 wait complete. 2024-09-11T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.150+0000 7ff134a0a740 1 -- start start 2024-09-11T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.150+0000 7ff134a0a740 1 Processor -- start 2024-09-11T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 0x5589822374e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222fc50 0x558982237a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898223a510 0x558982237f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff134a0a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55898223cf60 con 0x55898222fc50 2024-09-11T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff134a0a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55898211d920 con 0x55898223a510 2024-09-11T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff134a0a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55898223d0e0 con 0x55898222f330 2024-09-11T22:30:58.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff134a0a740 10 client.0 _ll_register_callbacks cb 0x5589821418a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff12a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222fc50 0x558982237a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff12a000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222fc50 0x558982237a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54830/0 (socket says 172.21.15.40:54830) 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff12a000640 1 -- 172.21.15.40:0/2406288743 learned_addr learned my addr 172.21.15.40:0/2406288743 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff12aa00640 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 0x5589822374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.151+0000 7ff12b400640 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898223a510 0x558982237f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff12a000640 1 -- 172.21.15.40:0/2406288743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 msgr2=0x5589822374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff12a000640 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 0x5589822374e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff12a000640 1 -- 172.21.15.40:0/2406288743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898223a510 msgr2=0x558982237f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff12a000640 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898223a510 0x558982237f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff12a000640 1 -- 172.21.15.40:0/2406288743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558981f062b0 con 0x55898222fc50 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff12a000640 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222fc50 0x558982237a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff118098640 tx=0x7ff118097fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daec474eb0cd7ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff114c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T22:30:58.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff114c00640 1 -- 172.21.15.40:0/2406288743 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11809bc70 con 0x55898222fc50 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff114c00640 1 -- 172.21.15.40:0/2406288743 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7ff1180cfb40 con 0x55898222fc50 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff134a0a740 1 -- 172.21.15.40:0/2406288743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff124036040 con 0x55898222fc50 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff114c00640 1 -- 172.21.15.40:0/2406288743 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff11809ff70 con 0x55898222fc50 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff134a0a740 10 client.15114 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.152+0000 7ff134a0a740 1 -- 172.21.15.40:0/2406288743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558982248bd0 con 0x55898222fc50 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.153+0000 7ff114c00640 1 -- 172.21.15.40:0/2406288743 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff124036040 con 0x55898222fc50 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.153+0000 7ff114c00640 1 -- 172.21.15.40:0/2406288743 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff118018b00 con 0x55898222fc50 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.153+0000 7ff134a0a740 10 client.15114 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.153+0000 7ff134a0a740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.153+0000 7ff134a0a740 20 client.15114 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.153+0000 7ff134a0a740 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55898224b210 0x55898224c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.153+0000 7ff134a0a740 4 client.15114 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.153+0000 7ff134a0a740 1 -- 172.21.15.40:0/2406288743 --> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589821a2620 con 0x55898224b210 2024-09-11T22:30:58.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.154+0000 7ff12aa00640 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55898224b210 0x55898224c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.154+0000 7ff12aa00640 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55898224b210 0x55898224c680 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6408dad372b84ca server_cookie=193b085080558b7 in_seq=0 out_seq=0 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.154+0000 7ff114c00640 10 client.15114 ms_handle_connect on v2:172.21.15.146:6838/2365077357 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.155+0000 7ff114c00640 1 -- 172.21.15.40:0/2406288743 <== mds.0 v2:172.21.15.146:6838/2365077357 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589821a2620 con 0x55898224b210 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.155+0000 7ff114c00640 10 client.15114 handle_command_reply: tid=0 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.155+0000 7ff134a0a740 1 client.15114 shutdown 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.155+0000 7ff134a0a740 1 -- 172.21.15.40:0/2406288743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222fc50 msgr2=0x558982237a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.155+0000 7ff134a0a740 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222fc50 0x558982237a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff118098640 tx=0x7ff118097fd0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff134a0a740 1 -- 172.21.15.40:0/2406288743 shutdown_connections 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff134a0a740 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x55898224b210 0x55898224c680 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff134a0a740 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898223a510 0x558982237f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff134a0a740 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898222fc50 0x558982237a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff134a0a740 1 --2- 172.21.15.40:0/2406288743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 0x5589822374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff134a0a740 1 -- 172.21.15.40:0/2406288743 >> 172.21.15.40:0/2406288743 conn(0x55898222b8c0 msgr2=0x5589822315f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff114c00640 0 client.15114 ms_handle_reset on v2:172.21.15.146:6838/2365077357 2024-09-11T22:30:58.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff134a0a740 1 -- 172.21.15.40:0/2406288743 shutdown_connections 2024-09-11T22:30:58.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff134a0a740 1 -- 172.21.15.40:0/2406288743 wait complete. 2024-09-11T22:30:58.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.156+0000 7ff134a0a740 20 client.15114 trim_cache size 0 max 16384 2024-09-11T22:30:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff134a0a740 1 Processor -- start 2024-09-11T22:30:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff134a0a740 1 -- start start 2024-09-11T22:30:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222f330 0x55898222bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222fc50 0x558982234740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x558982234c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff134a0a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55898224a9c0 con 0x55898223a510 2024-09-11T22:30:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff134a0a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55898224b090 con 0x55898222f330 2024-09-11T22:30:58.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff134a0a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55898224b760 con 0x55898222fc50 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff12b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x558982234c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff12b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x558982234c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54840/0 (socket says 172.21.15.40:54840) 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff12b400640 1 -- 172.21.15.40:0/1464542059 learned_addr learned my addr 172.21.15.40:0/1464542059 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff12a000640 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222fc50 0x558982234740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.175+0000 7ff12aa00640 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222f330 0x55898222bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff12b400640 1 -- 172.21.15.40:0/1464542059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222fc50 msgr2=0x558982234740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff12b400640 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222fc50 0x558982234740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff12b400640 1 -- 172.21.15.40:0/1464542059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222f330 msgr2=0x55898222bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff12b400640 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222f330 0x55898222bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff12b400640 1 -- 172.21.15.40:0/1464542059 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558982238860 con 0x55898223a510 2024-09-11T22:30:58.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff12aa00640 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222f330 0x55898222bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:58.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff12b400640 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x558982234c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff124031ab0 tx=0x7ff124031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84291f9d3f12cd7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff117400640 1 -- 172.21.15.40:0/1464542059 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124031db0 con 0x55898223a510 2024-09-11T22:30:58.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff117400640 1 -- 172.21.15.40:0/1464542059 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff124036050 con 0x55898223a510 2024-09-11T22:30:58.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.176+0000 7ff117400640 1 -- 172.21.15.40:0/1464542059 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124004380 con 0x55898223a510 2024-09-11T22:30:58.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 -- 172.21.15.40:0/1464542059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 msgr2=0x558982234c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x558982234c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff124031ab0 tx=0x7ff124031980 comp rx=0 tx=0).stop 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 -- 172.21.15.40:0/1464542059 shutdown_connections 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x558982234c80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222fc50 0x558982234740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 --2- 172.21.15.40:0/1464542059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222f330 0x55898222bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 -- 172.21.15.40:0/1464542059 >> 172.21.15.40:0/1464542059 conn(0x55898222b8c0 msgr2=0x558982235db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 -- 172.21.15.40:0/1464542059 shutdown_connections 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 -- 172.21.15.40:0/1464542059 wait complete. 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.177+0000 7ff134a0a740 1 -- start start 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.178+0000 7ff134a0a740 1 Processor -- start 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.178+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 0x558982254f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.178+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 0x55898224e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.178+0000 7ff134a0a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x55898224e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.178+0000 7ff134a0a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55898224c500 con 0x55898223a510 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.178+0000 7ff134a0a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55898224be30 con 0x55898222fc50 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.178+0000 7ff134a0a740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x55898224cbd0 con 0x55898222f330 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.178+0000 7ff134a0a740 10 client.0 _ll_register_callbacks cb 0x7ff11800ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.178+0000 7ff12b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x55898224e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12b400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x55898224e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54850/0 (socket says 172.21.15.40:54850) 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12b400640 1 -- 172.21.15.40:0/3394840410 learned_addr learned my addr 172.21.15.40:0/3394840410 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12aa00640 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 0x558982254f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12a000640 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 0x55898224e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12b400640 1 -- 172.21.15.40:0/3394840410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 msgr2=0x558982254f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12b400640 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 0x558982254f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12b400640 1 -- 172.21.15.40:0/3394840410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 msgr2=0x55898224e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12b400640 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 0x55898224e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12b400640 1 -- 172.21.15.40:0/3394840410 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55898224ee90 con 0x55898223a510 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff12b400640 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x55898224e7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff124009bf0 tx=0x7ff12402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb699c8117de4de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff114c00640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.179+0000 7ff114c00640 1 -- 172.21.15.40:0/3394840410 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12405a020 con 0x55898223a510 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff134a0a740 1 -- 172.21.15.40:0/3394840410 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff124036050 con 0x55898223a510 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff114c00640 1 -- 172.21.15.40:0/3394840410 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7ff124004120 con 0x55898223a510 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff114c00640 1 -- 172.21.15.40:0/3394840410 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff124062050 con 0x55898223a510 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff134a0a740 10 client.15120 fetch_fsmap learned FSMap version 25 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff134a0a740 1 -- 172.21.15.40:0/3394840410 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5589822b5920 con 0x55898223a510 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff114c00640 1 -- 172.21.15.40:0/3394840410 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff124036050 con 0x55898223a510 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff114c00640 1 -- 172.21.15.40:0/3394840410 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ff124043070 con 0x55898223a510 2024-09-11T22:30:58.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff134a0a740 10 client.15120 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T22:30:58.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff134a0a740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T22:30:58.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff134a0a740 20 client.15120 populate_metadata read hostname 'smithi040' 2024-09-11T22:30:58.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.180+0000 7ff134a0a740 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x5589822ba360 0x5589822b9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:58.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.181+0000 7ff134a0a740 4 client.15120 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:30:58.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.181+0000 7ff134a0a740 1 -- 172.21.15.40:0/3394840410 --> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] -- command(tid 0: {"prefix": "status"}) -- 0x55898219cb30 con 0x5589822ba360 2024-09-11T22:30:58.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.181+0000 7ff12aa00640 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x5589822ba360 0x5589822b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:58.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.181+0000 7ff12aa00640 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x5589822ba360 0x5589822b9070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f28bb309991f9d8 server_cookie=9169dad0b3945278 in_seq=0 out_seq=0 2024-09-11T22:30:58.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.181+0000 7ff114c00640 10 client.15120 ms_handle_connect on v2:172.21.15.146:6838/2365077357 2024-09-11T22:30:58.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff114c00640 1 -- 172.21.15.40:0/3394840410 <== mds.0 v2:172.21.15.146:6838/2365077357 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55898219cb30 con 0x5589822ba360 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff114c00640 10 client.15120 handle_command_reply: tid=0 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 client.15120 shutdown 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 -- 172.21.15.40:0/3394840410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 msgr2=0x55898224e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x55898224e7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff124009bf0 tx=0x7ff12402a8c0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 -- 172.21.15.40:0/3394840410 shutdown_connections 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55898223a510 0x55898224e7a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.146:6838/2365077357,v1:172.21.15.146:6839/2365077357] conn(0x5589822ba360 0x5589822b9070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55898222fc50 0x55898224e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 --2- 172.21.15.40:0/3394840410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55898222f330 0x558982254f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 -- 172.21.15.40:0/3394840410 >> 172.21.15.40:0/3394840410 conn(0x55898222b8c0 msgr2=0x55898222aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff114c00640 0 client.15120 ms_handle_reset on v2:172.21.15.146:6838/2365077357 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 -- 172.21.15.40:0/3394840410 shutdown_connections 2024-09-11T22:30:58.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 1 -- 172.21.15.40:0/3394840410 wait complete. 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.182+0000 7ff134a0a740 20 client.15120 trim_cache size 0 max 16384 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "c836ee3e-708b-11ef-bcea-c7b262605968", 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24527, 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 155.059891099, 2024-09-11T22:30:58.188 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 25, 2024-09-11T22:30:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 95, 2024-09-11T22:30:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 93, 2024-09-11T22:30:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 170.40482988100001 2024-09-11T22:30:58.189 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:30:58.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 -- 172.21.15.40:0/741764763 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff1100a2b80 msgr2=0x7ff1100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff1100a2b80 0x7ff1100a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55898222c720 tx=0x7ff11c00b4a0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 -- 172.21.15.40:0/741764763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c102790 msgr2=0x7ff12c19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c102790 0x7ff12c19ab10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff11800e9f0 tx=0x7ff11800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 -- 172.21.15.40:0/741764763 shutdown_connections 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7ff1100a2b80 0x7ff1100a5040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff12c106f10 0x7ff12c19eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12c102790 0x7ff12c19ab10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 --2- 172.21.15.40:0/741764763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff12c101de0 0x7ff12c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 -- 172.21.15.40:0/741764763 >> 172.21.15.40:0/741764763 conn(0x7ff12c0fd8c0 msgr2=0x7ff12c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 -- 172.21.15.40:0/741764763 shutdown_connections 2024-09-11T22:30:58.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:30:58.183+0000 7ff131e00640 1 -- 172.21.15.40:0/741764763 wait complete. 2024-09-11T22:30:59.141 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T22:30:59.151 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T22:30:59.151 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T22:30:59.151 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T22:30:59.151 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T22:30:59.165 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T22:30:59.166 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-11T22:30:59.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:30:59.166 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-11T22:30:59.203 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-11T22:30:59.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:30:59.204 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:30:59.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:58 smithi040 ceph-mon[30787]: pgmap v385: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:59.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:30:58 smithi040 ceph-mon[30787]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-11T22:30:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:58 smithi177 ceph-mon[35530]: pgmap v385: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:30:58 smithi177 ceph-mon[35530]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-11T22:30:59.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:30:59.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-09-11T22:30:59.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:58 smithi146 ceph-mon[34996]: pgmap v385: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:30:59.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:30:58 smithi146 ceph-mon[34996]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-11T22:30:59.618 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-11T22:30:59.618 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:30:59.618 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:30:59.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T22:30:59.996 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:31:00.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.563+0000 7faf9f600640 1 -- 172.21.15.40:0/2803618052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf98104010 msgr2=0x7faf981043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.563+0000 7faf9f600640 1 --2- 172.21.15.40:0/2803618052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf98104010 0x7faf981043f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faf88009900 tx=0x7faf8802a410 comp rx=0 tx=0).stop 2024-09-11T22:31:00.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.563+0000 7faf9f600640 1 -- 172.21.15.40:0/2803618052 shutdown_connections 2024-09-11T22:31:00.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.563+0000 7faf9f600640 1 --2- 172.21.15.40:0/2803618052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf98109140 0x7faf98110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.563+0000 7faf9f600640 1 --2- 172.21.15.40:0/2803618052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf981049c0 0x7faf98108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.563+0000 7faf9f600640 1 --2- 172.21.15.40:0/2803618052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf98104010 0x7faf981043f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.563+0000 7faf9f600640 1 -- 172.21.15.40:0/2803618052 >> 172.21.15.40:0/2803618052 conn(0x7faf980ffa50 msgr2=0x7faf98101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:00.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.563+0000 7faf9f600640 1 -- 172.21.15.40:0/2803618052 shutdown_connections 2024-09-11T22:31:00.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.563+0000 7faf9f600640 1 -- 172.21.15.40:0/2803618052 wait complete. 2024-09-11T22:31:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.565+0000 7faf9f600640 1 Processor -- start 2024-09-11T22:31:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.565+0000 7faf9f600640 1 -- start start 2024-09-11T22:31:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.565+0000 7faf9f600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf98104010 0x7faf9819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.565+0000 7faf9f600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf981049c0 0x7faf9819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.565+0000 7faf9f600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf98109140 0x7faf9819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.565+0000 7faf9f600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faf981141b0 con 0x7faf981049c0 2024-09-11T22:31:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.565+0000 7faf9f600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf98114030 con 0x7faf98104010 2024-09-11T22:31:00.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.565+0000 7faf9f600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf98114330 con 0x7faf98109140 2024-09-11T22:31:00.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf9cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf98104010 0x7faf9819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf9d600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf98109140 0x7faf9819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf8fe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf981049c0 0x7faf9819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf9cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf98104010 0x7faf9819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:41678/0 (socket says 172.21.15.40:41678) 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf9cc00640 1 -- 172.21.15.40:0/2060810121 learned_addr learned my addr 172.21.15.40:0/2060810121 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf9d600640 1 -- 172.21.15.40:0/2060810121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf98104010 msgr2=0x7faf9819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf9d600640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf98104010 0x7faf9819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf9d600640 1 -- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf981049c0 msgr2=0x7faf9819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf9d600640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf981049c0 0x7faf9819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf9d600640 1 -- 172.21.15.40:0/2060810121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9819f640 con 0x7faf98109140 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.566+0000 7faf8fe00640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf981049c0 0x7faf9819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.567+0000 7faf9d600640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf98109140 0x7faf9819ef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faf9000da10 tx=0x7faf9000ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.567+0000 7faf96000640 1 -- 172.21.15.40:0/2060810121 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9000bd70 con 0x7faf98109140 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.567+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9819f930 con 0x7faf98109140 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.567+0000 7faf96000640 1 -- 172.21.15.40:0/2060810121 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf90003e50 con 0x7faf98109140 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.567+0000 7faf96000640 1 -- 172.21.15.40:0/2060810121 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf900106a0 con 0x7faf98109140 2024-09-11T22:31:00.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.567+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf981a7210 con 0x7faf98109140 2024-09-11T22:31:00.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.568+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf981043f0 con 0x7faf98109140 2024-09-11T22:31:00.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.570+0000 7faf96000640 1 -- 172.21.15.40:0/2060810121 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7faf90003970 con 0x7faf98109140 2024-09-11T22:31:00.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.571+0000 7faf96000640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf7c0a2c00 0x7faf7c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:00.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.571+0000 7faf96000640 1 -- 172.21.15.40:0/2060810121 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7faf900cf720 con 0x7faf98109140 2024-09-11T22:31:00.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.572+0000 7faf9cc00640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf7c0a2c00 0x7faf7c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:00.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.572+0000 7faf9cc00640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf7c0a2c00 0x7faf7c0a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf880096c0 tx=0x7faf880046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:00.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.575+0000 7faf96000640 1 -- 172.21.15.40:0/2060810121 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf9009c290 con 0x7faf98109140 2024-09-11T22:31:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.798+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7faf9802d7c0 con 0x7faf98109140 2024-09-11T22:31:00.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.798+0000 7faf96000640 1 -- 172.21.15.40:0/2060810121 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+88 (secure 0 0 0) 0x7faf9009bb90 con 0x7faf98109140 2024-09-11T22:31:00.802 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T22:31:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf7c0a2c00 msgr2=0x7faf7c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf7c0a2c00 0x7faf7c0a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faf880096c0 tx=0x7faf880046c0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf98109140 msgr2=0x7faf9819ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf98109140 0x7faf9819ef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faf9000da10 tx=0x7faf9000ded0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 shutdown_connections 2024-09-11T22:31:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7faf7c0a2c00 0x7faf7c0a50c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf98109140 0x7faf9819ef60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf981049c0 0x7faf9819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 --2- 172.21.15.40:0/2060810121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf98104010 0x7faf9819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:00.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 >> 172.21.15.40:0/2060810121 conn(0x7faf980ffa50 msgr2=0x7faf98100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:00.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 shutdown_connections 2024-09-11T22:31:00.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:00.801+0000 7faf9f600640 1 -- 172.21.15.40:0/2060810121 wait complete. 2024-09-11T22:31:01.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:00 smithi040 ceph-mon[30787]: pgmap v386: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T22:31:01.180 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:00 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2060810121' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:31:01.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:00 smithi177 ceph-mon[35530]: pgmap v386: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T22:31:01.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:00 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2060810121' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:31:01.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:00 smithi146 ceph-mon[34996]: pgmap v386: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T22:31:01.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:00 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2060810121' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T22:31:01.672 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T22:31:01.672 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:31:01.672 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-11T22:31:01.673 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:31:01.673 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:31:01.673 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T22:31:01.673 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:31:01.673 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:31:01.673 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:31:01.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:31:01.673 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-11T22:31:01.711 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-11T22:31:01.712 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:31:01.713 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-11T22:31:01.713 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-11T22:31:01.713 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T22:31:01.713 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42047sec preferred_lft 42047sec 2024-09-11T22:31:01.713 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-11T22:31:01.713 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:31:01.713 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:31:01.713 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-11T22:31:01.713 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-11T22:31:01.713 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T22:31:01.714 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:31:01.714 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:31:01.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-09-11T22:31:01.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-09-11T22:31:01.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-09-11T22:31:01.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T22:31:01.714 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:31:01.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:31:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:31:01.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:31:01.942 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:31:01.997 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-11T22:31:02.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:31:02.001 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-11T22:31:02.037 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-11T22:31:02.038 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:31:02.038 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T22:31:02.038 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T22:31:02.038 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:31:02.038 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:31:02.038 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:31:02.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T22:31:02.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T22:31:02.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T22:31:02.039 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:31:02.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:31:02.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:31:02.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:31:02.239 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-11T22:31:02.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:31:02.275 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-09-11T22:31:02.351 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:31:02.351 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:31:02.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:31:02.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T22:31:02.351 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:31:02.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:31:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:31:02.529 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T22:31:02.530 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:31:02.530 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:31:02.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T22:31:02.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T22:31:02.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T22:31:02.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T22:31:02.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T22:31:02.531 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:31:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:31:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:31:02.753 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:31:02.753 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-11T22:31:02.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-09-11T22:31:02.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T22:31:02.753 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-11T22:31:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:31:02.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:31:02.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:31:02.921 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:31:02.957 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:31:02.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:31:02.957 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:31:03.032 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-11T22:31:03.032 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-11T22:31:03.032 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/3afc77d6-9cb9-46ce-97b9-46e96430fc46 2024-09-11T22:31:03.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:31:03.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/3afc77d6-9cb9-46ce-97b9-46e96430fc46 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-11T22:31:03.120 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:02 smithi040 ceph-mon[30787]: pgmap v387: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T22:31:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-11T22:31:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-11T22:31:03.161 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2024-09-11T22:31:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:02 smithi177 ceph-mon[35530]: pgmap v387: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T22:31:03.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:02 smithi146 ceph-mon[34996]: pgmap v387: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T22:31:03.792 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-11T22:31:03.792 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-11T22:31:03.792 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2024-09-11T22:31:03.793 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:6789,172.21.15.146:6789,172.21.15.177:6789" 2024-09-11T22:31:03.793 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.40:6789,172.21.15.146:6789,172.21.15.177:6789:/volumes/qa/sv_1/3afc77d6-9cb9-46ce-97b9-46e96430fc46 2024-09-11T22:31:03.793 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=c836ee3e-708b-11ef-bcea-c7b262605968" will pass to kernel 2024-09-11T22:31:03.795 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T22:31:03.795 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2024-09-11T22:31:03.795 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T22:31:03.795 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T22:31:03.796 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T22:31:03.798 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T22:31:03.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:31:03.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:31:03.858 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:31:03.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:31:03.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:31:03.952 INFO:teuthology.orchestra.run.smithi040.stdout:client25127 2024-09-11T22:31:03.952 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:31:03.952 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:31:03.989 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:31:04.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:31:04.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:31:04.118 INFO:teuthology.orchestra.run.smithi040.stdout:client25127 2024-09-11T22:31:04.118 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T22:31:04.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:31:04.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:31:04.209 INFO:teuthology.orchestra.run.smithi040.stdout:client25127 2024-09-11T22:31:04.209 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c836ee3e-708b-11ef-bcea-c7b262605968.client25127/status') 2024-09-11T22:31:04.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:31:04.310 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.25127 (3)172.21.15.40:0/2726831154 2024-09-11T22:31:04.310 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2024-09-11T22:31:04.310 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2024-09-11T22:31:04.311 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2024-09-11T22:31:04.311 INFO:teuthology.orchestra.run.smithi040.stderr:71 bytes copied, 7.2393e-05 s, 981 kB/s 2024-09-11T22:31:04.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:31:04.321 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T22:31:04.332 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T22:31:04.332 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T22:31:04.332 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-11T22:31:04.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.487+0000 7f5ff3e00640 1 -- 172.21.15.40:0/1979651044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 msgr2=0x7f5fec078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.487+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/1979651044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 0x7f5fec078250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009900 tx=0x7f5fd802a410 comp rx=0 tx=0).stop 2024-09-11T22:31:04.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.487+0000 7f5ff3e00640 1 -- 172.21.15.40:0/1979651044 shutdown_connections 2024-09-11T22:31:04.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.487+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/1979651044 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fec078790 0x7f5fec079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.487+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/1979651044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 0x7f5fec078250 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.487+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/1979651044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec076bb0 0x7f5fec076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.487+0000 7f5ff3e00640 1 -- 172.21.15.40:0/1979651044 >> 172.21.15.40:0/1979651044 conn(0x7f5fec0ff4e0 msgr2=0x7f5fec101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:04.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.487+0000 7f5ff3e00640 1 -- 172.21.15.40:0/1979651044 shutdown_connections 2024-09-11T22:31:04.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.488+0000 7f5ff3e00640 1 -- 172.21.15.40:0/1979651044 wait complete. 2024-09-11T22:31:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.488+0000 7f5ff3e00640 1 Processor -- start 2024-09-11T22:31:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff3e00640 1 -- start start 2024-09-11T22:31:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec076bb0 0x7f5fec19e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff3e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 0x7f5fec19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fec078790 0x7f5fec1a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff3e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec113e30 con 0x7f5fec077df0 2024-09-11T22:31:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff3e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec113cb0 con 0x7f5fec076bb0 2024-09-11T22:31:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec113fb0 con 0x7f5fec078790 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 0x7f5fec19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff0a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 0x7f5fec19e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56998/0 (socket says 172.21.15.40:56998) 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff0a00640 1 -- 172.21.15.40:0/3486859231 learned_addr learned my addr 172.21.15.40:0/3486859231 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff1400640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec076bb0 0x7f5fec19e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.489+0000 7f5ff1e00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fec078790 0x7f5fec1a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5ff0a00640 1 -- 172.21.15.40:0/3486859231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fec078790 msgr2=0x7f5fec1a59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5ff0a00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fec078790 0x7f5fec1a59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5ff0a00640 1 -- 172.21.15.40:0/3486859231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec076bb0 msgr2=0x7f5fec19e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5ff0a00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec076bb0 0x7f5fec19e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5ff0a00640 1 -- 172.21.15.40:0/3486859231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec1a6030 con 0x7f5fec077df0 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5ff0a00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 0x7f5fec19e950 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009230 tx=0x7f5fd8031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5fea000640 1 -- 172.21.15.40:0/3486859231 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd803f030 con 0x7f5fec077df0 2024-09-11T22:31:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5fea000640 1 -- 172.21.15.40:0/3486859231 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fd8003ad0 con 0x7f5fec077df0 2024-09-11T22:31:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fec1a62c0 con 0x7f5fec077df0 2024-09-11T22:31:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5fea000640 1 -- 172.21.15.40:0/3486859231 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8035070 con 0x7f5fec077df0 2024-09-11T22:31:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.490+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fec1a6800 con 0x7f5fec077df0 2024-09-11T22:31:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.491+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fec1106d0 con 0x7f5fec077df0 2024-09-11T22:31:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.493+0000 7f5fea000640 1 -- 172.21.15.40:0/3486859231 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f5fd8042030 con 0x7f5fec077df0 2024-09-11T22:31:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.495+0000 7f5fea000640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5fd40a2cb0 0x7f5fd40a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.495+0000 7f5fea000640 1 -- 172.21.15.40:0/3486859231 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f5fd80ef890 con 0x7f5fec077df0 2024-09-11T22:31:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.495+0000 7f5ff1400640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5fd40a2cb0 0x7f5fd40a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.496+0000 7f5ff1400640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5fd40a2cb0 0x7f5fd40a5170 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0005d00 tx=0x7f5fe000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:04.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.499+0000 7f5fea000640 1 -- 172.21.15.40:0/3486859231 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5fd80bbdb0 con 0x7f5fec077df0 2024-09-11T22:31:04.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.721+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f5fec062df0 con 0x7f5fec077df0 2024-09-11T22:31:04.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.940+0000 7f5fea000640 1 -- 172.21.15.40:0/3486859231 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f5fd80c00b0 con 0x7f5fec077df0 2024-09-11T22:31:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5fd40a2cb0 msgr2=0x7f5fd40a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5fd40a2cb0 0x7f5fd40a5170 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0005d00 tx=0x7f5fe000b410 comp rx=0 tx=0).stop 2024-09-11T22:31:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 msgr2=0x7f5fec19e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 0x7f5fec19e950 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009230 tx=0x7f5fd8031b60 comp rx=0 tx=0).stop 2024-09-11T22:31:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 shutdown_connections 2024-09-11T22:31:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f5fd40a2cb0 0x7f5fd40a5170 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5fec078790 0x7f5fec1a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5fec077df0 0x7f5fec19e950 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 --2- 172.21.15.40:0/3486859231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fec076bb0 0x7f5fec19e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.942+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 >> 172.21.15.40:0/3486859231 conn(0x7f5fec0ff4e0 msgr2=0x7f5fec100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.943+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 shutdown_connections 2024-09-11T22:31:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:31:04.943+0000 7f5ff3e00640 1 -- 172.21.15.40:0/3486859231 wait complete. 2024-09-11T22:31:04.961 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T22:31:04.972 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T22:31:04.985 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T22:31:04.986 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T22:31:04.986 INFO:tasks.workunit:timeout=3h 2024-09-11T22:31:04.986 INFO:tasks.workunit:cleanup=True 2024-09-11T22:31:04.986 DEBUG:teuthology.orchestra.run.smithi040:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T22:31:05.022 INFO:teuthology.orchestra.run.smithi040.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T22:31:05.022 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-11T22:31:05.023 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-11T22:31:05.023 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:31:05.023 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-11T22:31:05.023 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-11 22:29:25.122458960 +0000 2024-09-11T22:31:05.023 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-11 22:29:25.122458960 +0000 2024-09-11T22:31:05.023 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-11 22:31:03.853095290 +0000 2024-09-11T22:31:05.023 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-11 22:29:25.122458960 +0000 2024-09-11T22:31:05.024 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T22:31:05.024 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T22:31:05.130 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T22:31:05.169 INFO:tasks.workunit.client.0.smithi040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T22:31:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:04 smithi040 ceph-mon[30787]: pgmap v388: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-11T22:31:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:04 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3486859231' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-11T22:31:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:04 smithi177 ceph-mon[35530]: pgmap v388: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-11T22:31:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:04 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3486859231' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-11T22:31:05.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:04 smithi146 ceph-mon[34996]: pgmap v388: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-11T22:31:05.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:04 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3486859231' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-11T22:31:06.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:05 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3486859231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-11T22:31:06.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:05 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:31:06.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:05 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3486859231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-11T22:31:06.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:05 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:31:06.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:05 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3486859231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-11T22:31:06.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:05 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:31:07.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:06 smithi040 ceph-mon[30787]: pgmap v389: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T22:31:07.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:06 smithi177 ceph-mon[35530]: pgmap v389: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T22:31:07.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:06 smithi146 ceph-mon[34996]: pgmap v389: 129 pgs: 129 active+clean; 643 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T22:31:09.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:08 smithi040 ceph-mon[30787]: pgmap v390: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T22:31:09.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:08 smithi177 ceph-mon[35530]: pgmap v390: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T22:31:09.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:08 smithi146 ceph-mon[34996]: pgmap v390: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T22:31:11.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:10 smithi040 ceph-mon[30787]: pgmap v391: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-11T22:31:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:10 smithi177 ceph-mon[35530]: pgmap v391: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-11T22:31:11.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:10 smithi146 ceph-mon[34996]: pgmap v391: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-11T22:31:13.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:12 smithi040 ceph-mon[30787]: pgmap v392: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T22:31:13.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:12 smithi177 ceph-mon[35530]: pgmap v392: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T22:31:13.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:12 smithi146 ceph-mon[34996]: pgmap v392: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-09-11T22:31:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:14 smithi040 ceph-mon[30787]: pgmap v393: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T22:31:15.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:14 smithi177 ceph-mon[35530]: pgmap v393: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T22:31:15.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:14 smithi146 ceph-mon[34996]: pgmap v393: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T22:31:17.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:16 smithi040 ceph-mon[30787]: pgmap v394: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-11T22:31:17.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:16 smithi177 ceph-mon[35530]: pgmap v394: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-11T22:31:17.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:16 smithi146 ceph-mon[34996]: pgmap v394: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-11T22:31:18.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:18 smithi177 ceph-mon[35530]: pgmap v395: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T22:31:18.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:18 smithi146 ceph-mon[34996]: pgmap v395: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T22:31:18.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:18 smithi040 ceph-mon[30787]: pgmap v395: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T22:31:20.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:20 smithi040 ceph-mon[30787]: pgmap v396: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T22:31:20.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:20 smithi177 ceph-mon[35530]: pgmap v396: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T22:31:20.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:20 smithi146 ceph-mon[34996]: pgmap v396: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T22:31:22.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:22 smithi040 ceph-mon[30787]: pgmap v397: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T22:31:22.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:22 smithi177 ceph-mon[35530]: pgmap v397: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T22:31:22.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:22 smithi146 ceph-mon[34996]: pgmap v397: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T22:31:23.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:23 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:31:23.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:23 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:31:23.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:23 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:31:24.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:24 smithi040 ceph-mon[30787]: pgmap v398: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:31:24.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:31:24.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:31:24.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:24 smithi177 ceph-mon[35530]: pgmap v398: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:31:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:31:24.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:31:24.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:24 smithi146 ceph-mon[34996]: pgmap v398: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:31:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:24.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:31:24.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:31:24.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:31:26.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:26 smithi040 ceph-mon[30787]: pgmap v399: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:26.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:26 smithi177 ceph-mon[35530]: pgmap v399: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:26.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:26 smithi146 ceph-mon[34996]: pgmap v399: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:28.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:28 smithi040 ceph-mon[30787]: pgmap v400: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:31:28.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:28 smithi177 ceph-mon[35530]: pgmap v400: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:31:28.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:28 smithi146 ceph-mon[34996]: pgmap v400: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:31:30.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:30 smithi040 ceph-mon[30787]: pgmap v401: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:31:30.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:30 smithi177 ceph-mon[35530]: pgmap v401: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:31:30.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:30 smithi146 ceph-mon[34996]: pgmap v401: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:31:32.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:32 smithi040 ceph-mon[30787]: pgmap v402: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:32.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:32 smithi177 ceph-mon[35530]: pgmap v402: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:32.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:32 smithi146 ceph-mon[34996]: pgmap v402: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:34.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:34 smithi040 ceph-mon[30787]: pgmap v403: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:31:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:34 smithi177 ceph-mon[35530]: pgmap v403: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:31:34.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:34 smithi146 ceph-mon[34996]: pgmap v403: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:31:36.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:36 smithi040 ceph-mon[30787]: pgmap v404: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:36 smithi177 ceph-mon[35530]: pgmap v404: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:36.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:36 smithi146 ceph-mon[34996]: pgmap v404: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:38.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:38 smithi040 ceph-mon[30787]: pgmap v405: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:31:38.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:38 smithi177 ceph-mon[35530]: pgmap v405: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:31:38.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:38 smithi146 ceph-mon[34996]: pgmap v405: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:31:40.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:40 smithi040 ceph-mon[30787]: pgmap v406: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:31:40.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:40 smithi177 ceph-mon[35530]: pgmap v406: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:31:40.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:40 smithi146 ceph-mon[34996]: pgmap v406: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:31:42.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:42 smithi040 ceph-mon[30787]: pgmap v407: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T22:31:42.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:42 smithi177 ceph-mon[35530]: pgmap v407: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T22:31:42.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:42 smithi146 ceph-mon[34996]: pgmap v407: 129 pgs: 129 active+clean; 654 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T22:31:44.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:44 smithi040 ceph-mon[30787]: pgmap v408: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:31:44.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:44 smithi177 ceph-mon[35530]: pgmap v408: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:31:44.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:44 smithi146 ceph-mon[34996]: pgmap v408: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:31:46.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:46 smithi040 ceph-mon[30787]: pgmap v409: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T22:31:46.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:46 smithi177 ceph-mon[35530]: pgmap v409: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T22:31:46.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:46 smithi146 ceph-mon[34996]: pgmap v409: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T22:31:48.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:48 smithi040 ceph-mon[30787]: pgmap v410: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:31:48.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:48 smithi177 ceph-mon[35530]: pgmap v410: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:31:48.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:48 smithi146 ceph-mon[34996]: pgmap v410: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:31:50.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:50 smithi040 ceph-mon[30787]: pgmap v411: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T22:31:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:50 smithi177 ceph-mon[35530]: pgmap v411: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T22:31:50.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:50 smithi146 ceph-mon[34996]: pgmap v411: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T22:31:52.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:52 smithi040 ceph-mon[30787]: pgmap v412: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T22:31:52.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:52 smithi177 ceph-mon[35530]: pgmap v412: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T22:31:52.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:52 smithi146 ceph-mon[34996]: pgmap v412: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T22:31:54.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:54 smithi040 ceph-mon[30787]: pgmap v413: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T22:31:54.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:54 smithi177 ceph-mon[35530]: pgmap v413: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T22:31:54.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:54 smithi146 ceph-mon[34996]: pgmap v413: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T22:31:56.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:56 smithi040 ceph-mon[30787]: pgmap v414: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:56 smithi177 ceph-mon[35530]: pgmap v414: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:56.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:56 smithi146 ceph-mon[34996]: pgmap v414: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:31:58.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:31:58 smithi040 ceph-mon[30787]: pgmap v415: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:31:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:31:58 smithi177 ceph-mon[35530]: pgmap v415: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:31:58.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:31:58 smithi146 ceph-mon[34996]: pgmap v415: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:32:00.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:00 smithi040 ceph-mon[30787]: pgmap v416: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:32:00.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:00 smithi177 ceph-mon[35530]: pgmap v416: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:32:00.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:00 smithi146 ceph-mon[34996]: pgmap v416: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:32:02.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:02 smithi040 ceph-mon[30787]: pgmap v417: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:32:02.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:02 smithi177 ceph-mon[35530]: pgmap v417: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:32:02.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:02 smithi146 ceph-mon[34996]: pgmap v417: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:32:04.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:04 smithi040 ceph-mon[30787]: pgmap v418: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:32:04.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:04 smithi177 ceph-mon[35530]: pgmap v418: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:32:04.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:04 smithi146 ceph-mon[34996]: pgmap v418: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:32:06.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:06 smithi040 ceph-mon[30787]: pgmap v419: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:32:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:06 smithi177 ceph-mon[35530]: pgmap v419: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:32:06.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:06 smithi146 ceph-mon[34996]: pgmap v419: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:32:08.480 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:08 smithi040 ceph-mon[30787]: pgmap v420: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:32:08.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:08 smithi177 ceph-mon[35530]: pgmap v420: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:32:08.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:08 smithi146 ceph-mon[34996]: pgmap v420: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:32:10.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:10 smithi040 ceph-mon[30787]: pgmap v421: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:32:10.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:10 smithi177 ceph-mon[35530]: pgmap v421: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:32:10.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:10 smithi146 ceph-mon[34996]: pgmap v421: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:32:11.008 INFO:tasks.workunit.client.0.smithi040.stderr:Updating files: 61% (7981/12903) Updating files: 62% (8000/12903) Updating files: 63% (8129/12903) Updating files: 64% (8258/12903) Updating files: 65% (8387/12903) Updating files: 66% (8516/12903) Updating files: 67% (8646/12903) Updating files: 68% (8775/12903) Updating files: 69% (8904/12903) Updating files: 70% (9033/12903) Updating files: 71% (9162/12903) Updating files: 72% (9291/12903) Updating files: 73% (9420/12903) Updating files: 74% (9549/12903) Updating files: 75% (9678/12903) Updating files: 76% (9807/12903) Updating files: 77% (9936/12903) Updating files: 78% (10065/12903) Updating files: 79% (10194/12903) Updating files: 80% (10323/12903) Updating files: 81% (10452/12903) Updating files: 82% (10581/12903) Updating files: 83% (10710/12903) Updating files: 84% (10839/12903) Updating files: 85% (10968/12903) Updating files: 86% (11097/12903) Updating files: 87% (11226/12903) Updating files: 88% (11355/12903) Updating files: 89% (11484/12903) Updating files: 90% (11613/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 97% (12593/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-11T22:32:11.651 INFO:tasks.workunit.client.0.smithi040.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-11T22:32:11.651 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-09-11T22:32:11.651 INFO:tasks.workunit.client.0.smithi040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr: git switch -c 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr:Or undo this operation with: 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr: git switch - 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-09-11T22:32:11.652 INFO:tasks.workunit.client.0.smithi040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T22:32:11.653 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-09-11T22:32:11.653 INFO:tasks.workunit.client.0.smithi040.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-11T22:32:11.666 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T22:32:11.747 INFO:tasks.workunit.client.0.smithi040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T22:32:11.752 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T22:32:11.752 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T22:32:12.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:12 smithi040 ceph-mon[30787]: pgmap v422: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:32:12.505 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T22:32:12.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:12 smithi177 ceph-mon[35530]: pgmap v422: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:32:12.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:12 smithi146 ceph-mon[34996]: pgmap v422: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:32:12.606 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T22:32:12.673 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T22:32:12.676 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T22:32:12.676 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T22:32:12.741 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T22:32:12.749 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:32:12.749 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T22:32:12.825 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-11T22:32:12.826 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-11T22:32:12.826 DEBUG:teuthology.orchestra.run.smithi040:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-11T22:32:12.917 INFO:tasks.workunit.client.0.smithi040.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-11T22:32:12.918 INFO:tasks.workunit.client.0.smithi040.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-11T22:32:12.918 INFO:tasks.workunit.client.0.smithi040.stderr:+ trap -- retry EXIT 2024-09-11T22:32:12.919 INFO:tasks.workunit.client.0.smithi040.stderr:+ rm -rf ffsb 2024-09-11T22:32:12.920 INFO:tasks.workunit.client.0.smithi040.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-11T22:32:12.926 INFO:tasks.workunit.client.0.smithi040.stderr:Cloning into 'ffsb'... 2024-09-11T22:32:13.932 INFO:tasks.workunit.client.0.smithi040.stderr:+ trap - EXIT 2024-09-11T22:32:13.932 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd ffsb 2024-09-11T22:32:13.932 INFO:tasks.workunit.client.0.smithi040.stderr:+ ./configure 2024-09-11T22:32:14.169 INFO:tasks.workunit.client.0.smithi040.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T22:32:14.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:14 smithi040 ceph-mon[30787]: pgmap v423: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:32:14.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:14 smithi177 ceph-mon[35530]: pgmap v423: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:32:14.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:14 smithi146 ceph-mon[34996]: pgmap v423: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:32:15.182 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether build environment is sane... yes 2024-09-11T22:32:15.200 INFO:tasks.workunit.client.0.smithi040.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-11T22:32:15.201 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gawk... gawk 2024-09-11T22:32:15.225 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether make sets $(MAKE)... yes 2024-09-11T22:32:15.294 INFO:tasks.workunit.client.0.smithi040.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-11T22:32:15.294 INFO:tasks.workunit.client.0.smithi040.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-11T22:32:15.311 INFO:tasks.workunit.client.0.smithi040.stdout:checking for style of include used by make... GNU 2024-09-11T22:32:15.316 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc... gcc 2024-09-11T22:32:15.408 INFO:tasks.workunit.client.0.smithi040.stdout:checking for C compiler default output file name... a.out 2024-09-11T22:32:15.412 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether the C compiler works... yes 2024-09-11T22:32:15.416 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are cross compiling... no 2024-09-11T22:32:15.474 INFO:tasks.workunit.client.0.smithi040.stdout:checking for suffix of executables... 2024-09-11T22:32:15.528 INFO:tasks.workunit.client.0.smithi040.stdout:checking for suffix of object files... o 2024-09-11T22:32:15.580 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T22:32:15.634 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether gcc accepts -g... yes 2024-09-11T22:32:15.739 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T22:32:15.873 INFO:tasks.workunit.client.0.smithi040.stdout:checking dependency style of gcc... gcc3 2024-09-11T22:32:15.960 INFO:tasks.workunit.client.0.smithi040.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T22:32:16.037 INFO:tasks.workunit.client.0.smithi040.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-11T22:32:16.040 INFO:tasks.workunit.client.0.smithi040.stdout:checking for egrep... /usr/bin/grep -E 2024-09-11T22:32:16.059 INFO:tasks.workunit.client.0.smithi040.stdout:checking for AIX... no 2024-09-11T22:32:16.079 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc... (cached) gcc 2024-09-11T22:32:16.098 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T22:32:16.100 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T22:32:16.100 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T22:32:16.100 INFO:tasks.workunit.client.0.smithi040.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-11T22:32:16.190 INFO:tasks.workunit.client.0.smithi040.stdout:checking for main in -lm... yes 2024-09-11T22:32:16.278 INFO:tasks.workunit.client.0.smithi040.stdout:checking for main in -lpthread... yes 2024-09-11T22:32:16.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:16 smithi040 ceph-mon[30787]: pgmap v424: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-11T22:32:16.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:16 smithi177 ceph-mon[35530]: pgmap v424: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-11T22:32:16.536 INFO:tasks.workunit.client.0.smithi040.stdout:checking for ANSI C header files... yes 2024-09-11T22:32:16.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:16 smithi146 ceph-mon[34996]: pgmap v424: 129 pgs: 129 active+clean; 659 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-11T22:32:16.634 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-11T22:32:16.707 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/types.h... yes 2024-09-11T22:32:16.786 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/stat.h... yes 2024-09-11T22:32:16.867 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdlib.h... yes 2024-09-11T22:32:16.947 INFO:tasks.workunit.client.0.smithi040.stdout:checking for string.h... yes 2024-09-11T22:32:17.028 INFO:tasks.workunit.client.0.smithi040.stdout:checking for memory.h... yes 2024-09-11T22:32:17.109 INFO:tasks.workunit.client.0.smithi040.stdout:checking for strings.h... yes 2024-09-11T22:32:17.192 INFO:tasks.workunit.client.0.smithi040.stdout:checking for inttypes.h... yes 2024-09-11T22:32:17.273 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdint.h... yes 2024-09-11T22:32:17.357 INFO:tasks.workunit.client.0.smithi040.stdout:checking for unistd.h... yes 2024-09-11T22:32:17.454 INFO:tasks.workunit.client.0.smithi040.stdout:checking pthread.h usability... yes 2024-09-11T22:32:17.493 INFO:tasks.workunit.client.0.smithi040.stdout:checking pthread.h presence... yes 2024-09-11T22:32:17.493 INFO:tasks.workunit.client.0.smithi040.stdout:checking for pthread.h... yes 2024-09-11T22:32:17.584 INFO:tasks.workunit.client.0.smithi040.stdout:checking fcntl.h usability... yes 2024-09-11T22:32:17.620 INFO:tasks.workunit.client.0.smithi040.stdout:checking fcntl.h presence... yes 2024-09-11T22:32:17.621 INFO:tasks.workunit.client.0.smithi040.stdout:checking for fcntl.h... yes 2024-09-11T22:32:17.707 INFO:tasks.workunit.client.0.smithi040.stdout:checking limits.h usability... yes 2024-09-11T22:32:17.743 INFO:tasks.workunit.client.0.smithi040.stdout:checking limits.h presence... yes 2024-09-11T22:32:17.744 INFO:tasks.workunit.client.0.smithi040.stdout:checking for limits.h... yes 2024-09-11T22:32:17.766 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdint.h... (cached) yes 2024-09-11T22:32:17.843 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/time.h usability... yes 2024-09-11T22:32:17.880 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/time.h presence... yes 2024-09-11T22:32:17.881 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/time.h... yes 2024-09-11T22:32:17.903 INFO:tasks.workunit.client.0.smithi040.stdout:checking for unistd.h... (cached) yes 2024-09-11T22:32:17.992 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/vfs.h usability... yes 2024-09-11T22:32:18.028 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/vfs.h presence... yes 2024-09-11T22:32:18.029 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/vfs.h... yes 2024-09-11T22:32:18.107 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/limits.h usability... no 2024-09-11T22:32:18.144 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/limits.h presence... no 2024-09-11T22:32:18.145 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/limits.h... no 2024-09-11T22:32:18.204 INFO:tasks.workunit.client.0.smithi040.stdout:checking for an ANSI C-conforming const... yes 2024-09-11T22:32:18.266 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-11T22:32:18.268 INFO:tasks.workunit.client.0.smithi040.stdout:checking for function prototypes... yes 2024-09-11T22:32:18.318 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether setvbuf arguments are reversed... no 2024-09-11T22:32:18.483 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:18 smithi040 ceph-mon[30787]: pgmap v425: 129 pgs: 129 active+clean; 2.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 152 KiB/s wr, 14 op/s 2024-09-11T22:32:18.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:18 smithi177 ceph-mon[35530]: pgmap v425: 129 pgs: 129 active+clean; 2.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 152 KiB/s wr, 14 op/s 2024-09-11T22:32:18.554 INFO:tasks.workunit.client.0.smithi040.stdout:checking for system... yes 2024-09-11T22:32:18.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:18 smithi146 ceph-mon[34996]: pgmap v425: 129 pgs: 129 active+clean; 2.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 152 KiB/s wr, 14 op/s 2024-09-11T22:32:18.673 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gettimeofday... yes 2024-09-11T22:32:18.777 INFO:tasks.workunit.client.0.smithi040.stdout:checking for mkdir... yes 2024-09-11T22:32:18.880 INFO:tasks.workunit.client.0.smithi040.stdout:checking for strerror... yes 2024-09-11T22:32:18.983 INFO:tasks.workunit.client.0.smithi040.stdout:checking for open64... yes 2024-09-11T22:32:19.086 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stat64... yes 2024-09-11T22:32:19.191 INFO:tasks.workunit.client.0.smithi040.stdout:checking for fseeko64... yes 2024-09-11T22:32:19.340 INFO:tasks.workunit.client.0.smithi040.stdout:checking for lrand48_r... yes 2024-09-11T22:32:19.455 INFO:tasks.workunit.client.0.smithi040.stdout:checking for srand48_r... yes 2024-09-11T22:32:19.495 INFO:tasks.workunit.client.0.smithi040.stdout:configure: creating ./config.status 2024-09-11T22:32:19.693 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating Makefile 2024-09-11T22:32:19.721 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating config.h 2024-09-11T22:32:19.753 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: executing depfiles commands 2024-09-11T22:32:19.849 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: executing default commands 2024-09-11T22:32:19.910 INFO:tasks.workunit.client.0.smithi040.stderr:+ make 2024-09-11T22:32:19.918 INFO:tasks.workunit.client.0.smithi040.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-11T22:32:19.923 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-11T22:32:19.925 INFO:tasks.workunit.client.0.smithi040.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-11T22:32:19.925 INFO:tasks.workunit.client.0.smithi040.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-11T22:32:19.925 INFO:tasks.workunit.client.0.smithi040.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-11T22:32:19.925 INFO:tasks.workunit.client.0.smithi040.stderr: any GNU archive site. 2024-09-11T22:32:19.929 INFO:tasks.workunit.client.0.smithi040.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-11T22:32:19.932 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-11T22:32:19.934 INFO:tasks.workunit.client.0.smithi040.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-11T22:32:19.934 INFO:tasks.workunit.client.0.smithi040.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-11T22:32:19.934 INFO:tasks.workunit.client.0.smithi040.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-11T22:32:19.934 INFO:tasks.workunit.client.0.smithi040.stderr: Grab them from any GNU archive site. 2024-09-11T22:32:19.992 INFO:tasks.workunit.client.0.smithi040.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-11T22:32:20.390 INFO:tasks.workunit.client.0.smithi040.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-11T22:32:20.390 INFO:tasks.workunit.client.0.smithi040.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-11T22:32:20.390 INFO:tasks.workunit.client.0.smithi040.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-11T22:32:20.390 INFO:tasks.workunit.client.0.smithi040.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-11T22:32:20.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:20 smithi040 ceph-mon[30787]: pgmap v426: 129 pgs: 129 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 15 op/s 2024-09-11T22:32:20.520 INFO:tasks.workunit.client.0.smithi040.stdout:/bin/sh ./config.status --recheck 2024-09-11T22:32:20.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:20 smithi177 ceph-mon[35530]: pgmap v426: 129 pgs: 129 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 15 op/s 2024-09-11T22:32:20.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:20 smithi146 ceph-mon[34996]: pgmap v426: 129 pgs: 129 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 160 KiB/s wr, 15 op/s 2024-09-11T22:32:20.633 INFO:tasks.workunit.client.0.smithi040.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-11T22:32:20.814 INFO:tasks.workunit.client.0.smithi040.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T22:32:21.827 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether build environment is sane... yes 2024-09-11T22:32:21.838 INFO:tasks.workunit.client.0.smithi040.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-11T22:32:21.838 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gawk... gawk 2024-09-11T22:32:21.862 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether make sets $(MAKE)... yes 2024-09-11T22:32:21.930 INFO:tasks.workunit.client.0.smithi040.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-11T22:32:21.930 INFO:tasks.workunit.client.0.smithi040.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-11T22:32:21.946 INFO:tasks.workunit.client.0.smithi040.stdout:checking for style of include used by make... GNU 2024-09-11T22:32:21.950 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc... gcc 2024-09-11T22:32:22.079 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether the C compiler works... yes 2024-09-11T22:32:22.079 INFO:tasks.workunit.client.0.smithi040.stdout:checking for C compiler default output file name... a.out 2024-09-11T22:32:22.139 INFO:tasks.workunit.client.0.smithi040.stdout:checking for suffix of executables... 2024-09-11T22:32:22.203 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are cross compiling... no 2024-09-11T22:32:22.258 INFO:tasks.workunit.client.0.smithi040.stdout:checking for suffix of object files... o 2024-09-11T22:32:22.297 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T22:32:22.336 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether gcc accepts -g... yes 2024-09-11T22:32:22.392 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T22:32:22.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:22 smithi040 ceph-mon[30787]: pgmap v427: 129 pgs: 129 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 170 KiB/s wr, 19 op/s 2024-09-11T22:32:22.524 INFO:tasks.workunit.client.0.smithi040.stdout:checking dependency style of gcc... gcc3 2024-09-11T22:32:22.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:22 smithi177 ceph-mon[35530]: pgmap v427: 129 pgs: 129 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 170 KiB/s wr, 19 op/s 2024-09-11T22:32:22.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:22 smithi146 ceph-mon[34996]: pgmap v427: 129 pgs: 129 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 170 KiB/s wr, 19 op/s 2024-09-11T22:32:22.591 INFO:tasks.workunit.client.0.smithi040.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T22:32:22.663 INFO:tasks.workunit.client.0.smithi040.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-11T22:32:22.666 INFO:tasks.workunit.client.0.smithi040.stdout:checking for egrep... /usr/bin/grep -E 2024-09-11T22:32:22.858 INFO:tasks.workunit.client.0.smithi040.stdout:checking for ANSI C header files... yes 2024-09-11T22:32:22.915 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/types.h... yes 2024-09-11T22:32:22.979 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/stat.h... yes 2024-09-11T22:32:23.043 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdlib.h... yes 2024-09-11T22:32:23.108 INFO:tasks.workunit.client.0.smithi040.stdout:checking for string.h... yes 2024-09-11T22:32:23.174 INFO:tasks.workunit.client.0.smithi040.stdout:checking for memory.h... yes 2024-09-11T22:32:23.239 INFO:tasks.workunit.client.0.smithi040.stdout:checking for strings.h... yes 2024-09-11T22:32:23.305 INFO:tasks.workunit.client.0.smithi040.stdout:checking for inttypes.h... yes 2024-09-11T22:32:23.370 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdint.h... yes 2024-09-11T22:32:23.437 INFO:tasks.workunit.client.0.smithi040.stdout:checking for unistd.h... yes 2024-09-11T22:32:23.504 INFO:tasks.workunit.client.0.smithi040.stdout:checking minix/config.h usability... no 2024-09-11T22:32:23.545 INFO:tasks.workunit.client.0.smithi040.stdout:checking minix/config.h presence... no 2024-09-11T22:32:23.545 INFO:tasks.workunit.client.0.smithi040.stdout:checking for minix/config.h... no 2024-09-11T22:32:23.601 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-11T22:32:23.601 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc... (cached) gcc 2024-09-11T22:32:23.654 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T22:32:23.654 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T22:32:23.654 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T22:32:23.654 INFO:tasks.workunit.client.0.smithi040.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-11T22:32:23.722 INFO:tasks.workunit.client.0.smithi040.stdout:checking for main in -lm... yes 2024-09-11T22:32:23.795 INFO:tasks.workunit.client.0.smithi040.stdout:checking for main in -lpthread... yes 2024-09-11T22:32:23.797 INFO:tasks.workunit.client.0.smithi040.stdout:checking for ANSI C header files... (cached) yes 2024-09-11T22:32:23.851 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-11T22:32:23.937 INFO:tasks.workunit.client.0.smithi040.stdout:checking pthread.h usability... yes 2024-09-11T22:32:23.965 INFO:tasks.workunit.client.0.smithi040.stdout:checking pthread.h presence... yes 2024-09-11T22:32:23.965 INFO:tasks.workunit.client.0.smithi040.stdout:checking for pthread.h... yes 2024-09-11T22:32:24.042 INFO:tasks.workunit.client.0.smithi040.stdout:checking fcntl.h usability... yes 2024-09-11T22:32:24.069 INFO:tasks.workunit.client.0.smithi040.stdout:checking fcntl.h presence... yes 2024-09-11T22:32:24.069 INFO:tasks.workunit.client.0.smithi040.stdout:checking for fcntl.h... yes 2024-09-11T22:32:24.144 INFO:tasks.workunit.client.0.smithi040.stdout:checking limits.h usability... yes 2024-09-11T22:32:24.172 INFO:tasks.workunit.client.0.smithi040.stdout:checking limits.h presence... yes 2024-09-11T22:32:24.172 INFO:tasks.workunit.client.0.smithi040.stdout:checking for limits.h... yes 2024-09-11T22:32:24.197 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stdint.h... (cached) yes 2024-09-11T22:32:24.261 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/time.h usability... yes 2024-09-11T22:32:24.287 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/time.h presence... yes 2024-09-11T22:32:24.287 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/time.h... yes 2024-09-11T22:32:24.311 INFO:tasks.workunit.client.0.smithi040.stdout:checking for unistd.h... (cached) yes 2024-09-11T22:32:24.381 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/vfs.h usability... yes 2024-09-11T22:32:24.408 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/vfs.h presence... yes 2024-09-11T22:32:24.408 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/vfs.h... yes 2024-09-11T22:32:24.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:24 smithi040 ceph-mon[30787]: pgmap v428: 129 pgs: 129 active+clean; 4.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 387 KiB/s wr, 49 op/s 2024-09-11T22:32:24.494 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/limits.h usability... no 2024-09-11T22:32:24.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:24 smithi177 ceph-mon[35530]: pgmap v428: 129 pgs: 129 active+clean; 4.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 387 KiB/s wr, 49 op/s 2024-09-11T22:32:24.535 INFO:tasks.workunit.client.0.smithi040.stdout:checking sys/limits.h presence... no 2024-09-11T22:32:24.535 INFO:tasks.workunit.client.0.smithi040.stdout:checking for sys/limits.h... no 2024-09-11T22:32:24.578 INFO:tasks.workunit.client.0.smithi040.stdout:checking for an ANSI C-conforming const... yes 2024-09-11T22:32:24.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:24 smithi146 ceph-mon[34996]: pgmap v428: 129 pgs: 129 active+clean; 4.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 387 KiB/s wr, 49 op/s 2024-09-11T22:32:24.634 INFO:tasks.workunit.client.0.smithi040.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-11T22:32:24.722 INFO:tasks.workunit.client.0.smithi040.stdout:checking for system... yes 2024-09-11T22:32:24.811 INFO:tasks.workunit.client.0.smithi040.stdout:checking for gettimeofday... yes 2024-09-11T22:32:24.901 INFO:tasks.workunit.client.0.smithi040.stdout:checking for mkdir... yes 2024-09-11T22:32:24.992 INFO:tasks.workunit.client.0.smithi040.stdout:checking for strerror... yes 2024-09-11T22:32:25.083 INFO:tasks.workunit.client.0.smithi040.stdout:checking for open64... yes 2024-09-11T22:32:25.174 INFO:tasks.workunit.client.0.smithi040.stdout:checking for stat64... yes 2024-09-11T22:32:25.266 INFO:tasks.workunit.client.0.smithi040.stdout:checking for fseeko64... yes 2024-09-11T22:32:25.356 INFO:tasks.workunit.client.0.smithi040.stdout:checking for lrand48_r... yes 2024-09-11T22:32:25.445 INFO:tasks.workunit.client.0.smithi040.stdout:checking for srand48_r... yes 2024-09-11T22:32:25.481 INFO:tasks.workunit.client.0.smithi040.stdout:configure: creating ./config.status 2024-09-11T22:32:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:32:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:32:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:32:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:32:25.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:32:25.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:32:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:32:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:32:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:32:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:32:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:32:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:32:25.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:32:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:32:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:32:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:32:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:32:25.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:32:25.594 INFO:tasks.workunit.client.0.smithi040.stdout: /bin/sh ./config.status 2024-09-11T22:32:25.685 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating Makefile 2024-09-11T22:32:25.709 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating config.h 2024-09-11T22:32:25.740 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: executing depfiles commands 2024-09-11T22:32:25.768 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: executing default commands 2024-09-11T22:32:25.794 INFO:tasks.workunit.client.0.smithi040.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-11T22:32:25.991 INFO:tasks.workunit.client.0.smithi040.stdout:rm -f stamp-h1 2024-09-11T22:32:25.993 INFO:tasks.workunit.client.0.smithi040.stdout:touch config.h.in 2024-09-11T22:32:25.996 INFO:tasks.workunit.client.0.smithi040.stdout:cd . && /bin/sh ./config.status config.h 2024-09-11T22:32:26.073 INFO:tasks.workunit.client.0.smithi040.stdout:config.status: creating config.h 2024-09-11T22:32:26.109 INFO:tasks.workunit.client.0.smithi040.stdout:make all-am 2024-09-11T22:32:26.117 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-11T22:32:26.117 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-11T22:32:26.341 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-11T22:32:26.346 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-11T22:32:26.466 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-11T22:32:26.471 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-11T22:32:26.583 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-11T22:32:26.588 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-11T22:32:26.705 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-11T22:32:26.709 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-11T22:32:26.872 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-11T22:32:26.877 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-11T22:32:26.949 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-11T22:32:26.954 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-11T22:32:26.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:26 smithi040 ceph-mon[30787]: pgmap v429: 129 pgs: 129 active+clean; 4.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 388 KiB/s wr, 48 op/s 2024-09-11T22:32:27.016 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-11T22:32:27.021 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-11T22:32:27.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:26 smithi177 ceph-mon[35530]: pgmap v429: 129 pgs: 129 active+clean; 4.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 388 KiB/s wr, 48 op/s 2024-09-11T22:32:27.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:26 smithi146 ceph-mon[34996]: pgmap v429: 129 pgs: 129 active+clean; 4.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 388 KiB/s wr, 48 op/s 2024-09-11T22:32:27.090 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-11T22:32:27.095 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-11T22:32:27.337 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-11T22:32:27.342 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-11T22:32:27.501 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-11T22:32:27.506 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-11T22:32:27.683 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-11T22:32:27.689 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-11T22:32:27.781 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-11T22:32:27.787 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-11T22:32:27.883 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-11T22:32:27.888 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-11T22:32:28.023 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-11T22:32:28.028 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-11T22:32:28.071 INFO:tasks.workunit.client.0.smithi040.stderr:In file included from parser.h:22, 2024-09-11T22:32:28.071 INFO:tasks.workunit.client.0.smithi040.stderr: from parser.c:25: 2024-09-11T22:32:28.071 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c: In function ‘init_filesys’: 2024-09-11T22:32:28.071 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-09-11T22:32:28.072 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:32:28.073 INFO:tasks.workunit.client.0.smithi040.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-09-11T22:32:28.074 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-09-11T22:32:28.075 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.076 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:32:28.077 INFO:tasks.workunit.client.0.smithi040.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T22:32:28.078 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:32:28.079 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr: | ^ 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~ 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:32:28.080 INFO:tasks.workunit.client.0.smithi040.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:32:28.081 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:32:28.081 INFO:tasks.workunit.client.0.smithi040.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:32:28.081 INFO:tasks.workunit.client.0.smithi040.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T22:32:28.081 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~ 2024-09-11T22:32:28.081 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:32:28.081 INFO:tasks.workunit.client.0.smithi040.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-11T22:32:28.081 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.124 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c: In function ‘get_optstr’: 2024-09-11T22:32:28.124 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-11T22:32:28.124 INFO:tasks.workunit.client.0.smithi040.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-11T22:32:28.125 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.125 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:200:14: note: source object declared here 2024-09-11T22:32:28.125 INFO:tasks.workunit.client.0.smithi040.stderr: 200 | char temp[BUFSIZE]; 2024-09-11T22:32:28.125 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~ 2024-09-11T22:32:28.131 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c: In function ‘size64_convert’: 2024-09-11T22:32:28.131 INFO:tasks.workunit.client.0.smithi040.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-11T22:32:28.131 INFO:tasks.workunit.client.0.smithi040.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-11T22:32:28.132 INFO:tasks.workunit.client.0.smithi040.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-11T22:32:28.461 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-11T22:32:28.467 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-11T22:32:28.546 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-11T22:32:28.551 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-11T22:32:28.673 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-11T22:32:28.678 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-11T22:32:28.726 INFO:tasks.workunit.client.0.smithi040.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-11T22:32:28.733 INFO:tasks.workunit.client.0.smithi040.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-11T22:32:28.785 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-11T22:32:28.785 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd .. 2024-09-11T22:32:28.785 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir tmp 2024-09-11T22:32:28.789 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd tmp 2024-09-11T22:32:28.789 INFO:tasks.workunit.client.0.smithi040.stderr:+ for f in $mydir/*.ffsb 2024-09-11T22:32:28.789 INFO:tasks.workunit.client.0.smithi040.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-11T22:32:28.790 INFO:tasks.workunit.client.0.smithi040.stdout:FFSB version 6.0-RC2 started 2024-09-11T22:32:28.790 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:32:28.796 INFO:tasks.workunit.client.0.smithi040.stdout:benchmark time = 300 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout:ThreadGroup 0 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout:================ 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: num_threads = 32 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: read_random = off 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: read_size = 0 (0B) 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: read_blocksize = 0 (0B) 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: read_skip = off 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: read_skipsize = 0 (0B) 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: write_random = on 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: write_size = 5242880 (5MB) 2024-09-11T22:32:28.797 INFO:tasks.workunit.client.0.smithi040.stdout: fsync_file = 0 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: write_blocksize = 4096 (4KB) 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: wait time = 0 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: op weights 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: read = 0 (0.00%) 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: readall = 0 (0.00%) 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: write = 1 (100.00%) 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: create = 0 (0.00%) 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: append = 0 (0.00%) 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: delete = 0 (0.00%) 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: metaop = 0 (0.00%) 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: createdir = 0 (0.00%) 2024-09-11T22:32:28.798 INFO:tasks.workunit.client.0.smithi040.stdout: stat = 0 (0.00%) 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: writeall = 0 (0.00%) 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: writeall_fsync = 0 (0.00%) 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: open_close = 0 (0.00%) 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: write_fsync = 0 (0.00%) 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: create_fsync = 0 (0.00%) 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: append_fsync = 0 (0.00%) 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout:FileSystem . 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout:========== 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: num_dirs = 0 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: starting files = 128 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:32:28.799 INFO:tasks.workunit.client.0.smithi040.stdout: min file size = 104857600 (100MB) 2024-09-11T22:32:28.800 INFO:tasks.workunit.client.0.smithi040.stdout: max file size = 104857600 (100MB) 2024-09-11T22:32:28.800 INFO:tasks.workunit.client.0.smithi040.stdout: directio = off 2024-09-11T22:32:28.800 INFO:tasks.workunit.client.0.smithi040.stdout: alignedio = on 2024-09-11T22:32:28.800 INFO:tasks.workunit.client.0.smithi040.stdout: bufferedio = off 2024-09-11T22:32:28.800 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:32:28.800 INFO:tasks.workunit.client.0.smithi040.stdout: aging is off 2024-09-11T22:32:28.801 INFO:tasks.workunit.client.0.smithi040.stdout: current utilization = 0.03% 2024-09-11T22:32:28.801 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:32:28.801 INFO:tasks.workunit.client.0.smithi040.stdout:checking existing fs: . 2024-09-11T22:32:28.801 INFO:tasks.workunit.client.0.smithi040.stdout:recreating new fileset 2024-09-11T22:32:28.801 INFO:tasks.workunit.client.0.smithi040.stderr:opendir: No such file or directory 2024-09-11T22:32:28.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:28 smithi040 ceph-mon[30787]: pgmap v430: 129 pgs: 129 active+clean; 6.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 522 KiB/s wr, 57 op/s 2024-09-11T22:32:29.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:28 smithi177 ceph-mon[35530]: pgmap v430: 129 pgs: 129 active+clean; 6.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 522 KiB/s wr, 57 op/s 2024-09-11T22:32:29.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:28 smithi146 ceph-mon[34996]: pgmap v430: 129 pgs: 129 active+clean; 6.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 522 KiB/s wr, 57 op/s 2024-09-11T22:32:29.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:29 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:32:30.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:29 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:32:30.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:29 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:32:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:30 smithi040 ceph-mon[30787]: pgmap v431: 129 pgs: 129 active+clean; 6.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 372 KiB/s wr, 50 op/s 2024-09-11T22:32:31.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:30 smithi177 ceph-mon[35530]: pgmap v431: 129 pgs: 129 active+clean; 6.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 372 KiB/s wr, 50 op/s 2024-09-11T22:32:31.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:30 smithi146 ceph-mon[34996]: pgmap v431: 129 pgs: 129 active+clean; 6.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 372 KiB/s wr, 50 op/s 2024-09-11T22:32:32.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:32 smithi040 ceph-mon[30787]: pgmap v432: 129 pgs: 129 active+clean; 6.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 366 KiB/s wr, 48 op/s 2024-09-11T22:32:33.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:32 smithi177 ceph-mon[35530]: pgmap v432: 129 pgs: 129 active+clean; 6.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 366 KiB/s wr, 48 op/s 2024-09-11T22:32:33.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:32 smithi146 ceph-mon[34996]: pgmap v432: 129 pgs: 129 active+clean; 6.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 366 KiB/s wr, 48 op/s 2024-09-11T22:32:34.871 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:34 smithi040 ceph-mon[30787]: pgmap v433: 129 pgs: 129 active+clean; 6.7 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 424 KiB/s wr, 56 op/s 2024-09-11T22:32:35.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:34 smithi177 ceph-mon[35530]: pgmap v433: 129 pgs: 129 active+clean; 6.7 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 424 KiB/s wr, 56 op/s 2024-09-11T22:32:35.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:34 smithi146 ceph-mon[34996]: pgmap v433: 129 pgs: 129 active+clean; 6.7 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 424 KiB/s wr, 56 op/s 2024-09-11T22:32:36.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:36 smithi040 ceph-mon[30787]: pgmap v434: 129 pgs: 129 active+clean; 11 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 566 KiB/s wr, 32 op/s 2024-09-11T22:32:37.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:36 smithi177 ceph-mon[35530]: pgmap v434: 129 pgs: 129 active+clean; 11 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 566 KiB/s wr, 32 op/s 2024-09-11T22:32:37.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:36 smithi146 ceph-mon[34996]: pgmap v434: 129 pgs: 129 active+clean; 11 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 566 KiB/s wr, 32 op/s 2024-09-11T22:32:38.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:38 smithi040 ceph-mon[30787]: pgmap v435: 129 pgs: 129 active+clean; 36 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 2.7 MiB/s wr, 48 op/s 2024-09-11T22:32:39.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:38 smithi177 ceph-mon[35530]: pgmap v435: 129 pgs: 129 active+clean; 36 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 2.7 MiB/s wr, 48 op/s 2024-09-11T22:32:39.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:38 smithi146 ceph-mon[34996]: pgmap v435: 129 pgs: 129 active+clean; 36 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 2.7 MiB/s wr, 48 op/s 2024-09-11T22:32:40.991 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:40 smithi040 ceph-mon[30787]: pgmap v436: 129 pgs: 129 active+clean; 121 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.7 MiB/s wr, 65 op/s 2024-09-11T22:32:41.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:40 smithi177 ceph-mon[35530]: pgmap v436: 129 pgs: 129 active+clean; 121 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.7 MiB/s wr, 65 op/s 2024-09-11T22:32:41.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:40 smithi146 ceph-mon[34996]: pgmap v436: 129 pgs: 129 active+clean; 121 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 9.7 MiB/s wr, 65 op/s 2024-09-11T22:32:42.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:42 smithi040 ceph-mon[30787]: pgmap v437: 129 pgs: 129 active+clean; 205 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 17 MiB/s wr, 69 op/s 2024-09-11T22:32:43.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:42 smithi177 ceph-mon[35530]: pgmap v437: 129 pgs: 129 active+clean; 205 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 17 MiB/s wr, 69 op/s 2024-09-11T22:32:43.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:42 smithi146 ceph-mon[34996]: pgmap v437: 129 pgs: 129 active+clean; 205 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 17 MiB/s wr, 69 op/s 2024-09-11T22:32:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:44 smithi040 ceph-mon[30787]: pgmap v438: 129 pgs: 129 active+clean; 1.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 88 MiB/s wr, 101 op/s 2024-09-11T22:32:45.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:44 smithi177 ceph-mon[35530]: pgmap v438: 129 pgs: 129 active+clean; 1.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 88 MiB/s wr, 101 op/s 2024-09-11T22:32:45.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:44 smithi146 ceph-mon[34996]: pgmap v438: 129 pgs: 129 active+clean; 1.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 88 MiB/s wr, 101 op/s 2024-09-11T22:32:46.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:46 smithi040 ceph-mon[30787]: pgmap v439: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 112 MiB/s wr, 93 op/s 2024-09-11T22:32:47.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:46 smithi177 ceph-mon[35530]: pgmap v439: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 112 MiB/s wr, 93 op/s 2024-09-11T22:32:47.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:46 smithi146 ceph-mon[34996]: pgmap v439: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 112 MiB/s wr, 93 op/s 2024-09-11T22:32:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:48 smithi040 ceph-mon[30787]: pgmap v440: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 135 MiB/s wr, 108 op/s 2024-09-11T22:32:49.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:48 smithi177 ceph-mon[35530]: pgmap v440: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 135 MiB/s wr, 108 op/s 2024-09-11T22:32:49.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:48 smithi146 ceph-mon[34996]: pgmap v440: 129 pgs: 129 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 135 MiB/s wr, 108 op/s 2024-09-11T22:32:50.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:50 smithi040 ceph-mon[30787]: pgmap v441: 129 pgs: 129 active+clean; 2.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 208 MiB/s wr, 110 op/s 2024-09-11T22:32:51.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:50 smithi177 ceph-mon[35530]: pgmap v441: 129 pgs: 129 active+clean; 2.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 208 MiB/s wr, 110 op/s 2024-09-11T22:32:51.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:50 smithi146 ceph-mon[34996]: pgmap v441: 129 pgs: 129 active+clean; 2.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 208 MiB/s wr, 110 op/s 2024-09-11T22:32:52.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:52 smithi040 ceph-mon[30787]: pgmap v442: 129 pgs: 129 active+clean; 2.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 213 MiB/s wr, 86 op/s 2024-09-11T22:32:53.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:52 smithi177 ceph-mon[35530]: pgmap v442: 129 pgs: 129 active+clean; 2.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 213 MiB/s wr, 86 op/s 2024-09-11T22:32:53.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:52 smithi146 ceph-mon[34996]: pgmap v442: 129 pgs: 129 active+clean; 2.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 213 MiB/s wr, 86 op/s 2024-09-11T22:32:54.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:54 smithi040 ceph-mon[30787]: pgmap v443: 129 pgs: 129 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 285 MiB/s wr, 115 op/s 2024-09-11T22:32:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:54 smithi177 ceph-mon[35530]: pgmap v443: 129 pgs: 129 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 285 MiB/s wr, 115 op/s 2024-09-11T22:32:55.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:54 smithi146 ceph-mon[34996]: pgmap v443: 129 pgs: 129 active+clean; 3.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 285 MiB/s wr, 115 op/s 2024-09-11T22:32:56.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:56 smithi040 ceph-mon[30787]: pgmap v444: 129 pgs: 129 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 240 MiB/s wr, 88 op/s 2024-09-11T22:32:57.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:56 smithi177 ceph-mon[35530]: pgmap v444: 129 pgs: 129 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 240 MiB/s wr, 88 op/s 2024-09-11T22:32:57.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:56 smithi146 ceph-mon[34996]: pgmap v444: 129 pgs: 129 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 240 MiB/s wr, 88 op/s 2024-09-11T22:32:58.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:32:58 smithi040 ceph-mon[30787]: pgmap v445: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 241 MiB/s wr, 99 op/s 2024-09-11T22:32:59.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:32:58 smithi177 ceph-mon[35530]: pgmap v445: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 241 MiB/s wr, 99 op/s 2024-09-11T22:32:59.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:32:58 smithi146 ceph-mon[34996]: pgmap v445: 129 pgs: 129 active+clean; 4.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 241 MiB/s wr, 99 op/s 2024-09-11T22:33:00.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:00 smithi040 ceph-mon[30787]: pgmap v446: 129 pgs: 129 active+clean; 4.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 282 MiB/s wr, 98 op/s 2024-09-11T22:33:01.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:00 smithi177 ceph-mon[35530]: pgmap v446: 129 pgs: 129 active+clean; 4.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 282 MiB/s wr, 98 op/s 2024-09-11T22:33:01.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:00 smithi146 ceph-mon[34996]: pgmap v446: 129 pgs: 129 active+clean; 4.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 282 MiB/s wr, 98 op/s 2024-09-11T22:33:02.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:02 smithi040 ceph-mon[30787]: pgmap v447: 129 pgs: 129 active+clean; 5.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 223 MiB/s wr, 81 op/s 2024-09-11T22:33:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:02 smithi177 ceph-mon[35530]: pgmap v447: 129 pgs: 129 active+clean; 5.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 223 MiB/s wr, 81 op/s 2024-09-11T22:33:03.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:02 smithi146 ceph-mon[34996]: pgmap v447: 129 pgs: 129 active+clean; 5.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 223 MiB/s wr, 81 op/s 2024-09-11T22:33:04.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:04 smithi040 ceph-mon[30787]: pgmap v448: 129 pgs: 129 active+clean; 6.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 297 MiB/s wr, 113 op/s 2024-09-11T22:33:05.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:04 smithi177 ceph-mon[35530]: pgmap v448: 129 pgs: 129 active+clean; 6.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 297 MiB/s wr, 113 op/s 2024-09-11T22:33:05.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:04 smithi146 ceph-mon[34996]: pgmap v448: 129 pgs: 129 active+clean; 6.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 297 MiB/s wr, 113 op/s 2024-09-11T22:33:06.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:06 smithi040 ceph-mon[30787]: pgmap v449: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 240 MiB/s wr, 86 op/s 2024-09-11T22:33:07.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:06 smithi177 ceph-mon[35530]: pgmap v449: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 240 MiB/s wr, 86 op/s 2024-09-11T22:33:07.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:06 smithi146 ceph-mon[34996]: pgmap v449: 129 pgs: 129 active+clean; 6.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 240 MiB/s wr, 86 op/s 2024-09-11T22:33:08.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:08 smithi040 ceph-mon[30787]: pgmap v450: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 238 MiB/s wr, 97 op/s 2024-09-11T22:33:09.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:08 smithi177 ceph-mon[35530]: pgmap v450: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 238 MiB/s wr, 97 op/s 2024-09-11T22:33:09.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:08 smithi146 ceph-mon[34996]: pgmap v450: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 238 MiB/s wr, 97 op/s 2024-09-11T22:33:09.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:09 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:33:10.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:09 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:33:10.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:09 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:33:10.988 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:10 smithi040 ceph-mon[30787]: pgmap v451: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 285 MiB/s wr, 100 op/s 2024-09-11T22:33:11.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:10 smithi177 ceph-mon[35530]: pgmap v451: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 285 MiB/s wr, 100 op/s 2024-09-11T22:33:11.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:10 smithi146 ceph-mon[34996]: pgmap v451: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 285 MiB/s wr, 100 op/s 2024-09-11T22:33:12.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:12 smithi040 ceph-mon[30787]: pgmap v452: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 236 MiB/s wr, 86 op/s 2024-09-11T22:33:13.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:12 smithi177 ceph-mon[35530]: pgmap v452: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 236 MiB/s wr, 86 op/s 2024-09-11T22:33:13.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:12 smithi146 ceph-mon[34996]: pgmap v452: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 236 MiB/s wr, 86 op/s 2024-09-11T22:33:15.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:14 smithi177 ceph-mon[35530]: pgmap v453: 129 pgs: 129 active+clean; 8.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 305 MiB/s wr, 118 op/s 2024-09-11T22:33:15.081 INFO:tasks.workunit.client.0.smithi040.stdout:fs setup took 46 secs 2024-09-11T22:33:15.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:14 smithi146 ceph-mon[34996]: pgmap v453: 129 pgs: 129 active+clean; 8.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 305 MiB/s wr, 118 op/s 2024-09-11T22:33:15.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:14 smithi040 ceph-mon[30787]: pgmap v453: 129 pgs: 129 active+clean; 8.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 305 MiB/s wr, 118 op/s 2024-09-11T22:33:17.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:16 smithi177 ceph-mon[35530]: pgmap v454: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 238 MiB/s wr, 88 op/s 2024-09-11T22:33:17.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:16 smithi146 ceph-mon[34996]: pgmap v454: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 238 MiB/s wr, 88 op/s 2024-09-11T22:33:17.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:16 smithi040 ceph-mon[30787]: pgmap v454: 129 pgs: 129 active+clean; 8.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 238 MiB/s wr, 88 op/s 2024-09-11T22:33:19.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:18 smithi177 ceph-mon[35530]: pgmap v455: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 240 MiB/s wr, 96 op/s 2024-09-11T22:33:19.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:18 smithi146 ceph-mon[34996]: pgmap v455: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 240 MiB/s wr, 96 op/s 2024-09-11T22:33:19.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:18 smithi040 ceph-mon[30787]: pgmap v455: 129 pgs: 129 active+clean; 9.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 240 MiB/s wr, 96 op/s 2024-09-11T22:33:21.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:20 smithi177 ceph-mon[35530]: pgmap v456: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 296 MiB/s wr, 101 op/s 2024-09-11T22:33:21.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:20 smithi146 ceph-mon[34996]: pgmap v456: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 296 MiB/s wr, 101 op/s 2024-09-11T22:33:21.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:20 smithi040 ceph-mon[30787]: pgmap v456: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 296 MiB/s wr, 101 op/s 2024-09-11T22:33:23.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:22 smithi177 ceph-mon[35530]: pgmap v457: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 241 MiB/s wr, 85 op/s 2024-09-11T22:33:23.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:22 smithi146 ceph-mon[34996]: pgmap v457: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 241 MiB/s wr, 85 op/s 2024-09-11T22:33:23.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:22 smithi040 ceph-mon[30787]: pgmap v457: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 241 MiB/s wr, 85 op/s 2024-09-11T22:33:25.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:24 smithi177 ceph-mon[35530]: pgmap v458: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 312 MiB/s wr, 105 op/s 2024-09-11T22:33:25.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:24 smithi146 ceph-mon[34996]: pgmap v458: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 312 MiB/s wr, 105 op/s 2024-09-11T22:33:25.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:24 smithi040 ceph-mon[30787]: pgmap v458: 129 pgs: 129 active+clean; 11 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 312 MiB/s wr, 105 op/s 2024-09-11T22:33:25.913 INFO:tasks.workunit.client.0.smithi040.stdout:Syncing()...10 sec 2024-09-11T22:33:25.915 INFO:tasks.workunit.client.0.smithi040.stdout:Starting Actual Benchmark At: Wed Sep 11 22:33:25 2024 2024-09-11T22:33:25.915 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:33:26.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:33:26.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:33:26.148 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:33:27.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:26 smithi177 ceph-mon[35530]: pgmap v459: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 262 MiB/s wr, 79 op/s 2024-09-11T22:33:27.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:26 smithi146 ceph-mon[34996]: pgmap v459: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 262 MiB/s wr, 79 op/s 2024-09-11T22:33:27.239 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:26 smithi040 ceph-mon[30787]: pgmap v459: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 262 MiB/s wr, 79 op/s 2024-09-11T22:33:28.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:33:28.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:33:28.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:33:28.239 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:33:28.239 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:33:28.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:33:28.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:33:28.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:33:28.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:33:29.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:28 smithi146 ceph-mon[34996]: pgmap v460: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 262 MiB/s wr, 93 op/s 2024-09-11T22:33:29.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:28 smithi040 ceph-mon[30787]: pgmap v460: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 262 MiB/s wr, 93 op/s 2024-09-11T22:33:29.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:28 smithi177 ceph-mon[35530]: pgmap v460: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 262 MiB/s wr, 93 op/s 2024-09-11T22:33:30.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:30 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:33:30.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:30 smithi146 ceph-mon[34996]: pgmap v461: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 279 MiB/s wr, 360 op/s 2024-09-11T22:33:30.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:30 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:33:30.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:30 smithi040 ceph-mon[30787]: pgmap v461: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 279 MiB/s wr, 360 op/s 2024-09-11T22:33:30.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:30 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:33:30.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:30 smithi177 ceph-mon[35530]: pgmap v461: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 279 MiB/s wr, 360 op/s 2024-09-11T22:33:32.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:32 smithi040 ceph-mon[30787]: pgmap v462: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 207 MiB/s wr, 492 op/s 2024-09-11T22:33:32.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:32 smithi177 ceph-mon[35530]: pgmap v462: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 207 MiB/s wr, 492 op/s 2024-09-11T22:33:32.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:32 smithi146 ceph-mon[34996]: pgmap v462: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 207 MiB/s wr, 492 op/s 2024-09-11T22:33:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:34 smithi040 ceph-mon[30787]: pgmap v463: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 207 MiB/s wr, 3.33k op/s 2024-09-11T22:33:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:34 smithi177 ceph-mon[35530]: pgmap v463: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 207 MiB/s wr, 3.33k op/s 2024-09-11T22:33:34.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:34 smithi146 ceph-mon[34996]: pgmap v463: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 207 MiB/s wr, 3.33k op/s 2024-09-11T22:33:36.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:36 smithi040 ceph-mon[30787]: pgmap v464: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 123 MiB/s wr, 3.65k op/s 2024-09-11T22:33:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:36 smithi177 ceph-mon[35530]: pgmap v464: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 123 MiB/s wr, 3.65k op/s 2024-09-11T22:33:36.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:36 smithi146 ceph-mon[34996]: pgmap v464: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 123 MiB/s wr, 3.65k op/s 2024-09-11T22:33:38.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:38 smithi040 ceph-mon[30787]: pgmap v465: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 103 MiB/s wr, 5.67k op/s 2024-09-11T22:33:38.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:38 smithi177 ceph-mon[35530]: pgmap v465: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 103 MiB/s wr, 5.67k op/s 2024-09-11T22:33:38.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:38 smithi146 ceph-mon[34996]: pgmap v465: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 103 MiB/s wr, 5.67k op/s 2024-09-11T22:33:40.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:40 smithi040 ceph-mon[30787]: pgmap v466: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 101 MiB/s wr, 8.06k op/s 2024-09-11T22:33:40.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:40 smithi177 ceph-mon[35530]: pgmap v466: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 101 MiB/s wr, 8.06k op/s 2024-09-11T22:33:40.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:40 smithi146 ceph-mon[34996]: pgmap v466: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 101 MiB/s wr, 8.06k op/s 2024-09-11T22:33:42.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:42 smithi040 ceph-mon[30787]: pgmap v467: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 65 MiB/s wr, 8.62k op/s 2024-09-11T22:33:42.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:42 smithi177 ceph-mon[35530]: pgmap v467: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 65 MiB/s wr, 8.62k op/s 2024-09-11T22:33:42.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:42 smithi146 ceph-mon[34996]: pgmap v467: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 65 MiB/s wr, 8.62k op/s 2024-09-11T22:33:44.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:44 smithi040 ceph-mon[30787]: pgmap v468: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 78 MiB/s wr, 11.40k op/s 2024-09-11T22:33:44.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:44 smithi177 ceph-mon[35530]: pgmap v468: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 78 MiB/s wr, 11.40k op/s 2024-09-11T22:33:44.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:44 smithi146 ceph-mon[34996]: pgmap v468: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 78 MiB/s wr, 11.40k op/s 2024-09-11T22:33:46.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:46 smithi040 ceph-mon[30787]: pgmap v469: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 65 MiB/s wr, 9.14k op/s 2024-09-11T22:33:46.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:46 smithi177 ceph-mon[35530]: pgmap v469: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 65 MiB/s wr, 9.14k op/s 2024-09-11T22:33:46.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:46 smithi146 ceph-mon[34996]: pgmap v469: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 65 MiB/s wr, 9.14k op/s 2024-09-11T22:33:48.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:48 smithi040 ceph-mon[30787]: pgmap v470: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 76 MiB/s wr, 10.64k op/s 2024-09-11T22:33:48.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:48 smithi177 ceph-mon[35530]: pgmap v470: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 76 MiB/s wr, 10.64k op/s 2024-09-11T22:33:48.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:48 smithi146 ceph-mon[34996]: pgmap v470: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 76 MiB/s wr, 10.64k op/s 2024-09-11T22:33:50.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:50 smithi177 ceph-mon[35530]: pgmap v471: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 83 MiB/s wr, 11.39k op/s 2024-09-11T22:33:50.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:50 smithi146 ceph-mon[34996]: pgmap v471: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 83 MiB/s wr, 11.39k op/s 2024-09-11T22:33:50.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:50 smithi040 ceph-mon[30787]: pgmap v471: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 83 MiB/s wr, 11.39k op/s 2024-09-11T22:33:52.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:52 smithi177 ceph-mon[35530]: pgmap v472: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 70 MiB/s wr, 9.63k op/s 2024-09-11T22:33:52.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:52 smithi146 ceph-mon[34996]: pgmap v472: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 70 MiB/s wr, 9.63k op/s 2024-09-11T22:33:52.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:52 smithi040 ceph-mon[30787]: pgmap v472: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 70 MiB/s wr, 9.63k op/s 2024-09-11T22:33:54.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:54 smithi177 ceph-mon[35530]: pgmap v473: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 90 MiB/s wr, 12.01k op/s 2024-09-11T22:33:54.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:54 smithi146 ceph-mon[34996]: pgmap v473: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 90 MiB/s wr, 12.01k op/s 2024-09-11T22:33:54.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:54 smithi040 ceph-mon[30787]: pgmap v473: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 90 MiB/s wr, 12.01k op/s 2024-09-11T22:33:56.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:56 smithi177 ceph-mon[35530]: pgmap v474: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 72 MiB/s wr, 9.39k op/s 2024-09-11T22:33:56.537 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:56 smithi040 ceph-mon[30787]: pgmap v474: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 72 MiB/s wr, 9.39k op/s 2024-09-11T22:33:56.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:56 smithi146 ceph-mon[34996]: pgmap v474: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 72 MiB/s wr, 9.39k op/s 2024-09-11T22:33:58.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:33:58 smithi177 ceph-mon[35530]: pgmap v475: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 83 MiB/s wr, 10.67k op/s 2024-09-11T22:33:58.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:33:58 smithi146 ceph-mon[34996]: pgmap v475: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 83 MiB/s wr, 10.67k op/s 2024-09-11T22:33:58.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:33:58 smithi040 ceph-mon[30787]: pgmap v475: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 83 MiB/s wr, 10.67k op/s 2024-09-11T22:34:00.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:00 smithi177 ceph-mon[35530]: pgmap v476: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 90 MiB/s wr, 11.45k op/s 2024-09-11T22:34:00.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:00 smithi146 ceph-mon[34996]: pgmap v476: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 90 MiB/s wr, 11.45k op/s 2024-09-11T22:34:00.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:00 smithi040 ceph-mon[30787]: pgmap v476: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 90 MiB/s wr, 11.45k op/s 2024-09-11T22:34:02.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:02 smithi177 ceph-mon[35530]: pgmap v477: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 70 MiB/s wr, 8.67k op/s 2024-09-11T22:34:02.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:02 smithi146 ceph-mon[34996]: pgmap v477: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 70 MiB/s wr, 8.67k op/s 2024-09-11T22:34:02.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:02 smithi040 ceph-mon[30787]: pgmap v477: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 70 MiB/s wr, 8.67k op/s 2024-09-11T22:34:04.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:04 smithi177 ceph-mon[35530]: pgmap v478: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 98 MiB/s wr, 11.87k op/s 2024-09-11T22:34:04.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:04 smithi146 ceph-mon[34996]: pgmap v478: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 98 MiB/s wr, 11.87k op/s 2024-09-11T22:34:04.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:04 smithi040 ceph-mon[30787]: pgmap v478: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 98 MiB/s wr, 11.87k op/s 2024-09-11T22:34:06.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:06 smithi177 ceph-mon[35530]: pgmap v479: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 75 MiB/s wr, 9.02k op/s 2024-09-11T22:34:06.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:06 smithi146 ceph-mon[34996]: pgmap v479: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 75 MiB/s wr, 9.02k op/s 2024-09-11T22:34:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:06 smithi040 ceph-mon[30787]: pgmap v479: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 75 MiB/s wr, 9.02k op/s 2024-09-11T22:34:08.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:08 smithi146 ceph-mon[34996]: pgmap v480: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 84 MiB/s wr, 10.21k op/s 2024-09-11T22:34:08.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:08 smithi040 ceph-mon[30787]: pgmap v480: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 84 MiB/s wr, 10.21k op/s 2024-09-11T22:34:08.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:08 smithi177 ceph-mon[35530]: pgmap v480: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 84 MiB/s wr, 10.21k op/s 2024-09-11T22:34:10.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:10 smithi146 ceph-mon[34996]: pgmap v481: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 90 MiB/s wr, 10.85k op/s 2024-09-11T22:34:10.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:10 smithi040 ceph-mon[30787]: pgmap v481: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 90 MiB/s wr, 10.85k op/s 2024-09-11T22:34:10.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:10 smithi177 ceph-mon[35530]: pgmap v481: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 90 MiB/s wr, 10.85k op/s 2024-09-11T22:34:12.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:12 smithi146 ceph-mon[34996]: pgmap v482: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 69 MiB/s wr, 8.22k op/s 2024-09-11T22:34:12.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:12 smithi040 ceph-mon[30787]: pgmap v482: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 69 MiB/s wr, 8.22k op/s 2024-09-11T22:34:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:12 smithi177 ceph-mon[35530]: pgmap v482: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 69 MiB/s wr, 8.22k op/s 2024-09-11T22:34:14.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:14 smithi146 ceph-mon[34996]: pgmap v483: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 105 MiB/s wr, 12.42k op/s 2024-09-11T22:34:14.584 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:14 smithi177 ceph-mon[35530]: pgmap v483: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 105 MiB/s wr, 12.42k op/s 2024-09-11T22:34:14.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:14 smithi040 ceph-mon[30787]: pgmap v483: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 105 MiB/s wr, 12.42k op/s 2024-09-11T22:34:16.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:16 smithi146 ceph-mon[34996]: pgmap v484: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 75 MiB/s wr, 8.97k op/s 2024-09-11T22:34:16.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:16 smithi040 ceph-mon[30787]: pgmap v484: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 75 MiB/s wr, 8.97k op/s 2024-09-11T22:34:16.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:16 smithi177 ceph-mon[35530]: pgmap v484: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 75 MiB/s wr, 8.97k op/s 2024-09-11T22:34:18.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:18 smithi040 ceph-mon[30787]: pgmap v485: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 86 MiB/s wr, 10.07k op/s 2024-09-11T22:34:18.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:18 smithi177 ceph-mon[35530]: pgmap v485: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 86 MiB/s wr, 10.07k op/s 2024-09-11T22:34:18.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:18 smithi146 ceph-mon[34996]: pgmap v485: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 86 MiB/s wr, 10.07k op/s 2024-09-11T22:34:20.635 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:20 smithi146 ceph-mon[34996]: pgmap v486: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 100 MiB/s wr, 11.55k op/s 2024-09-11T22:34:20.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:20 smithi040 ceph-mon[30787]: pgmap v486: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 100 MiB/s wr, 11.55k op/s 2024-09-11T22:34:20.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:20 smithi177 ceph-mon[35530]: pgmap v486: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 100 MiB/s wr, 11.55k op/s 2024-09-11T22:34:22.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:22 smithi040 ceph-mon[30787]: pgmap v487: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 80 MiB/s wr, 9.06k op/s 2024-09-11T22:34:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:22 smithi177 ceph-mon[35530]: pgmap v487: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 80 MiB/s wr, 9.06k op/s 2024-09-11T22:34:22.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:22 smithi146 ceph-mon[34996]: pgmap v487: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 80 MiB/s wr, 9.06k op/s 2024-09-11T22:34:24.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:24 smithi040 ceph-mon[30787]: pgmap v488: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 110 MiB/s wr, 12.95k op/s 2024-09-11T22:34:24.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:24 smithi177 ceph-mon[35530]: pgmap v488: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 110 MiB/s wr, 12.95k op/s 2024-09-11T22:34:24.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:24 smithi146 ceph-mon[34996]: pgmap v488: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 110 MiB/s wr, 12.95k op/s 2024-09-11T22:34:26.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:26 smithi040 ceph-mon[30787]: pgmap v489: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 79 MiB/s wr, 9.26k op/s 2024-09-11T22:34:26.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:26 smithi177 ceph-mon[35530]: pgmap v489: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 79 MiB/s wr, 9.26k op/s 2024-09-11T22:34:26.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:26 smithi146 ceph-mon[34996]: pgmap v489: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 79 MiB/s wr, 9.26k op/s 2024-09-11T22:34:28.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:28 smithi177 ceph-mon[35530]: pgmap v490: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 76 MiB/s wr, 9.01k op/s 2024-09-11T22:34:28.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:28 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:34:28.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:28 smithi146 ceph-mon[34996]: pgmap v490: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 76 MiB/s wr, 9.01k op/s 2024-09-11T22:34:28.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:28 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:34:29.604 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:28 smithi040 ceph-mon[30787]: pgmap v490: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 76 MiB/s wr, 9.01k op/s 2024-09-11T22:34:29.604 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:28 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:34:30.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:30 smithi040 ceph-mon[30787]: pgmap v491: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 92 MiB/s wr, 11.28k op/s 2024-09-11T22:34:30.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:30 smithi177 ceph-mon[35530]: pgmap v491: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 92 MiB/s wr, 11.28k op/s 2024-09-11T22:34:30.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:30 smithi146 ceph-mon[34996]: pgmap v491: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 92 MiB/s wr, 11.28k op/s 2024-09-11T22:34:32.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:32 smithi040 ceph-mon[30787]: pgmap v492: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 65 MiB/s wr, 8.28k op/s 2024-09-11T22:34:32.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:32 smithi177 ceph-mon[35530]: pgmap v492: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 65 MiB/s wr, 8.28k op/s 2024-09-11T22:34:32.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:32 smithi146 ceph-mon[34996]: pgmap v492: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 65 MiB/s wr, 8.28k op/s 2024-09-11T22:34:33.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:34:33.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:34:33.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:33 smithi040 ceph-mon[30787]: pgmap v493: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 MiB/s wr, 9.62k op/s 2024-09-11T22:34:33.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:34:33.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:34:33.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:34:33.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:33 smithi177 ceph-mon[35530]: pgmap v493: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 MiB/s wr, 9.62k op/s 2024-09-11T22:34:33.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:34:33.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:34:33.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:34:33.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:33 smithi146 ceph-mon[34996]: pgmap v493: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 MiB/s wr, 9.62k op/s 2024-09-11T22:34:33.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:34:34.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:34 smithi040 ceph-mon[30787]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T22:34:34.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:34 smithi177 ceph-mon[35530]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T22:34:34.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:34 smithi146 ceph-mon[34996]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T22:34:35.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:35 smithi177 ceph-mon[35530]: pgmap v494: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 73 MiB/s wr, 8.85k op/s 2024-09-11T22:34:35.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:35 smithi146 ceph-mon[34996]: pgmap v494: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 73 MiB/s wr, 8.85k op/s 2024-09-11T22:34:35.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:35 smithi040 ceph-mon[30787]: pgmap v494: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 73 MiB/s wr, 8.85k op/s 2024-09-11T22:34:37.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:37 smithi146 ceph-mon[34996]: pgmap v495: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 69 MiB/s wr, 8.42k op/s 2024-09-11T22:34:37.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:37 smithi040 ceph-mon[30787]: pgmap v495: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 69 MiB/s wr, 8.42k op/s 2024-09-11T22:34:38.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:37 smithi177 ceph-mon[35530]: pgmap v495: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 69 MiB/s wr, 8.42k op/s 2024-09-11T22:34:39.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:39 smithi146 ceph-mon[34996]: pgmap v496: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 94 MiB/s wr, 11.24k op/s 2024-09-11T22:34:39.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:39 smithi040 ceph-mon[30787]: pgmap v496: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 94 MiB/s wr, 11.24k op/s 2024-09-11T22:34:40.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:39 smithi177 ceph-mon[35530]: pgmap v496: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 94 MiB/s wr, 11.24k op/s 2024-09-11T22:34:41.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:41 smithi146 ceph-mon[34996]: pgmap v497: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 72 MiB/s wr, 8.26k op/s 2024-09-11T22:34:41.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:41 smithi040 ceph-mon[30787]: pgmap v497: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 72 MiB/s wr, 8.26k op/s 2024-09-11T22:34:42.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:41 smithi177 ceph-mon[35530]: pgmap v497: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 72 MiB/s wr, 8.26k op/s 2024-09-11T22:34:43.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:43 smithi146 ceph-mon[34996]: pgmap v498: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 77 MiB/s wr, 8.69k op/s 2024-09-11T22:34:43.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:43 smithi040 ceph-mon[30787]: pgmap v498: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 77 MiB/s wr, 8.69k op/s 2024-09-11T22:34:44.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:43 smithi177 ceph-mon[35530]: pgmap v498: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 77 MiB/s wr, 8.69k op/s 2024-09-11T22:34:45.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:45 smithi146 ceph-mon[34996]: pgmap v499: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 100 MiB/s wr, 10.85k op/s 2024-09-11T22:34:45.834 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:45 smithi177 ceph-mon[35530]: pgmap v499: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 100 MiB/s wr, 10.85k op/s 2024-09-11T22:34:45.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:45 smithi040 ceph-mon[30787]: pgmap v499: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 100 MiB/s wr, 10.85k op/s 2024-09-11T22:34:47.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:47 smithi146 ceph-mon[34996]: pgmap v500: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 75 MiB/s wr, 7.88k op/s 2024-09-11T22:34:47.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:47 smithi040 ceph-mon[30787]: pgmap v500: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 75 MiB/s wr, 7.88k op/s 2024-09-11T22:34:48.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:47 smithi177 ceph-mon[35530]: pgmap v500: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 75 MiB/s wr, 7.88k op/s 2024-09-11T22:34:49.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:49 smithi146 ceph-mon[34996]: pgmap v501: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 97 MiB/s wr, 10.42k op/s 2024-09-11T22:34:49.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:49 smithi040 ceph-mon[30787]: pgmap v501: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 97 MiB/s wr, 10.42k op/s 2024-09-11T22:34:50.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:49 smithi177 ceph-mon[35530]: pgmap v501: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 97 MiB/s wr, 10.42k op/s 2024-09-11T22:34:51.991 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:51 smithi040 ceph-mon[30787]: pgmap v502: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 81 MiB/s wr, 8.50k op/s 2024-09-11T22:34:52.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:51 smithi177 ceph-mon[35530]: pgmap v502: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 81 MiB/s wr, 8.50k op/s 2024-09-11T22:34:52.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:51 smithi146 ceph-mon[34996]: pgmap v502: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 81 MiB/s wr, 8.50k op/s 2024-09-11T22:34:53.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:53 smithi040 ceph-mon[30787]: pgmap v503: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 77 MiB/s wr, 8.14k op/s 2024-09-11T22:34:54.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:53 smithi177 ceph-mon[35530]: pgmap v503: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 77 MiB/s wr, 8.14k op/s 2024-09-11T22:34:54.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:53 smithi146 ceph-mon[34996]: pgmap v503: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 77 MiB/s wr, 8.14k op/s 2024-09-11T22:34:55.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:55 smithi040 ceph-mon[30787]: pgmap v504: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 93 MiB/s wr, 10.20k op/s 2024-09-11T22:34:56.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:55 smithi177 ceph-mon[35530]: pgmap v504: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 93 MiB/s wr, 10.20k op/s 2024-09-11T22:34:56.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:55 smithi146 ceph-mon[34996]: pgmap v504: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 93 MiB/s wr, 10.20k op/s 2024-09-11T22:34:57.976 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:57 smithi040 ceph-mon[30787]: pgmap v505: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 MiB/s wr, 7.12k op/s 2024-09-11T22:34:58.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:57 smithi177 ceph-mon[35530]: pgmap v505: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 MiB/s wr, 7.12k op/s 2024-09-11T22:34:58.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:57 smithi146 ceph-mon[34996]: pgmap v505: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 MiB/s wr, 7.12k op/s 2024-09-11T22:34:59.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:34:59 smithi040 ceph-mon[30787]: pgmap v506: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 74 MiB/s wr, 9.10k op/s 2024-09-11T22:35:00.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:34:59 smithi177 ceph-mon[35530]: pgmap v506: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 74 MiB/s wr, 9.10k op/s 2024-09-11T22:35:00.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:34:59 smithi146 ceph-mon[34996]: pgmap v506: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 74 MiB/s wr, 9.10k op/s 2024-09-11T22:35:01.988 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:01 smithi040 ceph-mon[30787]: pgmap v507: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 61 MiB/s wr, 7.74k op/s 2024-09-11T22:35:02.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:01 smithi177 ceph-mon[35530]: pgmap v507: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 61 MiB/s wr, 7.74k op/s 2024-09-11T22:35:02.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:01 smithi146 ceph-mon[34996]: pgmap v507: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 61 MiB/s wr, 7.74k op/s 2024-09-11T22:35:03.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:03 smithi040 ceph-mon[30787]: pgmap v508: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 55 MiB/s wr, 7.27k op/s 2024-09-11T22:35:04.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:03 smithi177 ceph-mon[35530]: pgmap v508: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 55 MiB/s wr, 7.27k op/s 2024-09-11T22:35:04.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:03 smithi146 ceph-mon[34996]: pgmap v508: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 55 MiB/s wr, 7.27k op/s 2024-09-11T22:35:05.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:05 smithi040 ceph-mon[30787]: pgmap v509: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 68 MiB/s wr, 9.11k op/s 2024-09-11T22:35:06.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:05 smithi177 ceph-mon[35530]: pgmap v509: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 68 MiB/s wr, 9.11k op/s 2024-09-11T22:35:06.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:05 smithi146 ceph-mon[34996]: pgmap v509: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 68 MiB/s wr, 9.11k op/s 2024-09-11T22:35:07.994 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:07 smithi040 ceph-mon[30787]: pgmap v510: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 52 MiB/s wr, 7.16k op/s 2024-09-11T22:35:08.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:07 smithi177 ceph-mon[35530]: pgmap v510: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 52 MiB/s wr, 7.16k op/s 2024-09-11T22:35:08.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:07 smithi146 ceph-mon[34996]: pgmap v510: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 52 MiB/s wr, 7.16k op/s 2024-09-11T22:35:09.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:09 smithi040 ceph-mon[30787]: pgmap v511: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 62 MiB/s wr, 8.94k op/s 2024-09-11T22:35:09.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:09 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:35:10.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:09 smithi177 ceph-mon[35530]: pgmap v511: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 62 MiB/s wr, 8.94k op/s 2024-09-11T22:35:10.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:09 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:35:10.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:09 smithi146 ceph-mon[34996]: pgmap v511: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 62 MiB/s wr, 8.94k op/s 2024-09-11T22:35:10.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:09 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:35:12.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:11 smithi177 ceph-mon[35530]: pgmap v512: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 55 MiB/s wr, 7.89k op/s 2024-09-11T22:35:12.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:11 smithi146 ceph-mon[34996]: pgmap v512: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 55 MiB/s wr, 7.89k op/s 2024-09-11T22:35:12.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:11 smithi040 ceph-mon[30787]: pgmap v512: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 55 MiB/s wr, 7.89k op/s 2024-09-11T22:35:14.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:13 smithi177 ceph-mon[35530]: pgmap v513: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 48 MiB/s wr, 7.11k op/s 2024-09-11T22:35:14.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:13 smithi146 ceph-mon[34996]: pgmap v513: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 48 MiB/s wr, 7.11k op/s 2024-09-11T22:35:14.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:13 smithi040 ceph-mon[30787]: pgmap v513: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 48 MiB/s wr, 7.11k op/s 2024-09-11T22:35:16.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:15 smithi177 ceph-mon[35530]: pgmap v514: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 59 MiB/s wr, 8.70k op/s 2024-09-11T22:35:16.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:15 smithi146 ceph-mon[34996]: pgmap v514: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 59 MiB/s wr, 8.70k op/s 2024-09-11T22:35:16.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:15 smithi040 ceph-mon[30787]: pgmap v514: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 59 MiB/s wr, 8.70k op/s 2024-09-11T22:35:18.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:17 smithi177 ceph-mon[35530]: pgmap v515: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 49 MiB/s wr, 7.29k op/s 2024-09-11T22:35:18.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:17 smithi146 ceph-mon[34996]: pgmap v515: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 49 MiB/s wr, 7.29k op/s 2024-09-11T22:35:18.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:17 smithi040 ceph-mon[30787]: pgmap v515: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 49 MiB/s wr, 7.29k op/s 2024-09-11T22:35:20.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:19 smithi146 ceph-mon[34996]: pgmap v516: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 57 MiB/s wr, 8.68k op/s 2024-09-11T22:35:20.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:19 smithi040 ceph-mon[30787]: pgmap v516: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 57 MiB/s wr, 8.68k op/s 2024-09-11T22:35:20.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:19 smithi177 ceph-mon[35530]: pgmap v516: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 57 MiB/s wr, 8.68k op/s 2024-09-11T22:35:22.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:21 smithi146 ceph-mon[34996]: pgmap v517: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 7.16k op/s 2024-09-11T22:35:22.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:21 smithi040 ceph-mon[30787]: pgmap v517: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 7.16k op/s 2024-09-11T22:35:22.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:21 smithi177 ceph-mon[35530]: pgmap v517: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 7.16k op/s 2024-09-11T22:35:24.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:23 smithi146 ceph-mon[34996]: pgmap v518: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 MiB/s wr, 7.05k op/s 2024-09-11T22:35:24.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:23 smithi040 ceph-mon[30787]: pgmap v518: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 MiB/s wr, 7.05k op/s 2024-09-11T22:35:24.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:23 smithi177 ceph-mon[35530]: pgmap v518: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 MiB/s wr, 7.05k op/s 2024-09-11T22:35:26.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:25 smithi040 ceph-mon[30787]: pgmap v519: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 MiB/s wr, 8.46k op/s 2024-09-11T22:35:26.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:25 smithi177 ceph-mon[35530]: pgmap v519: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 MiB/s wr, 8.46k op/s 2024-09-11T22:35:26.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:25 smithi146 ceph-mon[34996]: pgmap v519: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 56 MiB/s wr, 8.46k op/s 2024-09-11T22:35:28.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:27 smithi040 ceph-mon[30787]: pgmap v520: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 48 MiB/s wr, 7.34k op/s 2024-09-11T22:35:28.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:27 smithi177 ceph-mon[35530]: pgmap v520: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 48 MiB/s wr, 7.34k op/s 2024-09-11T22:35:28.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:27 smithi146 ceph-mon[34996]: pgmap v520: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 48 MiB/s wr, 7.34k op/s 2024-09-11T22:35:30.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:29 smithi040 ceph-mon[30787]: pgmap v521: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 54 MiB/s wr, 8.01k op/s 2024-09-11T22:35:30.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:29 smithi177 ceph-mon[35530]: pgmap v521: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 54 MiB/s wr, 8.01k op/s 2024-09-11T22:35:30.337 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:29 smithi146 ceph-mon[34996]: pgmap v521: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 54 MiB/s wr, 8.01k op/s 2024-09-11T22:35:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:31 smithi040 ceph-mon[30787]: pgmap v522: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 45 MiB/s wr, 6.62k op/s 2024-09-11T22:35:32.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:31 smithi177 ceph-mon[35530]: pgmap v522: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 45 MiB/s wr, 6.62k op/s 2024-09-11T22:35:32.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:31 smithi146 ceph-mon[34996]: pgmap v522: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 45 MiB/s wr, 6.62k op/s 2024-09-11T22:35:33.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:32 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:35:33.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:32 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:35:33.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:32 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:35:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:33 smithi040 ceph-mon[30787]: pgmap v523: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 48 MiB/s wr, 7.10k op/s 2024-09-11T22:35:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:35:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:35:34.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:35:34.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:33 smithi177 ceph-mon[35530]: pgmap v523: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 48 MiB/s wr, 7.10k op/s 2024-09-11T22:35:34.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:35:34.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:35:34.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:35:34.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:33 smithi146 ceph-mon[34996]: pgmap v523: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 48 MiB/s wr, 7.10k op/s 2024-09-11T22:35:34.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:35:34.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:35:34.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:35:35.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:34 smithi040 ceph-mon[30787]: pgmap v524: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 55 MiB/s wr, 8.12k op/s 2024-09-11T22:35:35.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:34 smithi040 ceph-mon[30787]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-11T22:35:35.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:34 smithi040 ceph-mon[30787]: Cluster is now healthy 2024-09-11T22:35:35.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:34 smithi177 ceph-mon[35530]: pgmap v524: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 55 MiB/s wr, 8.12k op/s 2024-09-11T22:35:35.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:34 smithi177 ceph-mon[35530]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-11T22:35:35.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:34 smithi177 ceph-mon[35530]: Cluster is now healthy 2024-09-11T22:35:35.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:34 smithi146 ceph-mon[34996]: pgmap v524: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 55 MiB/s wr, 8.12k op/s 2024-09-11T22:35:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:34 smithi146 ceph-mon[34996]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-11T22:35:35.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:34 smithi146 ceph-mon[34996]: Cluster is now healthy 2024-09-11T22:35:37.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:36 smithi040 ceph-mon[30787]: pgmap v525: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 46 MiB/s wr, 6.64k op/s 2024-09-11T22:35:37.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:36 smithi177 ceph-mon[35530]: pgmap v525: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 46 MiB/s wr, 6.64k op/s 2024-09-11T22:35:37.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:36 smithi146 ceph-mon[34996]: pgmap v525: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 46 MiB/s wr, 6.64k op/s 2024-09-11T22:35:39.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:38 smithi040 ceph-mon[30787]: pgmap v526: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 50 MiB/s wr, 7.16k op/s 2024-09-11T22:35:39.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:38 smithi177 ceph-mon[35530]: pgmap v526: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 50 MiB/s wr, 7.16k op/s 2024-09-11T22:35:39.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:38 smithi146 ceph-mon[34996]: pgmap v526: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 50 MiB/s wr, 7.16k op/s 2024-09-11T22:35:41.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:40 smithi040 ceph-mon[30787]: pgmap v527: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 46 MiB/s wr, 6.90k op/s 2024-09-11T22:35:41.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:40 smithi177 ceph-mon[35530]: pgmap v527: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 46 MiB/s wr, 6.90k op/s 2024-09-11T22:35:41.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:40 smithi146 ceph-mon[34996]: pgmap v527: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 46 MiB/s wr, 6.90k op/s 2024-09-11T22:35:43.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:42 smithi040 ceph-mon[30787]: pgmap v528: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 47 MiB/s wr, 6.92k op/s 2024-09-11T22:35:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:42 smithi177 ceph-mon[35530]: pgmap v528: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 47 MiB/s wr, 6.92k op/s 2024-09-11T22:35:43.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:42 smithi146 ceph-mon[34996]: pgmap v528: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 47 MiB/s wr, 6.92k op/s 2024-09-11T22:35:45.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:44 smithi040 ceph-mon[30787]: pgmap v529: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 58 MiB/s wr, 8.58k op/s 2024-09-11T22:35:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:44 smithi177 ceph-mon[35530]: pgmap v529: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 58 MiB/s wr, 8.58k op/s 2024-09-11T22:35:45.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:44 smithi146 ceph-mon[34996]: pgmap v529: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 58 MiB/s wr, 8.58k op/s 2024-09-11T22:35:47.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:46 smithi040 ceph-mon[30787]: pgmap v530: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 45 MiB/s wr, 6.71k op/s 2024-09-11T22:35:47.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:46 smithi177 ceph-mon[35530]: pgmap v530: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 45 MiB/s wr, 6.71k op/s 2024-09-11T22:35:47.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:46 smithi146 ceph-mon[34996]: pgmap v530: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 45 MiB/s wr, 6.71k op/s 2024-09-11T22:35:49.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:49 smithi177 ceph-mon[35530]: pgmap v531: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 50 MiB/s wr, 7.48k op/s 2024-09-11T22:35:49.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:49 smithi146 ceph-mon[34996]: pgmap v531: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 50 MiB/s wr, 7.48k op/s 2024-09-11T22:35:49.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:49 smithi040 ceph-mon[30787]: pgmap v531: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 50 MiB/s wr, 7.48k op/s 2024-09-11T22:35:50.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:50 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:35:50.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:50 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:35:50.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:50 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:35:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:51 smithi177 ceph-mon[35530]: pgmap v532: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 8.00k op/s 2024-09-11T22:35:51.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:51 smithi146 ceph-mon[34996]: pgmap v532: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 8.00k op/s 2024-09-11T22:35:51.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:51 smithi040 ceph-mon[30787]: pgmap v532: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 8.00k op/s 2024-09-11T22:35:53.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:53 smithi146 ceph-mon[34996]: pgmap v533: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 44 MiB/s wr, 6.66k op/s 2024-09-11T22:35:53.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:53 smithi040 ceph-mon[30787]: pgmap v533: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 44 MiB/s wr, 6.66k op/s 2024-09-11T22:35:53.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:53 smithi177 ceph-mon[35530]: pgmap v533: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 44 MiB/s wr, 6.66k op/s 2024-09-11T22:35:54.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:54 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:35:54.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:54 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:35:54.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:54 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:35:55.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:55 smithi146 ceph-mon[34996]: pgmap v534: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 MiB/s wr, 8.18k op/s 2024-09-11T22:35:55.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:55 smithi040 ceph-mon[30787]: pgmap v534: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 MiB/s wr, 8.18k op/s 2024-09-11T22:35:55.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:55 smithi177 ceph-mon[35530]: pgmap v534: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 MiB/s wr, 8.18k op/s 2024-09-11T22:35:57.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:57 smithi146 ceph-mon[34996]: pgmap v535: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 MiB/s wr, 6.78k op/s 2024-09-11T22:35:57.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:57 smithi040 ceph-mon[30787]: pgmap v535: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 MiB/s wr, 6.78k op/s 2024-09-11T22:35:57.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:57 smithi177 ceph-mon[35530]: pgmap v535: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 42 MiB/s wr, 6.78k op/s 2024-09-11T22:35:59.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:35:59 smithi146 ceph-mon[34996]: pgmap v536: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 44 MiB/s wr, 7.12k op/s 2024-09-11T22:35:59.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:35:59 smithi040 ceph-mon[30787]: pgmap v536: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 44 MiB/s wr, 7.12k op/s 2024-09-11T22:35:59.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:35:59 smithi177 ceph-mon[35530]: pgmap v536: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 44 MiB/s wr, 7.12k op/s 2024-09-11T22:36:01.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:01 smithi146 ceph-mon[34996]: pgmap v537: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 52 MiB/s wr, 8.40k op/s 2024-09-11T22:36:01.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:01 smithi040 ceph-mon[30787]: pgmap v537: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 52 MiB/s wr, 8.40k op/s 2024-09-11T22:36:01.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:01 smithi177 ceph-mon[35530]: pgmap v537: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 52 MiB/s wr, 8.40k op/s 2024-09-11T22:36:02.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:02 smithi040 ceph-mon[30787]: pgmap v538: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 42 MiB/s wr, 6.79k op/s 2024-09-11T22:36:02.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:02 smithi177 ceph-mon[35530]: pgmap v538: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 42 MiB/s wr, 6.79k op/s 2024-09-11T22:36:02.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:02 smithi146 ceph-mon[34996]: pgmap v538: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 42 MiB/s wr, 6.79k op/s 2024-09-11T22:36:04.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:04 smithi040 ceph-mon[30787]: pgmap v539: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 54 MiB/s wr, 8.67k op/s 2024-09-11T22:36:04.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:04 smithi177 ceph-mon[35530]: pgmap v539: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 54 MiB/s wr, 8.67k op/s 2024-09-11T22:36:04.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:04 smithi146 ceph-mon[34996]: pgmap v539: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 54 MiB/s wr, 8.67k op/s 2024-09-11T22:36:06.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:06 smithi040 ceph-mon[30787]: pgmap v540: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 49 MiB/s wr, 7.68k op/s 2024-09-11T22:36:06.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:06 smithi177 ceph-mon[35530]: pgmap v540: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 49 MiB/s wr, 7.68k op/s 2024-09-11T22:36:06.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:06 smithi146 ceph-mon[34996]: pgmap v540: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 49 MiB/s wr, 7.68k op/s 2024-09-11T22:36:08.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:08 smithi040 ceph-mon[30787]: pgmap v541: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 MiB/s wr, 6.78k op/s 2024-09-11T22:36:08.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:08 smithi177 ceph-mon[35530]: pgmap v541: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 MiB/s wr, 6.78k op/s 2024-09-11T22:36:08.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:08 smithi146 ceph-mon[34996]: pgmap v541: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 44 MiB/s wr, 6.78k op/s 2024-09-11T22:36:10.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:10 smithi040 ceph-mon[30787]: pgmap v542: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 MiB/s wr, 9.13k op/s 2024-09-11T22:36:10.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:10 smithi177 ceph-mon[35530]: pgmap v542: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 MiB/s wr, 9.13k op/s 2024-09-11T22:36:10.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:10 smithi146 ceph-mon[34996]: pgmap v542: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 MiB/s wr, 9.13k op/s 2024-09-11T22:36:12.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:12 smithi040 ceph-mon[30787]: pgmap v543: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 MiB/s wr, 6.72k op/s 2024-09-11T22:36:12.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:12 smithi177 ceph-mon[35530]: pgmap v543: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 MiB/s wr, 6.72k op/s 2024-09-11T22:36:12.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:12 smithi146 ceph-mon[34996]: pgmap v543: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 MiB/s wr, 6.72k op/s 2024-09-11T22:36:14.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:14 smithi177 ceph-mon[35530]: pgmap v544: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 7.68k op/s 2024-09-11T22:36:14.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:14 smithi146 ceph-mon[34996]: pgmap v544: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 7.68k op/s 2024-09-11T22:36:14.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:14 smithi040 ceph-mon[30787]: pgmap v544: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 7.68k op/s 2024-09-11T22:36:16.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:16 smithi177 ceph-mon[35530]: pgmap v545: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 46 MiB/s wr, 7.31k op/s 2024-09-11T22:36:16.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:16 smithi146 ceph-mon[34996]: pgmap v545: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 46 MiB/s wr, 7.31k op/s 2024-09-11T22:36:16.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:16 smithi040 ceph-mon[30787]: pgmap v545: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 46 MiB/s wr, 7.31k op/s 2024-09-11T22:36:18.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:18 smithi177 ceph-mon[35530]: pgmap v546: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 MiB/s wr, 6.51k op/s 2024-09-11T22:36:18.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:18 smithi146 ceph-mon[34996]: pgmap v546: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 MiB/s wr, 6.51k op/s 2024-09-11T22:36:18.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:18 smithi040 ceph-mon[30787]: pgmap v546: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 MiB/s wr, 6.51k op/s 2024-09-11T22:36:20.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:20 smithi146 ceph-mon[34996]: pgmap v547: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 56 MiB/s wr, 8.93k op/s 2024-09-11T22:36:20.988 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:20 smithi040 ceph-mon[30787]: pgmap v547: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 56 MiB/s wr, 8.93k op/s 2024-09-11T22:36:21.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:20 smithi177 ceph-mon[35530]: pgmap v547: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 56 MiB/s wr, 8.93k op/s 2024-09-11T22:36:22.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:22 smithi146 ceph-mon[34996]: pgmap v548: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 MiB/s wr, 5.99k op/s 2024-09-11T22:36:22.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:22 smithi040 ceph-mon[30787]: pgmap v548: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 MiB/s wr, 5.99k op/s 2024-09-11T22:36:23.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:22 smithi177 ceph-mon[35530]: pgmap v548: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 MiB/s wr, 5.99k op/s 2024-09-11T22:36:24.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:24 smithi146 ceph-mon[34996]: pgmap v549: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 41 MiB/s wr, 6.57k op/s 2024-09-11T22:36:24.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:24 smithi040 ceph-mon[30787]: pgmap v549: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 41 MiB/s wr, 6.57k op/s 2024-09-11T22:36:25.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:24 smithi177 ceph-mon[35530]: pgmap v549: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 41 MiB/s wr, 6.57k op/s 2024-09-11T22:36:26.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:26 smithi146 ceph-mon[34996]: pgmap v550: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 MiB/s wr, 7.76k op/s 2024-09-11T22:36:26.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:26 smithi040 ceph-mon[30787]: pgmap v550: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 MiB/s wr, 7.76k op/s 2024-09-11T22:36:27.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:26 smithi177 ceph-mon[35530]: pgmap v550: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 48 MiB/s wr, 7.76k op/s 2024-09-11T22:36:28.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:28 smithi040 ceph-mon[30787]: pgmap v551: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 MiB/s wr, 6.26k op/s 2024-09-11T22:36:29.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:28 smithi177 ceph-mon[35530]: pgmap v551: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 MiB/s wr, 6.26k op/s 2024-09-11T22:36:29.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:28 smithi146 ceph-mon[34996]: pgmap v551: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 MiB/s wr, 6.26k op/s 2024-09-11T22:36:30.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:30 smithi040 ceph-mon[30787]: pgmap v552: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 MiB/s wr, 8.90k op/s 2024-09-11T22:36:31.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:30 smithi177 ceph-mon[35530]: pgmap v552: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 MiB/s wr, 8.90k op/s 2024-09-11T22:36:31.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:30 smithi146 ceph-mon[34996]: pgmap v552: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 MiB/s wr, 8.90k op/s 2024-09-11T22:36:32.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:32 smithi040 ceph-mon[30787]: pgmap v553: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 6.52k op/s 2024-09-11T22:36:33.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:32 smithi177 ceph-mon[35530]: pgmap v553: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 6.52k op/s 2024-09-11T22:36:33.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:32 smithi146 ceph-mon[34996]: pgmap v553: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 MiB/s wr, 6.52k op/s 2024-09-11T22:36:33.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:33 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:36:34.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:33 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:36:34.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:33 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:36:35.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:34 smithi177 ceph-mon[35530]: pgmap v554: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 7.37k op/s 2024-09-11T22:36:35.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:34 smithi146 ceph-mon[34996]: pgmap v554: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 7.37k op/s 2024-09-11T22:36:35.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:34 smithi040 ceph-mon[30787]: pgmap v554: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 7.37k op/s 2024-09-11T22:36:37.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:36 smithi177 ceph-mon[35530]: pgmap v555: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 50 MiB/s wr, 8.52k op/s 2024-09-11T22:36:37.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:36 smithi146 ceph-mon[34996]: pgmap v555: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 50 MiB/s wr, 8.52k op/s 2024-09-11T22:36:37.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:36 smithi040 ceph-mon[30787]: pgmap v555: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 50 MiB/s wr, 8.52k op/s 2024-09-11T22:36:39.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:38 smithi177 ceph-mon[35530]: pgmap v556: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 6.17k op/s 2024-09-11T22:36:39.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:38 smithi146 ceph-mon[34996]: pgmap v556: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 6.17k op/s 2024-09-11T22:36:39.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:38 smithi040 ceph-mon[30787]: pgmap v556: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 6.17k op/s 2024-09-11T22:36:41.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:40 smithi177 ceph-mon[35530]: pgmap v557: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 MiB/s wr, 8.66k op/s 2024-09-11T22:36:41.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:40 smithi146 ceph-mon[34996]: pgmap v557: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 MiB/s wr, 8.66k op/s 2024-09-11T22:36:41.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:40 smithi040 ceph-mon[30787]: pgmap v557: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 MiB/s wr, 8.66k op/s 2024-09-11T22:36:43.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:42 smithi146 ceph-mon[34996]: pgmap v558: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 6.01k op/s 2024-09-11T22:36:43.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:42 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:36:43.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:42 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:36:43.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:42 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:36:43.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:42 smithi040 ceph-mon[30787]: pgmap v558: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 6.01k op/s 2024-09-11T22:36:43.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:42 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:36:43.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:42 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:36:43.240 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:42 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:36:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:42 smithi177 ceph-mon[35530]: pgmap v558: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 6.01k op/s 2024-09-11T22:36:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:42 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:36:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:42 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:36:43.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:42 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:36:45.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:44 smithi146 ceph-mon[34996]: pgmap v559: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 6.49k op/s 2024-09-11T22:36:45.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:44 smithi040 ceph-mon[30787]: pgmap v559: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 6.49k op/s 2024-09-11T22:36:45.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:44 smithi177 ceph-mon[35530]: pgmap v559: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 6.49k op/s 2024-09-11T22:36:47.083 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:46 smithi177 ceph-mon[35530]: pgmap v560: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 43 MiB/s wr, 7.61k op/s 2024-09-11T22:36:47.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:46 smithi146 ceph-mon[34996]: pgmap v560: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 43 MiB/s wr, 7.61k op/s 2024-09-11T22:36:47.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:46 smithi040 ceph-mon[30787]: pgmap v560: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 43 MiB/s wr, 7.61k op/s 2024-09-11T22:36:49.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:48 smithi146 ceph-mon[34996]: pgmap v561: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 33 MiB/s wr, 6.05k op/s 2024-09-11T22:36:49.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:48 smithi040 ceph-mon[30787]: pgmap v561: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 33 MiB/s wr, 6.05k op/s 2024-09-11T22:36:49.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:48 smithi177 ceph-mon[35530]: pgmap v561: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 33 MiB/s wr, 6.05k op/s 2024-09-11T22:36:51.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:50 smithi146 ceph-mon[34996]: pgmap v562: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 MiB/s wr, 7.72k op/s 2024-09-11T22:36:51.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:50 smithi040 ceph-mon[30787]: pgmap v562: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 MiB/s wr, 7.72k op/s 2024-09-11T22:36:51.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:50 smithi177 ceph-mon[35530]: pgmap v562: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 MiB/s wr, 7.72k op/s 2024-09-11T22:36:53.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:52 smithi146 ceph-mon[34996]: pgmap v563: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 32 MiB/s wr, 5.81k op/s 2024-09-11T22:36:53.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:52 smithi040 ceph-mon[30787]: pgmap v563: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 32 MiB/s wr, 5.81k op/s 2024-09-11T22:36:53.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:52 smithi177 ceph-mon[35530]: pgmap v563: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 32 MiB/s wr, 5.81k op/s 2024-09-11T22:36:55.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:54 smithi040 ceph-mon[30787]: pgmap v564: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 MiB/s wr, 5.95k op/s 2024-09-11T22:36:55.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:54 smithi177 ceph-mon[35530]: pgmap v564: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 MiB/s wr, 5.95k op/s 2024-09-11T22:36:55.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:54 smithi146 ceph-mon[34996]: pgmap v564: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 33 MiB/s wr, 5.95k op/s 2024-09-11T22:36:57.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:56 smithi040 ceph-mon[30787]: pgmap v565: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 7.38k op/s 2024-09-11T22:36:57.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:56 smithi177 ceph-mon[35530]: pgmap v565: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 7.38k op/s 2024-09-11T22:36:57.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:56 smithi146 ceph-mon[34996]: pgmap v565: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 7.38k op/s 2024-09-11T22:36:59.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:36:58 smithi040 ceph-mon[30787]: pgmap v566: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 34 MiB/s wr, 5.89k op/s 2024-09-11T22:36:59.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:36:58 smithi177 ceph-mon[35530]: pgmap v566: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 34 MiB/s wr, 5.89k op/s 2024-09-11T22:36:59.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:36:58 smithi146 ceph-mon[34996]: pgmap v566: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 34 MiB/s wr, 5.89k op/s 2024-09-11T22:37:01.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:00 smithi040 ceph-mon[30787]: pgmap v567: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 43 MiB/s wr, 7.52k op/s 2024-09-11T22:37:01.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:00 smithi177 ceph-mon[35530]: pgmap v567: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 43 MiB/s wr, 7.52k op/s 2024-09-11T22:37:01.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:00 smithi146 ceph-mon[34996]: pgmap v567: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 43 MiB/s wr, 7.52k op/s 2024-09-11T22:37:03.236 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:02 smithi040 ceph-mon[30787]: pgmap v568: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 34 MiB/s wr, 5.96k op/s 2024-09-11T22:37:03.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:02 smithi177 ceph-mon[35530]: pgmap v568: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 34 MiB/s wr, 5.96k op/s 2024-09-11T22:37:03.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:02 smithi146 ceph-mon[34996]: pgmap v568: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 34 MiB/s wr, 5.96k op/s 2024-09-11T22:37:05.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:04 smithi040 ceph-mon[30787]: pgmap v569: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 5.69k op/s 2024-09-11T22:37:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:04 smithi177 ceph-mon[35530]: pgmap v569: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 5.69k op/s 2024-09-11T22:37:05.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:04 smithi146 ceph-mon[34996]: pgmap v569: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 32 MiB/s wr, 5.69k op/s 2024-09-11T22:37:07.238 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:06 smithi040 ceph-mon[30787]: pgmap v570: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 7.72k op/s 2024-09-11T22:37:07.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:06 smithi177 ceph-mon[35530]: pgmap v570: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 7.72k op/s 2024-09-11T22:37:07.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:06 smithi146 ceph-mon[34996]: pgmap v570: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 7.72k op/s 2024-09-11T22:37:09.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:08 smithi177 ceph-mon[35530]: pgmap v571: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 30 MiB/s wr, 5.57k op/s 2024-09-11T22:37:09.334 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:08 smithi146 ceph-mon[34996]: pgmap v571: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 30 MiB/s wr, 5.57k op/s 2024-09-11T22:37:09.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:08 smithi040 ceph-mon[30787]: pgmap v571: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 30 MiB/s wr, 5.57k op/s 2024-09-11T22:37:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:10 smithi177 ceph-mon[35530]: pgmap v572: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 40 MiB/s wr, 7.35k op/s 2024-09-11T22:37:11.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:10 smithi146 ceph-mon[34996]: pgmap v572: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 40 MiB/s wr, 7.35k op/s 2024-09-11T22:37:11.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:10 smithi040 ceph-mon[30787]: pgmap v572: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 40 MiB/s wr, 7.35k op/s 2024-09-11T22:37:13.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:13 smithi177 ceph-mon[35530]: pgmap v573: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 MiB/s wr, 5.86k op/s 2024-09-11T22:37:13.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:13 smithi146 ceph-mon[34996]: pgmap v573: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 MiB/s wr, 5.86k op/s 2024-09-11T22:37:13.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:13 smithi040 ceph-mon[30787]: pgmap v573: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 MiB/s wr, 5.86k op/s 2024-09-11T22:37:15.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:15 smithi177 ceph-mon[35530]: pgmap v574: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 MiB/s wr, 6.04k op/s 2024-09-11T22:37:15.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:15 smithi146 ceph-mon[34996]: pgmap v574: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 MiB/s wr, 6.04k op/s 2024-09-11T22:37:15.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:15 smithi040 ceph-mon[30787]: pgmap v574: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 MiB/s wr, 6.04k op/s 2024-09-11T22:37:17.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:17 smithi177 ceph-mon[35530]: pgmap v575: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 7.83k op/s 2024-09-11T22:37:17.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:17 smithi146 ceph-mon[34996]: pgmap v575: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 7.83k op/s 2024-09-11T22:37:17.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:17 smithi040 ceph-mon[30787]: pgmap v575: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 7.83k op/s 2024-09-11T22:37:19.335 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:19 smithi146 ceph-mon[34996]: pgmap v576: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 MiB/s wr, 5.78k op/s 2024-09-11T22:37:19.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:19 smithi040 ceph-mon[30787]: pgmap v576: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 MiB/s wr, 5.78k op/s 2024-09-11T22:37:19.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:19 smithi177 ceph-mon[35530]: pgmap v576: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 33 MiB/s wr, 5.78k op/s 2024-09-11T22:37:21.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:21 smithi146 ceph-mon[34996]: pgmap v577: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 41 MiB/s wr, 7.44k op/s 2024-09-11T22:37:21.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:21 smithi040 ceph-mon[30787]: pgmap v577: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 41 MiB/s wr, 7.44k op/s 2024-09-11T22:37:21.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:21 smithi177 ceph-mon[35530]: pgmap v577: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 41 MiB/s wr, 7.44k op/s 2024-09-11T22:37:23.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:23 smithi146 ceph-mon[34996]: pgmap v578: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 MiB/s wr, 6.01k op/s 2024-09-11T22:37:23.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:23 smithi040 ceph-mon[30787]: pgmap v578: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 MiB/s wr, 6.01k op/s 2024-09-11T22:37:23.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:23 smithi177 ceph-mon[35530]: pgmap v578: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 33 MiB/s wr, 6.01k op/s 2024-09-11T22:37:25.333 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:25 smithi146 ceph-mon[34996]: pgmap v579: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 33 MiB/s wr, 5.90k op/s 2024-09-11T22:37:25.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:25 smithi040 ceph-mon[30787]: pgmap v579: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 33 MiB/s wr, 5.90k op/s 2024-09-11T22:37:25.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:25 smithi177 ceph-mon[35530]: pgmap v579: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 33 MiB/s wr, 5.90k op/s 2024-09-11T22:37:27.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:27 smithi040 ceph-mon[30787]: pgmap v580: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 42 MiB/s wr, 7.55k op/s 2024-09-11T22:37:27.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:27 smithi177 ceph-mon[35530]: pgmap v580: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 42 MiB/s wr, 7.55k op/s 2024-09-11T22:37:27.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:27 smithi146 ceph-mon[34996]: pgmap v580: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 42 MiB/s wr, 7.55k op/s 2024-09-11T22:37:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:29 smithi040 ceph-mon[30787]: pgmap v581: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 6.05k op/s 2024-09-11T22:37:29.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:29 smithi177 ceph-mon[35530]: pgmap v581: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 6.05k op/s 2024-09-11T22:37:29.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:29 smithi146 ceph-mon[34996]: pgmap v581: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 6.05k op/s 2024-09-11T22:37:31.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:31 smithi040 ceph-mon[30787]: pgmap v582: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 40 MiB/s wr, 7.48k op/s 2024-09-11T22:37:31.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:31 smithi177 ceph-mon[35530]: pgmap v582: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 40 MiB/s wr, 7.48k op/s 2024-09-11T22:37:31.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:31 smithi146 ceph-mon[34996]: pgmap v582: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 40 MiB/s wr, 7.48k op/s 2024-09-11T22:37:33.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:33 smithi040 ceph-mon[30787]: pgmap v583: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 33 MiB/s wr, 6.05k op/s 2024-09-11T22:37:33.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:33 smithi177 ceph-mon[35530]: pgmap v583: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 33 MiB/s wr, 6.05k op/s 2024-09-11T22:37:33.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:33 smithi146 ceph-mon[34996]: pgmap v583: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 33 MiB/s wr, 6.05k op/s 2024-09-11T22:37:35.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:35 smithi040 ceph-mon[30787]: pgmap v584: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 5.67k op/s 2024-09-11T22:37:35.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:35 smithi177 ceph-mon[35530]: pgmap v584: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 5.67k op/s 2024-09-11T22:37:35.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:35 smithi146 ceph-mon[34996]: pgmap v584: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 30 MiB/s wr, 5.67k op/s 2024-09-11T22:37:36.497 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:36 smithi040 ceph-mon[30787]: pgmap v585: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 6.94k op/s 2024-09-11T22:37:36.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:36 smithi177 ceph-mon[35530]: pgmap v585: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 6.94k op/s 2024-09-11T22:37:36.583 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:36 smithi146 ceph-mon[34996]: pgmap v585: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 6.94k op/s 2024-09-11T22:37:38.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:38 smithi040 ceph-mon[30787]: pgmap v586: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 5.61k op/s 2024-09-11T22:37:38.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:38 smithi177 ceph-mon[35530]: pgmap v586: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 5.61k op/s 2024-09-11T22:37:38.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:38 smithi146 ceph-mon[34996]: pgmap v586: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 5.61k op/s 2024-09-11T22:37:40.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:40 smithi040 ceph-mon[30787]: pgmap v587: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 MiB/s wr, 6.57k op/s 2024-09-11T22:37:40.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:40 smithi177 ceph-mon[35530]: pgmap v587: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 MiB/s wr, 6.57k op/s 2024-09-11T22:37:40.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:40 smithi146 ceph-mon[34996]: pgmap v587: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 MiB/s wr, 6.57k op/s 2024-09-11T22:37:42.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:42 smithi040 ceph-mon[30787]: pgmap v588: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 5.20k op/s 2024-09-11T22:37:42.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:42 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:37:42.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:42 smithi177 ceph-mon[35530]: pgmap v588: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 5.20k op/s 2024-09-11T22:37:42.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:42 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:37:42.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:42 smithi146 ceph-mon[34996]: pgmap v588: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 5.20k op/s 2024-09-11T22:37:42.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:42 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:37:43.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:43 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:43 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:43 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:43 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:43 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:43 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:43 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:43 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:43 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:43 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:43 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:43.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:43 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:44.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:44 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi177 to 175.9M 2024-09-11T22:37:44.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi177 to 175.9M 2024-09-11T22:37:44.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: Unable to set osd_memory_target on smithi177 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-11T22:37:44.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: pgmap v589: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 5.57k op/s 2024-09-11T22:37:44.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:44.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:44.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:44.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:44.787 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: Adjusting osd_memory_target on smithi146 to 176.0M 2024-09-11T22:37:44.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: Unable to set osd_memory_target on smithi146 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-11T22:37:44.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:37:44.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:37:44.788 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:44 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:37:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi177 to 175.9M 2024-09-11T22:37:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: Unable to set osd_memory_target on smithi177 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-11T22:37:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: pgmap v589: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 5.57k op/s 2024-09-11T22:37:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: Adjusting osd_memory_target on smithi146 to 176.0M 2024-09-11T22:37:44.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: Unable to set osd_memory_target on smithi146 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-11T22:37:44.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:37:44.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:37:44.835 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:44 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:37:45.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: Unable to set osd_memory_target on smithi177 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: pgmap v589: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 5.57k op/s 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: Adjusting osd_memory_target on smithi146 to 176.0M 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: Unable to set osd_memory_target on smithi146 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:37:45.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:45 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:37:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:46 smithi040 ceph-mon[30787]: pgmap v590: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 6.48k op/s 2024-09-11T22:37:47.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:46 smithi177 ceph-mon[35530]: pgmap v590: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 6.48k op/s 2024-09-11T22:37:47.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:46 smithi146 ceph-mon[34996]: pgmap v590: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 6.48k op/s 2024-09-11T22:37:48.994 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:48 smithi040 ceph-mon[30787]: pgmap v591: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 5.57k op/s 2024-09-11T22:37:49.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:48 smithi177 ceph-mon[35530]: pgmap v591: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 5.57k op/s 2024-09-11T22:37:49.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:48 smithi146 ceph-mon[34996]: pgmap v591: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 5.57k op/s 2024-09-11T22:37:50.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:50 smithi040 ceph-mon[30787]: pgmap v592: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 35 MiB/s wr, 6.62k op/s 2024-09-11T22:37:51.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:50 smithi177 ceph-mon[35530]: pgmap v592: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 35 MiB/s wr, 6.62k op/s 2024-09-11T22:37:51.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:50 smithi146 ceph-mon[34996]: pgmap v592: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 35 MiB/s wr, 6.62k op/s 2024-09-11T22:37:52.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:52 smithi040 ceph-mon[30787]: pgmap v593: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 5.28k op/s 2024-09-11T22:37:53.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:52 smithi177 ceph-mon[35530]: pgmap v593: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 5.28k op/s 2024-09-11T22:37:53.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:52 smithi146 ceph-mon[34996]: pgmap v593: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 5.28k op/s 2024-09-11T22:37:54.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:54 smithi040 ceph-mon[30787]: pgmap v594: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 5.42k op/s 2024-09-11T22:37:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:54 smithi177 ceph-mon[35530]: pgmap v594: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 5.42k op/s 2024-09-11T22:37:55.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:54 smithi146 ceph-mon[34996]: pgmap v594: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 29 MiB/s wr, 5.42k op/s 2024-09-11T22:37:56.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:56 smithi040 ceph-mon[30787]: pgmap v595: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 6.71k op/s 2024-09-11T22:37:57.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:56 smithi177 ceph-mon[35530]: pgmap v595: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 6.71k op/s 2024-09-11T22:37:57.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:56 smithi146 ceph-mon[34996]: pgmap v595: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 36 MiB/s wr, 6.71k op/s 2024-09-11T22:37:59.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:37:58 smithi177 ceph-mon[35530]: pgmap v596: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 5.38k op/s 2024-09-11T22:37:59.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:37:58 smithi146 ceph-mon[34996]: pgmap v596: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 5.38k op/s 2024-09-11T22:37:59.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:37:58 smithi040 ceph-mon[30787]: pgmap v596: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 5.38k op/s 2024-09-11T22:38:01.035 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:00 smithi177 ceph-mon[35530]: pgmap v597: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 6.22k op/s 2024-09-11T22:38:01.040 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:00 smithi040 ceph-mon[30787]: pgmap v597: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 6.22k op/s 2024-09-11T22:38:01.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:00 smithi146 ceph-mon[34996]: pgmap v597: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 6.22k op/s 2024-09-11T22:38:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:02 smithi177 ceph-mon[35530]: pgmap v598: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 5.31k op/s 2024-09-11T22:38:03.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:02 smithi146 ceph-mon[34996]: pgmap v598: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 5.31k op/s 2024-09-11T22:38:03.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:02 smithi040 ceph-mon[30787]: pgmap v598: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 5.31k op/s 2024-09-11T22:38:05.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:04 smithi146 ceph-mon[34996]: pgmap v599: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 31 MiB/s wr, 5.88k op/s 2024-09-11T22:38:05.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:04 smithi040 ceph-mon[30787]: pgmap v599: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 31 MiB/s wr, 5.88k op/s 2024-09-11T22:38:05.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:04 smithi177 ceph-mon[35530]: pgmap v599: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 31 MiB/s wr, 5.88k op/s 2024-09-11T22:38:07.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:06 smithi146 ceph-mon[34996]: pgmap v600: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 36 MiB/s wr, 6.68k op/s 2024-09-11T22:38:07.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:06 smithi040 ceph-mon[30787]: pgmap v600: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 36 MiB/s wr, 6.68k op/s 2024-09-11T22:38:07.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:06 smithi177 ceph-mon[35530]: pgmap v600: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 36 MiB/s wr, 6.68k op/s 2024-09-11T22:38:09.083 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:08 smithi146 ceph-mon[34996]: pgmap v601: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 5.06k op/s 2024-09-11T22:38:09.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:08 smithi040 ceph-mon[30787]: pgmap v601: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 5.06k op/s 2024-09-11T22:38:09.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:08 smithi177 ceph-mon[35530]: pgmap v601: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 MiB/s wr, 5.06k op/s 2024-09-11T22:38:11.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:10 smithi146 ceph-mon[34996]: pgmap v602: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 36 MiB/s wr, 6.77k op/s 2024-09-11T22:38:11.237 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:10 smithi040 ceph-mon[30787]: pgmap v602: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 36 MiB/s wr, 6.77k op/s 2024-09-11T22:38:11.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:10 smithi177 ceph-mon[35530]: pgmap v602: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 36 MiB/s wr, 6.77k op/s 2024-09-11T22:38:13.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:12 smithi146 ceph-mon[34996]: pgmap v603: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 32 MiB/s wr, 5.94k op/s 2024-09-11T22:38:13.239 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:12 smithi040 ceph-mon[30787]: pgmap v603: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 32 MiB/s wr, 5.94k op/s 2024-09-11T22:38:13.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:12 smithi177 ceph-mon[35530]: pgmap v603: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 32 MiB/s wr, 5.94k op/s 2024-09-11T22:38:15.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:14 smithi146 ceph-mon[34996]: pgmap v604: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 30 MiB/s wr, 5.52k op/s 2024-09-11T22:38:15.244 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:14 smithi040 ceph-mon[30787]: pgmap v604: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 30 MiB/s wr, 5.52k op/s 2024-09-11T22:38:15.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:14 smithi177 ceph-mon[35530]: pgmap v604: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 30 MiB/s wr, 5.52k op/s 2024-09-11T22:38:17.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:17 smithi040 ceph-mon[30787]: pgmap v605: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 36 MiB/s wr, 6.56k op/s 2024-09-11T22:38:17.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:17 smithi177 ceph-mon[35530]: pgmap v605: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 36 MiB/s wr, 6.56k op/s 2024-09-11T22:38:17.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:17 smithi146 ceph-mon[34996]: pgmap v605: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 36 MiB/s wr, 6.56k op/s 2024-09-11T22:38:18.486 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:18 smithi040 ceph-mon[30787]: pgmap v606: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 5.64k op/s 2024-09-11T22:38:18.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:18 smithi177 ceph-mon[35530]: pgmap v606: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 5.64k op/s 2024-09-11T22:38:18.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:18 smithi146 ceph-mon[34996]: pgmap v606: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 MiB/s wr, 5.64k op/s 2024-09-11T22:38:20.737 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:20 smithi040 ceph-mon[30787]: pgmap v607: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 7.07k op/s 2024-09-11T22:38:20.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:20 smithi177 ceph-mon[35530]: pgmap v607: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 7.07k op/s 2024-09-11T22:38:20.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:20 smithi146 ceph-mon[34996]: pgmap v607: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 38 MiB/s wr, 7.07k op/s 2024-09-11T22:38:22.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:22 smithi040 ceph-mon[30787]: pgmap v608: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 MiB/s wr, 5.50k op/s 2024-09-11T22:38:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:22 smithi177 ceph-mon[35530]: pgmap v608: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 MiB/s wr, 5.50k op/s 2024-09-11T22:38:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:22 smithi146 ceph-mon[34996]: pgmap v608: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 MiB/s wr, 5.50k op/s 2024-09-11T22:38:24.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:38:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:38:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:38:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:38:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:38:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:38:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:38:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:38:24.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T22:38:24.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:38:24.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:38:24.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:38:24.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:38:24.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:38:24.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:38:25.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T22:38:25.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T22:38:25.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:38:25.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:38:25.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:38:25.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:38:29.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:29 smithi040 ceph-mon[30787]: pgmap v610: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 MiB/s wr, 6.83k op/s 2024-09-11T22:38:29.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:29 smithi040 ceph-mon[30787]: pgmap v611: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 27 MiB/s wr, 5.04k op/s 2024-09-11T22:38:29.736 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:29 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:38:29.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:29 smithi177 ceph-mon[35530]: pgmap v610: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 MiB/s wr, 6.83k op/s 2024-09-11T22:38:29.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:29 smithi177 ceph-mon[35530]: pgmap v611: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 27 MiB/s wr, 5.04k op/s 2024-09-11T22:38:29.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:29 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:38:29.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:29 smithi146 ceph-mon[34996]: pgmap v610: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 MiB/s wr, 6.83k op/s 2024-09-11T22:38:29.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:29 smithi146 ceph-mon[34996]: pgmap v611: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 27 MiB/s wr, 5.04k op/s 2024-09-11T22:38:29.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:29 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:38:30.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:30 smithi177 ceph-mon[35530]: pgmap v612: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 MiB/s wr, 6.47k op/s 2024-09-11T22:38:30.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:30 smithi146 ceph-mon[34996]: pgmap v612: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 MiB/s wr, 6.47k op/s 2024-09-11T22:38:30.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:30 smithi040 ceph-mon[30787]: pgmap v612: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 MiB/s wr, 6.47k op/s 2024-09-11T22:38:32.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:32 smithi177 ceph-mon[35530]: pgmap v613: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 MiB/s wr, 5.48k op/s 2024-09-11T22:38:32.788 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:32 smithi040 ceph-mon[30787]: pgmap v613: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 MiB/s wr, 5.48k op/s 2024-09-11T22:38:32.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:32 smithi146 ceph-mon[34996]: pgmap v613: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 MiB/s wr, 5.48k op/s 2024-09-11T22:38:34.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:34 smithi177 ceph-mon[35530]: pgmap v614: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 5.88k op/s 2024-09-11T22:38:34.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:34 smithi146 ceph-mon[34996]: pgmap v614: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 5.88k op/s 2024-09-11T22:38:34.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:34 smithi040 ceph-mon[30787]: pgmap v614: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 5.88k op/s 2024-09-11T22:38:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:36 smithi177 ceph-mon[35530]: pgmap v615: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 MiB/s wr, 6.80k op/s 2024-09-11T22:38:36.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:36 smithi146 ceph-mon[34996]: pgmap v615: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 MiB/s wr, 6.80k op/s 2024-09-11T22:38:36.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:36 smithi040 ceph-mon[30787]: pgmap v615: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 MiB/s wr, 6.80k op/s 2024-09-11T22:38:38.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:38 smithi177 ceph-mon[35530]: pgmap v616: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 MiB/s wr, 5.45k op/s 2024-09-11T22:38:38.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:38 smithi146 ceph-mon[34996]: pgmap v616: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 MiB/s wr, 5.45k op/s 2024-09-11T22:38:38.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:38 smithi040 ceph-mon[30787]: pgmap v616: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 MiB/s wr, 5.45k op/s 2024-09-11T22:38:40.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:40 smithi177 ceph-mon[35530]: pgmap v617: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 MiB/s wr, 6.24k op/s 2024-09-11T22:38:40.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:40 smithi146 ceph-mon[34996]: pgmap v617: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 MiB/s wr, 6.24k op/s 2024-09-11T22:38:40.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:40 smithi040 ceph-mon[30787]: pgmap v617: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 MiB/s wr, 6.24k op/s 2024-09-11T22:38:42.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:42 smithi146 ceph-mon[34996]: pgmap v618: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 5.23k op/s 2024-09-11T22:38:42.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:42 smithi040 ceph-mon[30787]: pgmap v618: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 5.23k op/s 2024-09-11T22:38:43.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:42 smithi177 ceph-mon[35530]: pgmap v618: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 28 MiB/s wr, 5.23k op/s 2024-09-11T22:38:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:44 smithi146 ceph-mon[34996]: pgmap v619: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 5.64k op/s 2024-09-11T22:38:44.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:44 smithi040 ceph-mon[30787]: pgmap v619: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 5.64k op/s 2024-09-11T22:38:45.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:44 smithi177 ceph-mon[35530]: pgmap v619: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 5.64k op/s 2024-09-11T22:38:46.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:46 smithi146 ceph-mon[34996]: pgmap v620: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 31 MiB/s wr, 5.77k op/s 2024-09-11T22:38:46.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:46 smithi040 ceph-mon[30787]: pgmap v620: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 31 MiB/s wr, 5.77k op/s 2024-09-11T22:38:47.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:46 smithi177 ceph-mon[35530]: pgmap v620: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 31 MiB/s wr, 5.77k op/s 2024-09-11T22:38:48.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:48 smithi146 ceph-mon[34996]: pgmap v621: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 24 MiB/s wr, 4.49k op/s 2024-09-11T22:38:48.834 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:48 smithi177 ceph-mon[35530]: pgmap v621: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 24 MiB/s wr, 4.49k op/s 2024-09-11T22:38:48.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:48 smithi040 ceph-mon[30787]: pgmap v621: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 24 MiB/s wr, 4.49k op/s 2024-09-11T22:38:50.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:50 smithi146 ceph-mon[34996]: pgmap v622: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 29 MiB/s wr, 5.61k op/s 2024-09-11T22:38:50.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:50 smithi040 ceph-mon[30787]: pgmap v622: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 29 MiB/s wr, 5.61k op/s 2024-09-11T22:38:51.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:50 smithi177 ceph-mon[35530]: pgmap v622: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 29 MiB/s wr, 5.61k op/s 2024-09-11T22:38:52.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:52 smithi040 ceph-mon[30787]: pgmap v623: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 33 MiB/s wr, 6.28k op/s 2024-09-11T22:38:53.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:52 smithi177 ceph-mon[35530]: pgmap v623: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 33 MiB/s wr, 6.28k op/s 2024-09-11T22:38:53.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:52 smithi146 ceph-mon[34996]: pgmap v623: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 33 MiB/s wr, 6.28k op/s 2024-09-11T22:38:54.886 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:54 smithi146 ceph-mon[34996]: pgmap v624: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 32 MiB/s wr, 6.21k op/s 2024-09-11T22:38:54.987 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:54 smithi040 ceph-mon[30787]: pgmap v624: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 32 MiB/s wr, 6.21k op/s 2024-09-11T22:38:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:54 smithi177 ceph-mon[35530]: pgmap v624: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 32 MiB/s wr, 6.21k op/s 2024-09-11T22:38:56.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:56 smithi040 ceph-mon[30787]: pgmap v625: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 32 MiB/s wr, 6.21k op/s 2024-09-11T22:38:57.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:56 smithi177 ceph-mon[35530]: pgmap v625: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 32 MiB/s wr, 6.21k op/s 2024-09-11T22:38:57.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:56 smithi146 ceph-mon[34996]: pgmap v625: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 32 MiB/s wr, 6.21k op/s 2024-09-11T22:38:58.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:38:58 smithi040 ceph-mon[30787]: pgmap v626: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 35 MiB/s wr, 6.99k op/s 2024-09-11T22:38:59.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:38:58 smithi177 ceph-mon[35530]: pgmap v626: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 35 MiB/s wr, 6.99k op/s 2024-09-11T22:38:59.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:38:58 smithi146 ceph-mon[34996]: pgmap v626: 129 pgs: 129 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 35 MiB/s wr, 6.99k op/s 2024-09-11T22:39:00.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:00 smithi040 ceph-mon[30787]: pgmap v627: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 39 MiB/s wr, 7.72k op/s 2024-09-11T22:39:01.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:00 smithi177 ceph-mon[35530]: pgmap v627: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 39 MiB/s wr, 7.72k op/s 2024-09-11T22:39:01.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:00 smithi146 ceph-mon[34996]: pgmap v627: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 39 MiB/s wr, 7.72k op/s 2024-09-11T22:39:02.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:02 smithi040 ceph-mon[30787]: pgmap v628: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 37 MiB/s wr, 7.45k op/s 2024-09-11T22:39:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:02 smithi177 ceph-mon[35530]: pgmap v628: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 37 MiB/s wr, 7.45k op/s 2024-09-11T22:39:03.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:02 smithi146 ceph-mon[34996]: pgmap v628: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 37 MiB/s wr, 7.45k op/s 2024-09-11T22:39:04.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:04 smithi040 ceph-mon[30787]: pgmap v629: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 32 MiB/s wr, 6.57k op/s 2024-09-11T22:39:05.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:04 smithi177 ceph-mon[35530]: pgmap v629: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 32 MiB/s wr, 6.57k op/s 2024-09-11T22:39:05.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:04 smithi146 ceph-mon[34996]: pgmap v629: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 32 MiB/s wr, 6.57k op/s 2024-09-11T22:39:06.991 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:06 smithi040 ceph-mon[30787]: pgmap v630: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 29 MiB/s wr, 6.03k op/s 2024-09-11T22:39:08.102 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:06 smithi146 ceph-mon[34996]: pgmap v630: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 29 MiB/s wr, 6.03k op/s 2024-09-11T22:39:08.102 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:06 smithi177 ceph-mon[35530]: pgmap v630: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 29 MiB/s wr, 6.03k op/s 2024-09-11T22:39:08.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:08 smithi040 ceph-mon[30787]: pgmap v631: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 29 MiB/s wr, 6.04k op/s 2024-09-11T22:39:09.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:08 smithi177 ceph-mon[35530]: pgmap v631: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 29 MiB/s wr, 6.04k op/s 2024-09-11T22:39:09.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:08 smithi146 ceph-mon[34996]: pgmap v631: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 29 MiB/s wr, 6.04k op/s 2024-09-11T22:39:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:10 smithi040 ceph-mon[30787]: pgmap v632: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 24 MiB/s wr, 4.91k op/s 2024-09-11T22:39:11.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:10 smithi177 ceph-mon[35530]: pgmap v632: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 24 MiB/s wr, 4.91k op/s 2024-09-11T22:39:11.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:10 smithi146 ceph-mon[34996]: pgmap v632: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 24 MiB/s wr, 4.91k op/s 2024-09-11T22:39:12.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:12 smithi040 ceph-mon[30787]: pgmap v633: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 23 MiB/s wr, 4.73k op/s 2024-09-11T22:39:13.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:12 smithi177 ceph-mon[35530]: pgmap v633: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 23 MiB/s wr, 4.73k op/s 2024-09-11T22:39:13.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:12 smithi146 ceph-mon[34996]: pgmap v633: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 23 MiB/s wr, 4.73k op/s 2024-09-11T22:39:14.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:14 smithi040 ceph-mon[30787]: pgmap v634: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 21 MiB/s wr, 4.49k op/s 2024-09-11T22:39:15.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:14 smithi177 ceph-mon[35530]: pgmap v634: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 21 MiB/s wr, 4.49k op/s 2024-09-11T22:39:15.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:14 smithi146 ceph-mon[34996]: pgmap v634: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 21 MiB/s wr, 4.49k op/s 2024-09-11T22:39:16.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:16 smithi040 ceph-mon[30787]: pgmap v635: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 20 MiB/s wr, 4.23k op/s 2024-09-11T22:39:17.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:16 smithi177 ceph-mon[35530]: pgmap v635: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 20 MiB/s wr, 4.23k op/s 2024-09-11T22:39:17.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:16 smithi146 ceph-mon[34996]: pgmap v635: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 20 MiB/s wr, 4.23k op/s 2024-09-11T22:39:18.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:18 smithi040 ceph-mon[30787]: pgmap v636: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 26 MiB/s wr, 5.61k op/s 2024-09-11T22:39:19.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:18 smithi177 ceph-mon[35530]: pgmap v636: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 26 MiB/s wr, 5.61k op/s 2024-09-11T22:39:19.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:18 smithi146 ceph-mon[34996]: pgmap v636: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 26 MiB/s wr, 5.61k op/s 2024-09-11T22:39:19.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:19 smithi040 ceph-mon[30787]: pgmap v637: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 22 MiB/s wr, 4.78k op/s 2024-09-11T22:39:20.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:19 smithi177 ceph-mon[35530]: pgmap v637: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 22 MiB/s wr, 4.78k op/s 2024-09-11T22:39:20.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:19 smithi146 ceph-mon[34996]: pgmap v637: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 22 MiB/s wr, 4.78k op/s 2024-09-11T22:39:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:22 smithi177 ceph-mon[35530]: pgmap v638: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 26 MiB/s wr, 5.68k op/s 2024-09-11T22:39:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:22 smithi146 ceph-mon[34996]: pgmap v638: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 26 MiB/s wr, 5.68k op/s 2024-09-11T22:39:22.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:22 smithi040 ceph-mon[30787]: pgmap v638: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 26 MiB/s wr, 5.68k op/s 2024-09-11T22:39:24.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:24 smithi177 ceph-mon[35530]: pgmap v639: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 27 MiB/s wr, 5.80k op/s 2024-09-11T22:39:24.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:24 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:39:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:24 smithi146 ceph-mon[34996]: pgmap v639: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 27 MiB/s wr, 5.80k op/s 2024-09-11T22:39:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:24 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:39:24.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:24 smithi040 ceph-mon[30787]: pgmap v639: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 27 MiB/s wr, 5.80k op/s 2024-09-11T22:39:24.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:24 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:39:25.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:39:25.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:39:25.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:39:25.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:39:25.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:39:25.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:39:25.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:39:25.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:39:25.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:39:26.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:26 smithi177 ceph-mon[35530]: pgmap v640: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 23 MiB/s wr, 4.97k op/s 2024-09-11T22:39:26.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:26 smithi146 ceph-mon[34996]: pgmap v640: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 23 MiB/s wr, 4.97k op/s 2024-09-11T22:39:26.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:26 smithi040 ceph-mon[30787]: pgmap v640: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 23 MiB/s wr, 4.97k op/s 2024-09-11T22:39:28.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:28 smithi177 ceph-mon[35530]: pgmap v641: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 26 MiB/s wr, 5.59k op/s 2024-09-11T22:39:28.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:28 smithi146 ceph-mon[34996]: pgmap v641: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 26 MiB/s wr, 5.59k op/s 2024-09-11T22:39:28.986 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:28 smithi040 ceph-mon[30787]: pgmap v641: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 26 MiB/s wr, 5.59k op/s 2024-09-11T22:39:30.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:30 smithi177 ceph-mon[35530]: pgmap v642: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 20 MiB/s wr, 4.44k op/s 2024-09-11T22:39:30.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:30 smithi146 ceph-mon[34996]: pgmap v642: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 20 MiB/s wr, 4.44k op/s 2024-09-11T22:39:30.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:30 smithi040 ceph-mon[30787]: pgmap v642: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 20 MiB/s wr, 4.44k op/s 2024-09-11T22:39:32.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:32 smithi177 ceph-mon[35530]: pgmap v643: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 21 MiB/s wr, 4.51k op/s 2024-09-11T22:39:32.786 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:32 smithi040 ceph-mon[30787]: pgmap v643: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 21 MiB/s wr, 4.51k op/s 2024-09-11T22:39:32.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:32 smithi146 ceph-mon[34996]: pgmap v643: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 21 MiB/s wr, 4.51k op/s 2024-09-11T22:39:34.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:34 smithi177 ceph-mon[35530]: pgmap v644: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 19 MiB/s wr, 4.31k op/s 2024-09-11T22:39:34.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:34 smithi146 ceph-mon[34996]: pgmap v644: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 19 MiB/s wr, 4.31k op/s 2024-09-11T22:39:34.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:34 smithi040 ceph-mon[30787]: pgmap v644: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 19 MiB/s wr, 4.31k op/s 2024-09-11T22:39:36.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:36 smithi177 ceph-mon[35530]: pgmap v645: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 16 MiB/s wr, 3.50k op/s 2024-09-11T22:39:36.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:36 smithi146 ceph-mon[34996]: pgmap v645: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 16 MiB/s wr, 3.50k op/s 2024-09-11T22:39:36.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:36 smithi040 ceph-mon[30787]: pgmap v645: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 16 MiB/s wr, 3.50k op/s 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout:Syncing()...52 sec 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout:FFSB benchmark finished at: Wed Sep 11 22:39:37 2024 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout:Results: 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout:Benchmark took 371.50 sec 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout:Total Results 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout:=============== 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-11T22:39:37.412 INFO:tasks.workunit.client.0.smithi040.stdout: ======= ============ ========= ======= =========== ========== 2024-09-11T22:39:37.413 INFO:tasks.workunit.client.0.smithi040.stdout: write : 5903360 15890.69 100.000% 100.000% 62.1MB/sec 2024-09-11T22:39:37.413 INFO:tasks.workunit.client.0.smithi040.stdout:- 2024-09-11T22:39:37.413 INFO:tasks.workunit.client.0.smithi040.stdout:15890.69 Transactions per Second 2024-09-11T22:39:37.413 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.413 INFO:tasks.workunit.client.0.smithi040.stdout:Throughput Results 2024-09-11T22:39:37.413 INFO:tasks.workunit.client.0.smithi040.stdout:=================== 2024-09-11T22:39:37.413 INFO:tasks.workunit.client.0.smithi040.stdout:Write Throughput: 62.1MB/sec 2024-09-11T22:39:37.469 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.469 INFO:tasks.workunit.client.0.smithi040.stdout:System Call Latency statistics in millisecs 2024-09-11T22:39:37.469 INFO:tasks.workunit.client.0.smithi040.stdout:===== 2024-09-11T22:39:37.469 INFO:tasks.workunit.client.0.smithi040.stdout: Min Avg Max Total Calls 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: ======== ======== ======== ============ 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout:[ open] 0.018000 0.602684 167.585007 4612 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[5] 100.000000 - 200.000000 : 4 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[7] 20.000000 - 50.000000 : 5 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[8] 10.000000 - 20.000000 : 27 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[9] 5.000000 - 10.000000 : 55 2024-09-11T22:39:37.470 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[10] 2.000000 - 5.000000 : 170 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[11] 1.000000 - 2.000000 : 197 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[12] 0.500000 - 1.000000 : 178 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[13] 0.200000 - 0.500000 : 75 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[14] 0.100000 - 0.200000 : 608 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[15] 0.050000 - 0.100000 : 316 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[16] 0.020000 - 0.050000 : 2970 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[17] 0.010000 - 0.020000 : 5 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout:[ write] 0.003000 1.673230 34022.382812 5903360 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[0] 5000.000000 - 10000.000000 : 309 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[1] 2000.000000 - 5000.000000 : 341 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[2] 1000.000000 - 2000.000000 : 172 2024-09-11T22:39:37.471 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[3] 500.000000 - 1000.000000 : 253 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[4] 200.000000 - 500.000000 : 625 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[5] 100.000000 - 200.000000 : 2160 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[6] 50.000000 - 100.000000 : 839 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[7] 20.000000 - 50.000000 : 1538 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[8] 10.000000 - 20.000000 : 1769 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[9] 5.000000 - 10.000000 : 2168 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[10] 2.000000 - 5.000000 : 4001 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[11] 1.000000 - 2.000000 : 2247 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[12] 0.500000 - 1.000000 : 1892 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[13] 0.200000 - 0.500000 : 3683 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[14] 0.100000 - 0.200000 : 7024 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[15] 0.050000 - 0.100000 : 18104 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[16] 0.020000 - 0.050000 : 122778 2024-09-11T22:39:37.472 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[17] 0.010000 - 0.020000 : 1802385 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[18] 0.000000 - 0.010000 : 3930727 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout:[ lseek] 0.000000 0.002273 43.029999 5903360 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[7] 20.000000 - 50.000000 : 57 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[8] 10.000000 - 20.000000 : 151 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[9] 5.000000 - 10.000000 : 184 2024-09-11T22:39:37.473 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[10] 2.000000 - 5.000000 : 356 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[11] 1.000000 - 2.000000 : 197 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[12] 0.500000 - 1.000000 : 146 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[13] 0.200000 - 0.500000 : 260 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[14] 0.100000 - 0.200000 : 419 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[15] 0.050000 - 0.100000 : 983 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[16] 0.020000 - 0.050000 : 3672 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[17] 0.010000 - 0.020000 : 2728 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[18] 0.000000 - 0.010000 : 5894207 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout:[ close] 0.003000 0.014473 7.024000 4612 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T22:39:37.474 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[10] 2.000000 - 5.000000 : 3 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[11] 1.000000 - 2.000000 : 1 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[12] 0.500000 - 1.000000 : 1 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[13] 0.200000 - 0.500000 : 3 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[14] 0.100000 - 0.200000 : 4 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[15] 0.050000 - 0.100000 : 10 2024-09-11T22:39:37.475 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[16] 0.020000 - 0.050000 : 41 2024-09-11T22:39:37.476 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[17] 0.010000 - 0.020000 : 2477 2024-09-11T22:39:37.476 INFO:tasks.workunit.client.0.smithi040.stdout: msec_range[18] 0.000000 - 0.010000 : 2071 2024-09-11T22:39:37.476 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.476 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.476 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.476 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-09-11T22:39:37.476 INFO:tasks.workunit.client.0.smithi040.stdout:1.1% User Time 2024-09-11T22:39:37.476 INFO:tasks.workunit.client.0.smithi040.stdout:17.2% System Time 2024-09-11T22:39:37.476 INFO:tasks.workunit.client.0.smithi040.stdout:18.4% CPU Utilization 2024-09-11T22:39:37.483 INFO:tasks.workunit.client.0.smithi040.stderr:+ cd .. 2024-09-11T22:39:37.485 INFO:tasks.workunit.client.0.smithi040.stderr:+ rm -r tmp ffsb 2024-09-11T22:39:38.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:38 smithi177 ceph-mon[35530]: pgmap v646: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 17 MiB/s wr, 3.82k op/s 2024-09-11T22:39:38.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:38 smithi146 ceph-mon[34996]: pgmap v646: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 17 MiB/s wr, 3.82k op/s 2024-09-11T22:39:38.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:38 smithi040 ceph-mon[30787]: pgmap v646: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 17 MiB/s wr, 3.82k op/s 2024-09-11T22:39:40.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:40 smithi146 ceph-mon[34996]: pgmap v647: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 MiB/s wr, 2.78k op/s 2024-09-11T22:39:40.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:40 smithi040 ceph-mon[30787]: pgmap v647: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 MiB/s wr, 2.78k op/s 2024-09-11T22:39:41.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:40 smithi177 ceph-mon[35530]: pgmap v647: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 MiB/s wr, 2.78k op/s 2024-09-11T22:39:41.840 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T22:39:41.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T22:39:42.307 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-11T22:39:42.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T22:39:42.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:42 smithi146 ceph-mon[34996]: pgmap v648: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 10 MiB/s wr, 2.29k op/s 2024-09-11T22:39:42.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:42 smithi040 ceph-mon[30787]: pgmap v648: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 10 MiB/s wr, 2.29k op/s 2024-09-11T22:39:43.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:42 smithi177 ceph-mon[35530]: pgmap v648: 129 pgs: 129 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 10 MiB/s wr, 2.29k op/s 2024-09-11T22:39:44.514 DEBUG:teuthology.parallel:result is None 2024-09-11T22:39:44.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T22:39:44.641 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T22:39:44.641 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-11T22:39:44.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:39:44.766 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:44 smithi040 ceph-mon[30787]: pgmap v649: 129 pgs: 129 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.2 MiB/s wr, 1.84k op/s 2024-09-11T22:39:44.767 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:44 smithi040 ceph-mon[30787]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:39:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:44 smithi146 ceph-mon[34996]: pgmap v649: 129 pgs: 129 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.2 MiB/s wr, 1.84k op/s 2024-09-11T22:39:44.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:44 smithi146 ceph-mon[34996]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:39:45.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:44 smithi177 ceph-mon[35530]: pgmap v649: 129 pgs: 129 active+clean; 12 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.2 MiB/s wr, 1.84k op/s 2024-09-11T22:39:45.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:44 smithi177 ceph-mon[35530]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T22:39:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.344+0000 7f2fa2000640 1 -- 172.21.15.40:0/2571707405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9c0761d0 msgr2=0x7f2f9c074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.344+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2571707405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9c0761d0 0x7f2f9c074620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009900 tx=0x7f2f8c02a490 comp rx=0 tx=0).stop 2024-09-11T22:39:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.344+0000 7f2fa2000640 1 -- 172.21.15.40:0/2571707405 shutdown_connections 2024-09-11T22:39:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.345+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2571707405 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f9c1099c0 0x7f2f9c10be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.345+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2571707405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9c074bf0 0x7f2f9c075050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:45.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.345+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2571707405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9c0761d0 0x7f2f9c074620 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.345+0000 7f2fa2000640 1 -- 172.21.15.40:0/2571707405 >> 172.21.15.40:0/2571707405 conn(0x7f2f9c0fd2b0 msgr2=0x7f2f9c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.345+0000 7f2fa2000640 1 -- 172.21.15.40:0/2571707405 shutdown_connections 2024-09-11T22:39:45.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.346+0000 7f2fa2000640 1 -- 172.21.15.40:0/2571707405 wait complete. 2024-09-11T22:39:45.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.364+0000 7f2fa2000640 1 Processor -- start 2024-09-11T22:39:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.408+0000 7f2fa2000640 1 -- start start 2024-09-11T22:39:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.409+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f9c074bf0 0x7f2f9c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.409+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9c0761d0 0x7f2f9c06ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.409+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9c1099c0 0x7f2f9c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:45.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.409+0000 7f2fa2000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c1028a0 con 0x7f2f9c074bf0 2024-09-11T22:39:45.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.409+0000 7f2fa2000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c102720 con 0x7f2f9c0761d0 2024-09-11T22:39:45.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.409+0000 7f2fa2000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c102a20 con 0x7f2f9c1099c0 2024-09-11T22:39:45.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.409+0000 7f2f9be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9c1099c0 0x7f2f9c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:45.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.409+0000 7f2f9be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9c1099c0 0x7f2f9c073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:60344/0 (socket says 172.21.15.40:60344) 2024-09-11T22:39:45.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.409+0000 7f2f9be00640 1 -- 172.21.15.40:0/2270192053 learned_addr learned my addr 172.21.15.40:0/2270192053 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:39:45.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.410+0000 7f2f9aa00640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9c0761d0 0x7f2f9c06ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.410+0000 7f2f9aa00640 1 -- 172.21.15.40:0/2270192053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9c1099c0 msgr2=0x7f2f9c073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.410+0000 7f2f9aa00640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9c1099c0 0x7f2f9c073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.410+0000 7f2f9aa00640 1 -- 172.21.15.40:0/2270192053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f9c074bf0 msgr2=0x7f2f9c06e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.410+0000 7f2f9aa00640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f9c074bf0 0x7f2f9c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:45.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.410+0000 7f2f9aa00640 1 -- 172.21.15.40:0/2270192053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c0740e0 con 0x7f2f9c0761d0 2024-09-11T22:39:45.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:45.413+0000 7f2f9aa00640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9c0761d0 0x7f2f9c06ea10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009fd0 tx=0x7f2f9400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.603+0000 7f2f93e00640 1 -- 172.21.15.40:0/2270192053 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94004b20 con 0x7f2f9c0761d0 2024-09-11T22:39:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.603+0000 7f2f93e00640 1 -- 172.21.15.40:0/2270192053 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f94004cc0 con 0x7f2f9c0761d0 2024-09-11T22:39:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.603+0000 7f2f93e00640 1 -- 172.21.15.40:0/2270192053 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f940107b0 con 0x7f2f9c0761d0 2024-09-11T22:39:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.603+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c10e6b0 con 0x7f2f9c0761d0 2024-09-11T22:39:46.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.603+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c10ebb0 con 0x7f2f9c0761d0 2024-09-11T22:39:46.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.723+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9c1060a0 con 0x7f2f9c0761d0 2024-09-11T22:39:46.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.726+0000 7f2f93e00640 1 -- 172.21.15.40:0/2270192053 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2f94005020 con 0x7f2f9c0761d0 2024-09-11T22:39:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.828+0000 7f2f93e00640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f800a2d90 0x7f2f800a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.829+0000 7f2f93e00640 1 -- 172.21.15.40:0/2270192053 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f2f940cfc00 con 0x7f2f9c0761d0 2024-09-11T22:39:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.829+0000 7f2f9b400640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f800a2d90 0x7f2f800a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.829+0000 7f2f93e00640 1 -- 172.21.15.40:0/2270192053 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f940d3280 con 0x7f2f9c0761d0 2024-09-11T22:39:46.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:46.830+0000 7f2f9b400640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f800a2d90 0x7f2f800a5250 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c005c20 tx=0x7f2f8c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:46.833 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:46 smithi146 ceph-mon[34996]: pgmap v650: 129 pgs: 129 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.6 MiB/s wr, 829 op/s 2024-09-11T22:39:46.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:46 smithi040 ceph-mon[30787]: pgmap v650: 129 pgs: 129 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.6 MiB/s wr, 829 op/s 2024-09-11T22:39:47.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:46 smithi177 ceph-mon[35530]: pgmap v650: 129 pgs: 129 active+clean; 11 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.6 MiB/s wr, 829 op/s 2024-09-11T22:39:47.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.166+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f9c062df0 con 0x7f2f9c0761d0 2024-09-11T22:39:47.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.168+0000 7f2f93e00640 1 -- 172.21.15.40:0/2270192053 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24848 (secure 0 0 0) 0x7f2f9409c770 con 0x7f2f9c0761d0 2024-09-11T22:39:47.173 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:39:47.174 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":95,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:29:59.079781+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:39:47.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f800a2d90 msgr2=0x7f2f800a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:47.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f800a2d90 0x7f2f800a5250 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c005c20 tx=0x7f2f8c031400 comp rx=0 tx=0).stop 2024-09-11T22:39:47.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9c0761d0 msgr2=0x7f2f9c06ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:47.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9c0761d0 0x7f2f9c06ea10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009fd0 tx=0x7f2f9400ef90 comp rx=0 tx=0).stop 2024-09-11T22:39:47.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 shutdown_connections 2024-09-11T22:39:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2f800a2d90 0x7f2f800a5250 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f9c1099c0 0x7f2f9c073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f9c0761d0 0x7f2f9c06ea10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 --2- 172.21.15.40:0/2270192053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f9c074bf0 0x7f2f9c06e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 >> 172.21.15.40:0/2270192053 conn(0x7f2f9c0fd2b0 msgr2=0x7f2f9c103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 shutdown_connections 2024-09-11T22:39:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.172+0000 7f2fa2000640 1 -- 172.21.15.40:0/2270192053 wait complete. 2024-09-11T22:39:47.215 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:23:19.500985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T22:28:17.106068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T22:28:20.087828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-11T22:28:28.693002+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-11T22:39:47.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:39:47.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.508+0000 7f777d400640 1 -- 172.21.15.40:0/3893605115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77781058e0 msgr2=0x7f777810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:47.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.508+0000 7f777d400640 1 --2- 172.21.15.40:0/3893605115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77781058e0 0x7f777810c170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7770009900 tx=0x7f777002a410 comp rx=0 tx=0).stop 2024-09-11T22:39:47.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.508+0000 7f777d400640 1 -- 172.21.15.40:0/3893605115 shutdown_connections 2024-09-11T22:39:47.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.508+0000 7f777d400640 1 --2- 172.21.15.40:0/3893605115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77781058e0 0x7f777810c170 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.508+0000 7f777d400640 1 --2- 172.21.15.40:0/3893605115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7778104f20 0x7f77781053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.508+0000 7f777d400640 1 --2- 172.21.15.40:0/3893605115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7778103d30 0x7f7778104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.508+0000 7f777d400640 1 -- 172.21.15.40:0/3893605115 >> 172.21.15.40:0/3893605115 conn(0x7f77780ff470 msgr2=0x7f77781018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:47.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.508+0000 7f777d400640 1 -- 172.21.15.40:0/3893605115 shutdown_connections 2024-09-11T22:39:47.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.508+0000 7f777d400640 1 -- 172.21.15.40:0/3893605115 wait complete. 2024-09-11T22:39:47.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.510+0000 7f777d400640 1 Processor -- start 2024-09-11T22:39:47.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.510+0000 7f777d400640 1 -- start start 2024-09-11T22:39:47.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.510+0000 7f777d400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7778103d30 0x7f777819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:47.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.510+0000 7f777d400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7778104f20 0x7f777819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:47.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.510+0000 7f777d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77781058e0 0x7f77781a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:47.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.510+0000 7f777d400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f777810fa30 con 0x7f7778103d30 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.510+0000 7f777d400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f777810f8b0 con 0x7f77781058e0 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.510+0000 7f777d400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f777810fbb0 con 0x7f7778104f20 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.511+0000 7f776de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7778104f20 0x7f777819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.511+0000 7f776de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7778104f20 0x7f777819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:60370/0 (socket says 172.21.15.40:60370) 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.511+0000 7f776de00640 1 -- 172.21.15.40:0/328540163 learned_addr learned my addr 172.21.15.40:0/328540163 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.511+0000 7f7776800640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7778103d30 0x7f777819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.511+0000 7f7777200640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77781058e0 0x7f77781a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.511+0000 7f776de00640 1 -- 172.21.15.40:0/328540163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77781058e0 msgr2=0x7f77781a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.511+0000 7f776de00640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77781058e0 0x7f77781a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.511+0000 7f776de00640 1 -- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7778103d30 msgr2=0x7f777819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.513+0000 7f776de00640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7778103d30 0x7f777819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.513+0000 7f776de00640 1 -- 172.21.15.40:0/328540163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777806bd40 con 0x7f7778104f20 2024-09-11T22:39:47.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.513+0000 7f7776800640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7778103d30 0x7f777819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:39:47.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.513+0000 7f776de00640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7778104f20 0x7f777819a5f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f776000d950 tx=0x7f776000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:47.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.513+0000 7f776fe00640 1 -- 172.21.15.40:0/328540163 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760017070 con 0x7f7778104f20 2024-09-11T22:39:47.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.514+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777806c030 con 0x7f7778104f20 2024-09-11T22:39:47.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.514+0000 7f776fe00640 1 -- 172.21.15.40:0/328540163 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7760009c30 con 0x7f7778104f20 2024-09-11T22:39:47.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.514+0000 7f776fe00640 1 -- 172.21.15.40:0/328540163 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776000f6b0 con 0x7f7778104f20 2024-09-11T22:39:47.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.514+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777806c650 con 0x7f7778104f20 2024-09-11T22:39:47.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.516+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777810b0d0 con 0x7f7778104f20 2024-09-11T22:39:47.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.523+0000 7f776fe00640 1 -- 172.21.15.40:0/328540163 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f77600109d0 con 0x7f7778104f20 2024-09-11T22:39:47.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.527+0000 7f776fe00640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f775c0a2be0 0x7f775c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:47.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.527+0000 7f776fe00640 1 -- 172.21.15.40:0/328540163 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f77600cf140 con 0x7f7778104f20 2024-09-11T22:39:47.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.528+0000 7f7776800640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f775c0a2be0 0x7f775c0a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:47.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.528+0000 7f776fe00640 1 -- 172.21.15.40:0/328540163 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77600cf5c0 con 0x7f7778104f20 2024-09-11T22:39:47.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.529+0000 7f7776800640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f775c0a2be0 0x7f775c0a50a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7778104d80 tx=0x7f7768009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:47.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:47 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2270192053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:39:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.901+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f777802d9c0 con 0x7f7778104f20 2024-09-11T22:39:47.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.902+0000 7f776fe00640 1 -- 172.21.15.40:0/328540163 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f7760009de0 con 0x7f7778104f20 2024-09-11T22:39:47.904 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-11T22:39:47.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f775c0a2be0 msgr2=0x7f775c0a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:47.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f775c0a2be0 0x7f775c0a50a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7778104d80 tx=0x7f7768009570 comp rx=0 tx=0).stop 2024-09-11T22:39:47.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7778104f20 msgr2=0x7f777819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:47.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7778104f20 0x7f777819a5f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f776000d950 tx=0x7f776000de10 comp rx=0 tx=0).stop 2024-09-11T22:39:47.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 shutdown_connections 2024-09-11T22:39:47.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f775c0a2be0 0x7f775c0a50a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77781058e0 0x7f77781a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7778104f20 0x7f777819a5f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 --2- 172.21.15.40:0/328540163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7778103d30 0x7f777819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:47.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.907+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 >> 172.21.15.40:0/328540163 conn(0x7f77780ff470 msgr2=0x7f77781082a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:47.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.908+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 shutdown_connections 2024-09-11T22:39:47.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:47.908+0000 7f777d400640 1 -- 172.21.15.40:0/328540163 wait complete. 2024-09-11T22:39:47.939 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:47 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2270192053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:39:47.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T22:39:48.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:47 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2270192053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:39:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.233+0000 7f2eab600640 1 -- 172.21.15.40:0/1857952996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ea4103d20 msgr2=0x7f2ea4104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.233+0000 7f2eab600640 1 --2- 172.21.15.40:0/1857952996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ea4103d20 0x7f2ea4104120 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009900 tx=0x7f2e9402a3f0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.234+0000 7f2eab600640 1 -- 172.21.15.40:0/1857952996 shutdown_connections 2024-09-11T22:39:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.234+0000 7f2eab600640 1 --2- 172.21.15.40:0/1857952996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea41058d0 0x7f2ea410c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.234+0000 7f2eab600640 1 --2- 172.21.15.40:0/1857952996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ea4104f10 0x7f2ea4105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.234+0000 7f2eab600640 1 --2- 172.21.15.40:0/1857952996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ea4103d20 0x7f2ea4104120 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.234+0000 7f2eab600640 1 -- 172.21.15.40:0/1857952996 >> 172.21.15.40:0/1857952996 conn(0x7f2ea40ff4a0 msgr2=0x7f2ea41018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.235+0000 7f2eab600640 1 -- 172.21.15.40:0/1857952996 shutdown_connections 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.235+0000 7f2eab600640 1 -- 172.21.15.40:0/1857952996 wait complete. 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.236+0000 7f2eab600640 1 Processor -- start 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.237+0000 7f2eab600640 1 -- start start 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.237+0000 7f2eab600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea4103d20 0x7f2ea4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.237+0000 7f2eab600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ea4104f10 0x7f2ea40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.237+0000 7f2eab600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ea41058d0 0x7f2ea41ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.237+0000 7f2eab600640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea410f9d0 con 0x7f2ea4103d20 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.237+0000 7f2eab600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea410f850 con 0x7f2ea41058d0 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.237+0000 7f2eab600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea410fb50 con 0x7f2ea4104f10 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2e9be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ea4104f10 0x7f2ea40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2e9be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ea4104f10 0x7f2ea40710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:60400/0 (socket says 172.21.15.40:60400) 2024-09-11T22:39:48.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2e9be00640 1 -- 172.21.15.40:0/1261287525 learned_addr learned my addr 172.21.15.40:0/1261287525 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:39:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2ea9600640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ea41058d0 0x7f2ea41ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2ea8c00640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea4103d20 0x7f2ea4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2e9be00640 1 -- 172.21.15.40:0/1261287525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ea41058d0 msgr2=0x7f2ea41ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2e9be00640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ea41058d0 0x7f2ea41ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2e9be00640 1 -- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea4103d20 msgr2=0x7f2ea4070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2e9be00640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea4103d20 0x7f2ea4070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.238+0000 7f2e9be00640 1 -- 172.21.15.40:0/1261287525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea407a650 con 0x7f2ea4104f10 2024-09-11T22:39:48.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.239+0000 7f2e9be00640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ea4104f10 0x7f2ea40710e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00eab0 tx=0x7f2e8c00ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.241+0000 7f2ea2000640 1 -- 172.21.15.40:0/1261287525 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00ce40 con 0x7f2ea4104f10 2024-09-11T22:39:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.241+0000 7f2ea2000640 1 -- 172.21.15.40:0/1261287525 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e8c011950 con 0x7f2ea4104f10 2024-09-11T22:39:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.241+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea41aee10 con 0x7f2ea4104f10 2024-09-11T22:39:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.241+0000 7f2ea2000640 1 -- 172.21.15.40:0/1261287525 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c010b40 con 0x7f2ea4104f10 2024-09-11T22:39:48.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.241+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea41af1c0 con 0x7f2ea4104f10 2024-09-11T22:39:48.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.246+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea410b110 con 0x7f2ea4104f10 2024-09-11T22:39:48.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.250+0000 7f2ea2000640 1 -- 172.21.15.40:0/1261287525 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2e8c011b00 con 0x7f2ea4104f10 2024-09-11T22:39:48.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.252+0000 7f2ea2000640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e880a2c10 0x7f2e880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:48.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.253+0000 7f2ea2000640 1 -- 172.21.15.40:0/1261287525 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f2e8c0cfa30 con 0x7f2ea4104f10 2024-09-11T22:39:48.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.253+0000 7f2ea8c00640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e880a2c10 0x7f2e880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:48.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.255+0000 7f2ea8c00640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e880a2c10 0x7f2e880a50d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2e9402a9e0 tx=0x7f2e94031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:48.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.256+0000 7f2ea2000640 1 -- 172.21.15.40:0/1261287525 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e8c016030 con 0x7f2ea4104f10 2024-09-11T22:39:48.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.633+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2ea402d970 con 0x7f2ea4104f10 2024-09-11T22:39:48.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.634+0000 7f2ea2000640 1 -- 172.21.15.40:0/1261287525 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f2e8c09c680 con 0x7f2ea4104f10 2024-09-11T22:39:48.637 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-11T22:39:48.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e880a2c10 msgr2=0x7f2e880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:48.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e880a2c10 0x7f2e880a50d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2e9402a9e0 tx=0x7f2e94031400 comp rx=0 tx=0).stop 2024-09-11T22:39:48.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ea4104f10 msgr2=0x7f2ea40710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:48.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ea4104f10 0x7f2ea40710e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00eab0 tx=0x7f2e8c00ef70 comp rx=0 tx=0).stop 2024-09-11T22:39:48.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 shutdown_connections 2024-09-11T22:39:48.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f2e880a2c10 0x7f2e880a50d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ea41058d0 0x7f2ea41ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ea4104f10 0x7f2ea40710e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 --2- 172.21.15.40:0/1261287525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ea4103d20 0x7f2ea4070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.639+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 >> 172.21.15.40:0/1261287525 conn(0x7f2ea40ff4a0 msgr2=0x7f2ea41082e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.641+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 shutdown_connections 2024-09-11T22:39:48.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.641+0000 7f2eab600640 1 -- 172.21.15.40:0/1261287525 wait complete. 2024-09-11T22:39:48.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T22:39:48.933 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:48 smithi177 ceph-mon[35530]: pgmap v651: 129 pgs: 129 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 2.2 MiB/s wr, 584 op/s 2024-09-11T22:39:48.934 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:48 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/328540163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:39:48.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.965+0000 7f7c88800640 1 -- 172.21.15.40:0/3131260807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ffdd0 msgr2=0x7f7c801001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:48.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.965+0000 7f7c88800640 1 --2- 172.21.15.40:0/3131260807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ffdd0 0x7f7c801001d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009860 tx=0x7f7c7402a360 comp rx=0 tx=0).stop 2024-09-11T22:39:48.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.965+0000 7f7c88800640 1 -- 172.21.15.40:0/3131260807 shutdown_connections 2024-09-11T22:39:48.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.965+0000 7f7c88800640 1 --2- 172.21.15.40:0/3131260807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c801014f0 0x7f7c80105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.965+0000 7f7c88800640 1 --2- 172.21.15.40:0/3131260807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c80100b30 0x7f7c80100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.965+0000 7f7c88800640 1 --2- 172.21.15.40:0/3131260807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ffdd0 0x7f7c801001d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.965+0000 7f7c88800640 1 -- 172.21.15.40:0/3131260807 >> 172.21.15.40:0/3131260807 conn(0x7f7c800fb910 msgr2=0x7f7c800fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:48.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.966+0000 7f7c88800640 1 -- 172.21.15.40:0/3131260807 shutdown_connections 2024-09-11T22:39:48.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.966+0000 7f7c88800640 1 -- 172.21.15.40:0/3131260807 wait complete. 2024-09-11T22:39:48.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.968+0000 7f7c88800640 1 Processor -- start 2024-09-11T22:39:48.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.968+0000 7f7c88800640 1 -- start start 2024-09-11T22:39:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.969+0000 7f7c88800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ffdd0 0x7f7c80070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.969+0000 7f7c88800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c80100b30 0x7f7c80071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:48.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.970+0000 7f7c88800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c801014f0 0x7f7c801ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:48.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.970+0000 7f7c85e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ffdd0 0x7f7c80070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:48.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.970+0000 7f7c88800640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80113dd0 con 0x7f7c80100b30 2024-09-11T22:39:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.970+0000 7f7c88800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80113c50 con 0x7f7c801014f0 2024-09-11T22:39:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.970+0000 7f7c88800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80113f50 con 0x7f7c800ffdd0 2024-09-11T22:39:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.970+0000 7f7c85e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ffdd0 0x7f7c80070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:60412/0 (socket says 172.21.15.40:60412) 2024-09-11T22:39:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.970+0000 7f7c85e00640 1 -- 172.21.15.40:0/2993294855 learned_addr learned my addr 172.21.15.40:0/2993294855 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:39:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.970+0000 7f7c85400640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c80100b30 0x7f7c80071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:48.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.970+0000 7f7c86800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c801014f0 0x7f7c801ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.972+0000 7f7c86800640 1 -- 172.21.15.40:0/2993294855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ffdd0 msgr2=0x7f7c80070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.972+0000 7f7c86800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ffdd0 0x7f7c80070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.972+0000 7f7c86800640 1 -- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c80100b30 msgr2=0x7f7c80071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.972+0000 7f7c86800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c80100b30 0x7f7c80071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:48.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.972+0000 7f7c86800640 1 -- 172.21.15.40:0/2993294855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c801ae9e0 con 0x7f7c801014f0 2024-09-11T22:39:48.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.975+0000 7f7c86800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c801014f0 0x7f7c801ae4a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00ed70 tx=0x7f7c7c00c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:48.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.975+0000 7f7c7aa00640 1 -- 172.21.15.40:0/2993294855 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00ee60 con 0x7f7c801014f0 2024-09-11T22:39:48.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.975+0000 7f7c7aa00640 1 -- 172.21.15.40:0/2993294855 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c7c003b70 con 0x7f7c801014f0 2024-09-11T22:39:48.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.976+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c801aec10 con 0x7f7c801014f0 2024-09-11T22:39:48.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.977+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c801af0e0 con 0x7f7c801014f0 2024-09-11T22:39:48.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.977+0000 7f7c7aa00640 1 -- 172.21.15.40:0/2993294855 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c0178e0 con 0x7f7c801014f0 2024-09-11T22:39:48.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.978+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c801af310 con 0x7f7c801014f0 2024-09-11T22:39:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:48 smithi040 ceph-mon[30787]: pgmap v651: 129 pgs: 129 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 2.2 MiB/s wr, 584 op/s 2024-09-11T22:39:48.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:48 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/328540163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:39:48.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.985+0000 7f7c7aa00640 1 -- 172.21.15.40:0/2993294855 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7c7c043b30 con 0x7f7c801014f0 2024-09-11T22:39:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.987+0000 7f7c7aa00640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c680a2b90 0x7f7c680a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.988+0000 7f7c7aa00640 1 -- 172.21.15.40:0/2993294855 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f7c7c0cf730 con 0x7f7c801014f0 2024-09-11T22:39:48.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.988+0000 7f7c85e00640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c680a2b90 0x7f7c680a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:48.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.988+0000 7f7c7aa00640 1 -- 172.21.15.40:0/2993294855 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c7c0cfc50 con 0x7f7c801014f0 2024-09-11T22:39:48.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:48.990+0000 7f7c85e00640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c680a2b90 0x7f7c680a5050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7c740057c0 tx=0x7f7c740305f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:49.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:48 smithi146 ceph-mon[34996]: pgmap v651: 129 pgs: 129 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 2.2 MiB/s wr, 584 op/s 2024-09-11T22:39:49.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:48 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/328540163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T22:39:49.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.349+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7c801af6a0 con 0x7f7c801014f0 2024-09-11T22:39:49.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.363+0000 7f7c7aa00640 1 -- 172.21.15.40:0/2993294855 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7f7c7c043e20 con 0x7f7c801014f0 2024-09-11T22:39:49.366 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-09-11T22:39:49.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.367+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c680a2b90 msgr2=0x7f7c680a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:49.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.367+0000 7f7c88800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c680a2b90 0x7f7c680a5050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7c740057c0 tx=0x7f7c740305f0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.367+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c801014f0 msgr2=0x7f7c801ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:49.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.367+0000 7f7c88800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c801014f0 0x7f7c801ae4a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00ed70 tx=0x7f7c7c00c6e0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.369+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 shutdown_connections 2024-09-11T22:39:49.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.369+0000 7f7c88800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f7c680a2b90 0x7f7c680a5050 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.369+0000 7f7c88800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c801014f0 0x7f7c801ae4a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.369+0000 7f7c88800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c80100b30 0x7f7c80071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.369+0000 7f7c88800640 1 --2- 172.21.15.40:0/2993294855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ffdd0 0x7f7c80070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.369+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 >> 172.21.15.40:0/2993294855 conn(0x7f7c800fb910 msgr2=0x7f7c800fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.370+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 shutdown_connections 2024-09-11T22:39:49.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.370+0000 7f7c88800640 1 -- 172.21.15.40:0/2993294855 wait complete. 2024-09-11T22:39:49.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-11T22:39:49.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.696+0000 7f1a85000640 1 -- 172.21.15.40:0/3396730346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80109b90 msgr2=0x7f1a80110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:49.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.696+0000 7f1a85000640 1 --2- 172.21.15.40:0/3396730346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80109b90 0x7f1a80110420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009ca0 tx=0x7f1a7802a8b0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.698+0000 7f1a85000640 1 -- 172.21.15.40:0/3396730346 shutdown_connections 2024-09-11T22:39:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.698+0000 7f1a85000640 1 --2- 172.21.15.40:0/3396730346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80109b90 0x7f1a80110420 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.698+0000 7f1a85000640 1 --2- 172.21.15.40:0/3396730346 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a801091d0 0x7f1a80109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.698+0000 7f1a85000640 1 --2- 172.21.15.40:0/3396730346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a80108410 0x7f1a80108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.698+0000 7f1a85000640 1 -- 172.21.15.40:0/3396730346 >> 172.21.15.40:0/3396730346 conn(0x7f1a80077470 msgr2=0x7f1a800798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:49.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.699+0000 7f1a85000640 1 -- 172.21.15.40:0/3396730346 shutdown_connections 2024-09-11T22:39:49.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.699+0000 7f1a85000640 1 -- 172.21.15.40:0/3396730346 wait complete. 2024-09-11T22:39:49.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.700+0000 7f1a85000640 1 Processor -- start 2024-09-11T22:39:49.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.700+0000 7f1a85000640 1 -- start start 2024-09-11T22:39:49.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a85000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80108410 0x7f1a8019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a85000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a801091d0 0x7f1a8019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a85000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a80109b90 0x7f1a801a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a85000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80113cd0 con 0x7f1a80108410 2024-09-11T22:39:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a85000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80113b50 con 0x7f1a80109b90 2024-09-11T22:39:49.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a85000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80113e50 con 0x7f1a801091d0 2024-09-11T22:39:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a7f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80108410 0x7f1a8019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a7f400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80108410 0x7f1a8019e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60080/0 (socket says 172.21.15.40:60080) 2024-09-11T22:39:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a7ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a801091d0 0x7f1a8019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.702+0000 7f1a7f400640 1 -- 172.21.15.40:0/2549746324 learned_addr learned my addr 172.21.15.40:0/2549746324 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:39:49.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.703+0000 7f1a7fe00640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a80109b90 0x7f1a801a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.703+0000 7f1a7f400640 1 -- 172.21.15.40:0/2549746324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a801091d0 msgr2=0x7f1a8019e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.703+0000 7f1a7f400640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a801091d0 0x7f1a8019e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.703+0000 7f1a7f400640 1 -- 172.21.15.40:0/2549746324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a80109b90 msgr2=0x7f1a801a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.703+0000 7f1a7f400640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a80109b90 0x7f1a801a5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.703+0000 7f1a7f400640 1 -- 172.21.15.40:0/2549746324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a801a5e70 con 0x7f1a80108410 2024-09-11T22:39:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.705+0000 7f1a7f400640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80108410 0x7f1a8019e250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c970 tx=0x7f1a6800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.706+0000 7f1a77e00640 1 -- 172.21.15.40:0/2549746324 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68007c10 con 0x7f1a80108410 2024-09-11T22:39:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.706+0000 7f1a77e00640 1 -- 172.21.15.40:0/2549746324 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a68007db0 con 0x7f1a80108410 2024-09-11T22:39:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.706+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a801a6160 con 0x7f1a80108410 2024-09-11T22:39:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.706+0000 7f1a77e00640 1 -- 172.21.15.40:0/2549746324 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800f870 con 0x7f1a80108410 2024-09-11T22:39:49.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.706+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a801a66b0 con 0x7f1a80108410 2024-09-11T22:39:49.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.708+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a5c0052c0 con 0x7f1a80108410 2024-09-11T22:39:49.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.711+0000 7f1a77e00640 1 -- 172.21.15.40:0/2549746324 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1a68018af0 con 0x7f1a80108410 2024-09-11T22:39:49.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.714+0000 7f1a77e00640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1a640a2d90 0x7f1a640a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:49.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.714+0000 7f1a77e00640 1 -- 172.21.15.40:0/2549746324 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f1a680cf5f0 con 0x7f1a80108410 2024-09-11T22:39:49.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.718+0000 7f1a7ea00640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1a640a2d90 0x7f1a640a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:49.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.720+0000 7f1a7ea00640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1a640a2d90 0x7f1a640a5250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005fd0 tx=0x7f1a70005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:49.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:49.721+0000 7f1a77e00640 1 -- 172.21.15.40:0/2549746324 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a6809c1f0 con 0x7f1a80108410 2024-09-11T22:39:49.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:49 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1261287525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:39:49.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:49 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2993294855' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:39:50.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:49 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1261287525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:39:50.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:49 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2993294855' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:39:50.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:49 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1261287525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T22:39:50.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:49 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2993294855' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T22:39:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.094+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1a5c005dc0 con 0x7f1a80108410 2024-09-11T22:39:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.095+0000 7f1a77e00640 1 -- 172.21.15.40:0/2549746324 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v95) ==== 103+0+11 (secure 0 0 0) 0x7f1a6809baf0 con 0x7f1a80108410 2024-09-11T22:39:50.097 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-11T22:39:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.098+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1a640a2d90 msgr2=0x7f1a640a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.099+0000 7f1a85000640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1a640a2d90 0x7f1a640a5250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005fd0 tx=0x7f1a70005850 comp rx=0 tx=0).stop 2024-09-11T22:39:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.099+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80108410 msgr2=0x7f1a8019e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.099+0000 7f1a85000640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80108410 0x7f1a8019e250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c970 tx=0x7f1a6800ce30 comp rx=0 tx=0).stop 2024-09-11T22:39:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.099+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 shutdown_connections 2024-09-11T22:39:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.099+0000 7f1a85000640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f1a640a2d90 0x7f1a640a5250 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.099+0000 7f1a85000640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a80109b90 0x7f1a801a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.099+0000 7f1a85000640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a801091d0 0x7f1a8019e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.099+0000 7f1a85000640 1 --2- 172.21.15.40:0/2549746324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a80108410 0x7f1a8019e250 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.099+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 >> 172.21.15.40:0/2549746324 conn(0x7f1a80077470 msgr2=0x7f1a8010c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.100+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 shutdown_connections 2024-09-11T22:39:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.100+0000 7f1a85000640 1 -- 172.21.15.40:0/2549746324 wait complete. 2024-09-11T22:39:50.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T22:39:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.427+0000 7fa41f600640 1 -- 172.21.15.40:0/3621194993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa418100ce0 msgr2=0x7fa418101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.427+0000 7fa41f600640 1 --2- 172.21.15.40:0/3621194993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa418100ce0 0x7fa418101140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa404009900 tx=0x7fa40402a410 comp rx=0 tx=0).stop 2024-09-11T22:39:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.427+0000 7fa41f600640 1 -- 172.21.15.40:0/3621194993 shutdown_connections 2024-09-11T22:39:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.428+0000 7fa41f600640 1 --2- 172.21.15.40:0/3621194993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa418101680 0x7fa418101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.428+0000 7fa41f600640 1 --2- 172.21.15.40:0/3621194993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa418100ce0 0x7fa418101140 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.428+0000 7fa41f600640 1 --2- 172.21.15.40:0/3621194993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4181003a0 0x7fa4181007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:50.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.428+0000 7fa41f600640 1 -- 172.21.15.40:0/3621194993 >> 172.21.15.40:0/3621194993 conn(0x7fa4180fc1b0 msgr2=0x7fa4180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.429+0000 7fa41f600640 1 -- 172.21.15.40:0/3621194993 shutdown_connections 2024-09-11T22:39:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.429+0000 7fa41f600640 1 -- 172.21.15.40:0/3621194993 wait complete. 2024-09-11T22:39:50.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.431+0000 7fa41f600640 1 Processor -- start 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.431+0000 7fa41f600640 1 -- start start 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.431+0000 7fa41f600640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4181003a0 0x7fa41819e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.431+0000 7fa41f600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa418100ce0 0x7fa41819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.432+0000 7fa41f600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa418101680 0x7fa4181a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.432+0000 7fa417e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa418100ce0 0x7fa41819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.432+0000 7fa417e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa418100ce0 0x7fa41819e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.40:43828/0 (socket says 172.21.15.40:43828) 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.432+0000 7fa417e00640 1 -- 172.21.15.40:0/177653298 learned_addr learned my addr 172.21.15.40:0/177653298 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.432+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa4181034f0 con 0x7fa4181003a0 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.432+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa418103370 con 0x7fa418100ce0 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.432+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa418103670 con 0x7fa418101680 2024-09-11T22:39:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.432+0000 7fa41d600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa418101680 0x7fa4181a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.433+0000 7fa41d600640 1 -- 172.21.15.40:0/177653298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa418100ce0 msgr2=0x7fa41819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.433+0000 7fa41d600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa418100ce0 0x7fa41819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.433+0000 7fa41d600640 1 -- 172.21.15.40:0/177653298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4181003a0 msgr2=0x7fa41819e490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:39:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.433+0000 7fa41d600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4181003a0 0x7fa41819e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.433+0000 7fa41d600640 1 -- 172.21.15.40:0/177653298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4181a60b0 con 0x7fa418101680 2024-09-11T22:39:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.434+0000 7fa41d600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa418101680 0x7fa4181a5a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa410009fd0 tx=0x7fa41000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.434+0000 7fa415600640 1 -- 172.21.15.40:0/177653298 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41000ce20 con 0x7fa418101680 2024-09-11T22:39:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.434+0000 7fa415600640 1 -- 172.21.15.40:0/177653298 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa410005020 con 0x7fa418101680 2024-09-11T22:39:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.434+0000 7fa415600640 1 -- 172.21.15.40:0/177653298 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410010720 con 0x7fa418101680 2024-09-11T22:39:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.434+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4181a63a0 con 0x7fa418101680 2024-09-11T22:39:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.434+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4181a68a0 con 0x7fa418101680 2024-09-11T22:39:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.436+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4181085f0 con 0x7fa418101680 2024-09-11T22:39:50.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.439+0000 7fa415600640 1 -- 172.21.15.40:0/177653298 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa410005540 con 0x7fa418101680 2024-09-11T22:39:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.441+0000 7fa415600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4000a2d90 0x7fa4000a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:39:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.441+0000 7fa415600640 1 -- 172.21.15.40:0/177653298 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fa4100cfa70 con 0x7fa418101680 2024-09-11T22:39:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.442+0000 7fa41cc00640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4000a2d90 0x7fa4000a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:39:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.443+0000 7fa41cc00640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4000a2d90 0x7fa4000a5250 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa40c005fd0 tx=0x7fa40c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:39:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.444+0000 7fa415600640 1 -- 172.21.15.40:0/177653298 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa41009c5e0 con 0x7fa418101680 2024-09-11T22:39:50.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.898+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fa418062df0 con 0x7fa418101680 2024-09-11T22:39:50.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.907+0000 7fa415600640 1 -- 172.21.15.40:0/177653298 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+740371 (secure 0 0 0) 0x7fa41009bee0 con 0x7fa418101680 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 18, 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: "active_gid": 14150, 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: "active_name": "x", 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: "active_addrs": { 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-09-11T22:39:50.921 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6800", 2024-09-11T22:39:50.922 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3905506167 2024-09-11T22:39:50.922 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.922 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:50.922 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-11T22:39:50.922 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:6801", 2024-09-11T22:39:50.922 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3905506167 2024-09-11T22:39:50.922 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:50.922 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:39:50.922 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.923 INFO:teuthology.orchestra.run.smithi040.stdout: "active_addr": "172.21.15.40:6801/3905506167", 2024-09-11T22:39:50.923 INFO:teuthology.orchestra.run.smithi040.stdout: "active_change": "2024-09-11T22:20:56.889394+0000", 2024-09-11T22:39:50.923 INFO:teuthology.orchestra.run.smithi040.stdout: "active_mgr_features": 4540701547738038271, 2024-09-11T22:39:50.923 INFO:teuthology.orchestra.run.smithi040.stdout: "available": true, 2024-09-11T22:39:50.923 INFO:teuthology.orchestra.run.smithi040.stdout: "standbys": [ 2024-09-11T22:39:50.923 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:50.923 INFO:teuthology.orchestra.run.smithi040.stdout: "gid": 24109, 2024-09-11T22:39:50.923 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "z", 2024-09-11T22:39:50.923 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr_features": 4540701547738038271, 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: "available_modules": [ 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "alerts", 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:50.924 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:50.926 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:50.927 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:50.927 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:50.927 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:50.927 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.927 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.927 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.927 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.927 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:50.927 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.928 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:50.929 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.930 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_destination": { 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_destination", 2024-09-11T22:39:50.931 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email address to send alerts to", 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.932 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_from_name": { 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_from_name", 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "Ceph", 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email From: name", 2024-09-11T22:39:50.933 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_host": { 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_host", 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.934 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.935 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.935 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP server", 2024-09-11T22:39:50.935 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.935 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.935 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.935 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.935 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_password": { 2024-09-11T22:39:50.935 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_password", 2024-09-11T22:39:50.935 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Password to authenticate with", 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.936 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_port": { 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_port", 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "465", 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP port", 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.937 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_sender": { 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_sender", 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.938 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.939 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.939 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP envelope sender", 2024-09-11T22:39:50.939 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.939 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.939 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.939 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.939 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_ssl": { 2024-09-11T22:39:50.939 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_ssl", 2024-09-11T22:39:50.940 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.940 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.940 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.940 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:50.940 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.940 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.940 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.940 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T22:39:50.940 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.941 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.941 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.941 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.941 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_user": { 2024-09-11T22:39:50.941 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_user", 2024-09-11T22:39:50.941 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.941 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.941 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.942 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:50.942 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.942 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.942 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.942 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "User to authenticate as", 2024-09-11T22:39:50.942 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.943 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.943 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.943 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:50.943 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:50.943 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.943 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:50.943 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "balancer", 2024-09-11T22:39:50.943 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:50.944 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:50.944 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:50.944 INFO:teuthology.orchestra.run.smithi040.stdout: "active": { 2024-09-11T22:39:50.944 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "active", 2024-09-11T22:39:50.945 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.945 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.945 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.945 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:50.945 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.946 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.947 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.947 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T22:39:50.947 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.947 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.948 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.948 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.949 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_time": { 2024-09-11T22:39:50.949 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_time", 2024-09-11T22:39:50.949 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.949 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.949 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.949 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0000", 2024-09-11T22:39:50.950 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.950 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.950 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.950 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T22:39:50.950 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:50.950 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.950 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.951 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.951 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_weekday": { 2024-09-11T22:39:50.951 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_weekday", 2024-09-11T22:39:50.951 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:50.951 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.951 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.952 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:50.952 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-09-11T22:39:50.952 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-09-11T22:39:50.952 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.952 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T22:39:50.952 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:50.952 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.952 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.952 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.953 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_max_iterations": { 2024-09-11T22:39:50.953 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_max_iterations", 2024-09-11T22:39:50.953 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:50.953 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.953 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.954 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "25", 2024-09-11T22:39:50.954 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:50.954 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "250", 2024-09-11T22:39:50.954 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.954 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T22:39:50.954 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.954 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_metrics": { 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_metrics", 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_step": { 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_step", 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:50.956 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.957 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.957 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.5", 2024-09-11T22:39:50.957 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0.001", 2024-09-11T22:39:50.957 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "0.999", 2024-09-11T22:39:50.957 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.957 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "aggressiveness of optimization", 2024-09-11T22:39:50.957 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T22:39:50.958 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.958 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.958 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.958 INFO:teuthology.orchestra.run.smithi040.stdout: "end_time": { 2024-09-11T22:39:50.958 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_time", 2024-09-11T22:39:50.958 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.958 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.958 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.958 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2359", 2024-09-11T22:39:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T22:39:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.959 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "end_weekday": { 2024-09-11T22:39:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_weekday", 2024-09-11T22:39:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:50.960 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-09-11T22:39:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-09-11T22:39:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T22:39:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.961 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:50.962 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.963 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.964 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:50.964 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:50.964 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.964 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.964 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.964 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:50.965 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.965 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.965 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.965 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:50.965 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.965 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.966 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.968 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.968 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.968 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.968 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:50.968 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:50.968 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.968 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "min_score": { 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_score", 2024-09-11T22:39:50.969 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-09-11T22:39:50.970 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "upmap", 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "crush-compat", 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "none", 2024-09-11T22:39:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: "read", 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap", 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap-read" 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Balancer mode", 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_ids": { 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_ids", 2024-09-11T22:39:50.972 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.973 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.973 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.973 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:50.973 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.973 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.973 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.973 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T22:39:50.973 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.974 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.974 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.974 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.974 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:50.974 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:50.974 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:50.975 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.975 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.975 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:50.975 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.975 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.975 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.976 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T22:39:50.976 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.976 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.976 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.976 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.976 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_deviation": { 2024-09-11T22:39:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_deviation", 2024-09-11T22:39:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.978 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T22:39:50.978 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T22:39:50.978 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.978 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.978 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.978 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_optimizations": { 2024-09-11T22:39:50.978 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_optimizations", 2024-09-11T22:39:50.979 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:50.979 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.979 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.979 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:50.979 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.979 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.979 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.979 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T22:39:50.980 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.980 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.980 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.980 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:50.980 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:50.980 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.980 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:50.980 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm", 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_down_multiplier": { 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_down_multiplier", 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.981 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_refresh_rate": { 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_refresh_rate", 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "20", 2024-09-11T22:39:50.982 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_starting_port": { 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_starting_port", 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4721", 2024-09-11T22:39:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_ptrace": { 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_ptrace", 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.984 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_interval": { 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_interval", 2024-09-11T22:39:50.985 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:50.986 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.986 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.986 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:50.986 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.986 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.986 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.986 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_memory_target_ratio": { 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.7", 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.987 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm_log_destination": { 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm_log_destination", 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.988 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: "file", 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: "file,syslog", 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: "syslog" 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.989 INFO:teuthology.orchestra.run.smithi040.stdout: "cgroups_split": { 2024-09-11T22:39:50.990 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cgroups_split", 2024-09-11T22:39:50.990 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.990 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.990 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.990 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:50.990 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.991 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.991 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.991 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T22:39:50.991 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.991 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.992 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.992 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.992 INFO:teuthology.orchestra.run.smithi040.stdout: "config_checks_enabled": { 2024-09-11T22:39:50.992 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_checks_enabled", 2024-09-11T22:39:50.993 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.993 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.993 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.993 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:50.993 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.993 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.993 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "config_dashboard": { 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_dashboard", 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.994 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_alertmanager": { 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_alertmanager", 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T22:39:50.995 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_base": { 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_base", 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.996 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Container image name, without the tag", 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_elasticsearch": { 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_elasticsearch", 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:50.998 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:50.998 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T22:39:50.998 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:50.998 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:50.998 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:50.998 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "elasticsearch container image", 2024-09-11T22:39:50.999 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:50.999 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:50.999 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:50.999 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:50.999 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_grafana": { 2024-09-11T22:39:51.000 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_grafana", 2024-09-11T22:39:51.000 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.000 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.000 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.001 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T22:39:51.001 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.001 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.001 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.001 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.002 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.002 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.002 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.002 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.003 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_haproxy": { 2024-09-11T22:39:51.003 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_haproxy", 2024-09-11T22:39:51.003 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.003 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.003 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.003 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T22:39:51.004 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.004 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.004 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.005 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "HAproxy container image", 2024-09-11T22:39:51.005 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.005 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.005 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.005 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.005 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_agent": { 2024-09-11T22:39:51.006 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_agent", 2024-09-11T22:39:51.006 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.006 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.006 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.006 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T22:39:51.006 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.007 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.007 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.007 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger agent container image", 2024-09-11T22:39:51.007 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.007 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.007 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.008 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.008 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_collector": { 2024-09-11T22:39:51.008 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_collector", 2024-09-11T22:39:51.008 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.008 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.009 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.009 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T22:39:51.009 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.009 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.009 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.009 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger collector container image", 2024-09-11T22:39:51.010 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.010 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.010 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.010 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.010 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_query": { 2024-09-11T22:39:51.010 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_query", 2024-09-11T22:39:51.011 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.011 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.011 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.011 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T22:39:51.011 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.011 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.011 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger query container image", 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_keepalived": { 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_keepalived", 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Keepalived container image", 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_loki": { 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_loki", 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T22:39:51.013 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Loki container image", 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_node_exporter": { 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_node_exporter", 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T22:39:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_nvmeof": { 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_nvmeof", 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.015 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Nvme-of container image", 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_prometheus": { 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_prometheus", 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.016 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_promtail": { 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_promtail", 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.017 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Promtail container image", 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_samba": { 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_samba", 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.018 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Samba/SMB container image", 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_snmp_gateway": { 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_snmp_gateway", 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.019 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SNMP Gateway container image", 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "container_init": { 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_init", 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.020 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "daemon_cache_timeout": { 2024-09-11T22:39:51.021 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "daemon_cache_timeout", 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.022 INFO:teuthology.orchestra.run.smithi040.stdout: "default_cephadm_command_timeout": { 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "900", 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.023 INFO:teuthology.orchestra.run.smithi040.stdout: "default_registry": { 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_registry", 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io", 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.024 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "device_cache_timeout": { 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_cache_timeout", 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1800", 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache device inventory", 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.025 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "device_enhanced_scan": { 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_enhanced_scan", 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.026 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "facts_cache_timeout": { 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "facts_cache_timeout", 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache host facts data", 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.027 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "grafana_dashboards_path": { 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "grafana_dashboards_path", 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T22:39:51.028 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "host_check_interval": { 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "host_check_interval", 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to perform a host check", 2024-09-11T22:39:51.029 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "hw_monitoring": { 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hw_monitoring", 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T22:39:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "inventory_list_all": { 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "inventory_list_all", 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.031 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.032 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "log_refresh_metadata": { 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_refresh_metadata", 2024-09-11T22:39:51.033 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.034 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.036 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.037 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.038 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "*", 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "max_count_per_host": { 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_count_per_host", 2024-09-11T22:39:51.040 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of daemons per service per host", 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "max_osd_draining_count": { 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_osd_draining_count", 2024-09-11T22:39:51.041 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "migration_current": { 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "migration_current", 2024-09-11T22:39:51.042 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "internal - do not modify", 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-09-11T22:39:51.043 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "root", 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm-package", 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "root" 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.044 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: "oob_default_addr": { 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "oob_default_addr", 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "169.254.1.1", 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "prometheus_alerts_path": { 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus_alerts_path", 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.046 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_insecure": { 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_insecure", 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.047 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_password": { 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_password", 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.048 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.049 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_url": { 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_url", 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.050 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_username": { 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_username", 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.051 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "secure_monitoring_stack": { 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "secure_monitoring_stack", 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.052 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "service_discovery_port": { 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "service_discovery_port", 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8765", 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "cephadm service discovery port", 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.053 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "ssh_config_file": { 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssh_config_file", 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T22:39:51.054 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "use_agent": { 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_agent", 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T22:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "use_repo_digest": { 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_repo_digest", 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T22:39:51.056 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_failed_host_check": { 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_failed_host_check", 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.057 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_daemons": { 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_daemons", 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.058 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_hosts": { 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_hosts", 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.059 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crash", 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.060 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.061 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.062 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.063 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.064 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.065 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "retain_interval": { 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retain_interval", 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "31536000", 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.066 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_recent_interval": { 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_recent_interval", 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1209600", 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T22:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dashboard", 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.068 INFO:teuthology.orchestra.run.smithi040.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.070 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.071 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_ENABLED": { 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.072 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.074 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.076 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.077 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.078 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.079 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.080 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.081 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.082 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_URL": { 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_URL", 2024-09-11T22:39:51.085 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.086 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.088 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.089 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.090 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.090 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.090 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.090 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.090 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.090 INFO:teuthology.orchestra.run.smithi040.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T22:39:51.090 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T22:39:51.092 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.092 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.092 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.092 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T22:39:51.093 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T22:39:51.094 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.095 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.096 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.097 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.098 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.099 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.101 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.102 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.103 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.104 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.105 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.106 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.107 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8", 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.108 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "45", 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T22:39:51.109 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T22:39:51.110 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T22:39:51.111 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T22:39:51.112 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T22:39:51.113 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T22:39:51.114 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T22:39:51.115 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: "cross_origin_url": { 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cross_origin_url", 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.117 INFO:teuthology.orchestra.run.smithi040.stdout: "crt_file": { 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crt_file", 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.118 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "debug": { 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "debug", 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable/disable debug options", 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.119 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "jwt_token_ttl": { 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "jwt_token_ttl", 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "28800", 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.120 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.121 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.123 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.124 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.125 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "motd": { 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "motd", 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.127 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "The message of the day", 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect_resolve_ip_addr": { 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.128 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8080", 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.131 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl_server_port": { 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl_server_port", 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8443", 2024-09-11T22:39:51.132 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.133 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "redirect", 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect" 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-09-11T22:39:51.134 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.135 INFO:teuthology.orchestra.run.smithi040.stdout: "url_prefix": { 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url_prefix", 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.136 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "devicehealth", 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_monitoring": { 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_monitoring", 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.137 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "monitor device health metrics", 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.138 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.139 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.140 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.141 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.142 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "mark_out_threshold": { 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mark_out_threshold", 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.143 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2419200", 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": { 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_name", 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.144 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "device_health_metrics", 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "retention_period": { 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retention_period", 2024-09-11T22:39:51.145 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15552000", 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain device health metrics", 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_frequency": { 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_frequency", 2024-09-11T22:39:51.146 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.147 INFO:teuthology.orchestra.run.smithi040.stdout: "self_heal": { 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "self_heal", 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.148 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.149 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_threshold": { 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_threshold", 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7257600", 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.150 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "diskprediction_local", 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.152 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.153 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.155 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "predict_interval": { 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predict_interval", 2024-09-11T22:39:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "predictor_model": { 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predictor_model", 2024-09-11T22:39:51.157 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "prophetstor", 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.158 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.159 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "influx", 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": false, 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "influxdb python module not found", 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "batch_size": { 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "batch_size", 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5000", 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.160 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "database": { 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "database", 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "ceph", 2024-09-11T22:39:51.161 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": { 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hostname", 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.162 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server hostname", 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "30", 2024-09-11T22:39:51.163 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "5", 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.164 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.166 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.167 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.168 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "password": { 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "password", 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.169 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "password of InfluxDB server user", 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "port": { 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "port", 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.170 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8086", 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server port", 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-09-11T22:39:51.171 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "false", 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "threads": { 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threads", 2024-09-11T22:39:51.172 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "32", 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "username": { 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "username", 2024-09-11T22:39:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "username of InfluxDB server user", 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.174 INFO:teuthology.orchestra.run.smithi040.stdout: "verify_ssl": { 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "verify_ssl", 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "true", 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.175 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "insights", 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.176 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.177 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.178 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.179 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.180 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.181 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "iostat", 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.182 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.183 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.185 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.186 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.187 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.187 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.187 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.187 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.187 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.187 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.187 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.187 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.187 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "k8sevents", 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_event_retention_days": { 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ceph_event_retention_days", 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7", 2024-09-11T22:39:51.188 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "config_check_secs": { 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_check_secs", 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "10", 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.190 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.191 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.193 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.194 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.195 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "localpool", 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: "failure_domain": { 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "failure_domain", 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.196 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "host", 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "failure domain for any created local pool", 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.197 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.198 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.199 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.200 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.201 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.202 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": { 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_size", 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default min_size for any created local pool", 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: "num_rep": { 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "num_rep", 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3", 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default replica count for any created local pool", 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.204 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": { 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_num", 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "128", 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.205 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "prefix": { 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prefix", 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name prefix for any created local pool", 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.206 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "subtree": { 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "subtree", 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "rack", 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T22:39:51.207 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mds_autoscaler", 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.208 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.210 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.211 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.212 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.213 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirroring", 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.214 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.216 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.217 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.218 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.219 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "nfs", 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.221 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.222 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.223 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.224 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.225 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "fail_fs": { 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "fail_fs", 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.226 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.227 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.228 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.229 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.230 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.231 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator": { 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.232 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm", 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: "rook", 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: "test_orchestrator" 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Orchestrator backend", 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_perf_query", 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.234 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.235 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.236 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.237 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.239 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_support", 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.241 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.242 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.243 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.244 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_autoscaler", 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.246 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.247 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.248 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.249 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.250 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.251 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "threshold": { 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threshold", 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.252 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1.0", 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "scaling threshold", 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.253 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "progress", 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_pg_recovery_event": { 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_pg_recovery_event", 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T22:39:51.254 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.255 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.256 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.257 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.258 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.259 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.260 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "max_completed_events": { 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_completed_events", 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.261 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "50", 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "number of past completed events to remember", 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.262 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long the module is going to sleep", 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.263 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus", 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "cache": { 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cache", 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.264 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "exclude_perf_counters": { 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "exclude_perf_counters", 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.265 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.267 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.269 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.270 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.271 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools": { 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools", 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.272 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "300", 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.273 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_interval": { 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_interval", 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15.0", 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T22:39:51.275 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "9283", 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.276 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "stale_cache_strategy": { 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stale_cache_strategy", 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "log", 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.277 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "default", 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.278 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "default", 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "error" 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.280 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_support", 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.281 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.282 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.283 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_snap_create": { 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_snap_create", 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.286 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "mirror_snapshot_schedule": { 2024-09-11T22:39:51.287 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.288 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "trash_purge_schedule": { 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "trash_purge_schedule", 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.289 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "restful", 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_auth": { 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_auth", 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.290 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.291 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.292 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.293 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.294 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.297 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.298 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.299 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.300 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.301 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.302 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rgw", 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.303 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.304 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.305 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.306 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.307 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.308 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rook", 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.309 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.310 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.312 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.314 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_class": { 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "storage_class", 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "local", 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.315 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "selftest", 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.316 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.318 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.319 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.320 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "roption1": { 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption1", 2024-09-11T22:39:51.321 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "roption2": { 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption2", 2024-09-11T22:39:51.322 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "xyz", 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption1": { 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption1", 2024-09-11T22:39:51.323 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption2": { 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption2", 2024-09-11T22:39:51.324 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption3": { 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption3", 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.326 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption4": { 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption4", 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption5": { 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption5", 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.328 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption6": { 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption6", 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.329 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption7": { 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption7", 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "42", 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "testkey": { 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testkey", 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.331 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "testlkey": { 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testlkey", 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.332 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "testnewline": { 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testnewline", 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.333 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snap_schedule", 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_m_granularity": { 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_m_granularity", 2024-09-11T22:39:51.334 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "dump_on_update": { 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dump_on_update", 2024-09-11T22:39:51.335 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "dump database to debug log on update", 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.336 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.337 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.338 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.339 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.340 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.341 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stats", 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.342 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.343 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.344 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.345 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.346 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.347 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "status", 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.348 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.349 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.350 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.351 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.352 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telegraf", 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.353 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "address": { 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "address", 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.354 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15", 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.355 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.357 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.358 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.359 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.360 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telemetry", 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.361 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_basic": { 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_basic", 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_crash": { 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_crash", 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.363 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_device": { 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_device", 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.364 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_ident": { 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_ident", 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.365 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_perf": { 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_perf", 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "contact": { 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "contact", 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "description": { 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "description", 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.368 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "device_url": { 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_url", 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.369 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "24", 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "8", 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.371 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "last_opt_revision": { 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "last_opt_revision", 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1", 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.372 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard": { 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard", 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.373 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard_description": { 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard_description", 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.374 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.375 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.376 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.377 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.378 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.379 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "organization": { 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "organization", 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.380 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "proxy": { 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "proxy", 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.381 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "url": { 2024-09-11T22:39:51.382 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url", 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "test_orchestrator", 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.384 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.385 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.386 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.387 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.388 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.389 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "volumes", 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.390 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.391 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.392 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.393 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_clones": { 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_clones", 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4", 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "periodic_async_work": { 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "periodic_async_work", 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.396 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Periodically check for async work", 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_delay": { 2024-09-11T22:39:51.397 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_delay", 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.398 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_no_wait": { 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.399 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix", 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "discovery_interval": { 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "discovery_interval", 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.400 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "100", 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "identifier": { 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "identifier", 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.401 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.402 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.403 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.404 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.405 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.406 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.408 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_host": { 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_host", 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.409 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_port": { 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_port", 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10051", 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.410 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_sender": { 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_sender", 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.411 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "gid": 24119, 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "y", 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr_features": 4540701547738038271, 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "available_modules": [ 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "alerts", 2024-09-11T22:39:51.412 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T22:39:51.413 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.414 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.415 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.416 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.417 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_destination": { 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_destination", 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.419 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email address to send alerts to", 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_from_name": { 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_from_name", 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "Ceph", 2024-09-11T22:39:51.420 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email From: name", 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_host": { 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_host", 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.421 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP server", 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_password": { 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_password", 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.422 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Password to authenticate with", 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_port": { 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_port", 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.423 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "465", 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP port", 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_sender": { 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_sender", 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.424 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP envelope sender", 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_ssl": { 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_ssl", 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_user": { 2024-09-11T22:39:51.426 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_user", 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "User to authenticate as", 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.427 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "balancer", 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "active": { 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "active", 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.428 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_time": { 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_time", 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0000", 2024-09-11T22:39:51.429 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_weekday": { 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_weekday", 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.430 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_max_iterations": { 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_max_iterations", 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.431 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "25", 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "250", 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_metrics": { 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_metrics", 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.432 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_step": { 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_step", 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.433 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.5", 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0.001", 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "0.999", 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "aggressiveness of optimization", 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "end_time": { 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_time", 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.434 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2359", 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "end_weekday": { 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_weekday", 2024-09-11T22:39:51.435 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.436 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.437 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.438 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.439 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.440 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.441 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "min_score": { 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_score", 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T22:39:51.442 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "upmap", 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.443 INFO:teuthology.orchestra.run.smithi040.stdout: "crush-compat", 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "none", 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "read", 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap", 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap-read" 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Balancer mode", 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_ids": { 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_ids", 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.444 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.445 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_deviation": { 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_deviation", 2024-09-11T22:39:51.446 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_optimizations": { 2024-09-11T22:39:51.447 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_optimizations", 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.448 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm", 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_down_multiplier": { 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_down_multiplier", 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.449 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_refresh_rate": { 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_refresh_rate", 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "20", 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.450 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_starting_port": { 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_starting_port", 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4721", 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.451 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_ptrace": { 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_ptrace", 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.452 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_interval": { 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_interval", 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.453 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_memory_target_ratio": { 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.454 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.7", 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm_log_destination": { 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm_log_destination", 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.455 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "file", 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "file,syslog", 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "syslog" 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.456 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "cgroups_split": { 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cgroups_split", 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.457 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "config_checks_enabled": { 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_checks_enabled", 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.458 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "config_dashboard": { 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_dashboard", 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.459 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_alertmanager": { 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_alertmanager", 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_base": { 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_base", 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.461 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Container image name, without the tag", 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_elasticsearch": { 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_elasticsearch", 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.462 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "elasticsearch container image", 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_grafana": { 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_grafana", 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.463 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_haproxy": { 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_haproxy", 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.464 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "HAproxy container image", 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_agent": { 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_agent", 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.465 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger agent container image", 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_collector": { 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_collector", 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.466 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger collector container image", 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_query": { 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_query", 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.467 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger query container image", 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_keepalived": { 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_keepalived", 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.468 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Keepalived container image", 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_loki": { 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_loki", 2024-09-11T22:39:51.469 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Loki container image", 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_node_exporter": { 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_node_exporter", 2024-09-11T22:39:51.470 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_nvmeof": { 2024-09-11T22:39:51.471 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_nvmeof", 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Nvme-of container image", 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_prometheus": { 2024-09-11T22:39:51.472 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_prometheus", 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.473 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_promtail": { 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_promtail", 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Promtail container image", 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.474 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_samba": { 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_samba", 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Samba/SMB container image", 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.475 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_snmp_gateway": { 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_snmp_gateway", 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SNMP Gateway container image", 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.476 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "container_init": { 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_init", 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.477 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "daemon_cache_timeout": { 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "daemon_cache_timeout", 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T22:39:51.478 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "default_cephadm_command_timeout": { 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "900", 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T22:39:51.479 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "default_registry": { 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_registry", 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io", 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.480 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "device_cache_timeout": { 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_cache_timeout", 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1800", 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.481 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache device inventory", 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "device_enhanced_scan": { 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_enhanced_scan", 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.482 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "facts_cache_timeout": { 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "facts_cache_timeout", 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.483 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache host facts data", 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "grafana_dashboards_path": { 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "grafana_dashboards_path", 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "host_check_interval": { 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "host_check_interval", 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.485 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to perform a host check", 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "hw_monitoring": { 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hw_monitoring", 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.486 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "inventory_list_all": { 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "inventory_list_all", 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.487 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T22:39:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.488 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.489 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "log_refresh_metadata": { 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_refresh_metadata", 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.490 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.491 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.493 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.495 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "*", 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.496 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "max_count_per_host": { 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_count_per_host", 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of daemons per service per host", 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "max_osd_draining_count": { 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_osd_draining_count", 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.500 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "migration_current": { 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "migration_current", 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.501 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "internal - do not modify", 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "root", 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm-package", 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "root" 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.503 INFO:teuthology.orchestra.run.smithi040.stdout: "oob_default_addr": { 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "oob_default_addr", 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "169.254.1.1", 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.504 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "prometheus_alerts_path": { 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus_alerts_path", 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.505 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_insecure": { 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_insecure", 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.506 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_password": { 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_password", 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T22:39:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_url": { 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_url", 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.508 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_username": { 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_username", 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.509 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "secure_monitoring_stack": { 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "secure_monitoring_stack", 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.510 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "service_discovery_port": { 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "service_discovery_port", 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8765", 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.511 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "cephadm service discovery port", 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "ssh_config_file": { 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssh_config_file", 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "use_agent": { 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_agent", 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.513 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "use_repo_digest": { 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_repo_digest", 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.514 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_failed_host_check": { 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_failed_host_check", 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.515 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_daemons": { 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_daemons", 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_hosts": { 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_hosts", 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.517 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.518 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crash", 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.519 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.520 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.521 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.522 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "retain_interval": { 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retain_interval", 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.524 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "31536000", 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_recent_interval": { 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_recent_interval", 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.525 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1209600", 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.526 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dashboard", 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.527 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.528 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_ENABLED": { 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.530 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.531 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.532 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.533 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.534 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.535 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.536 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.537 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T22:39:51.538 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T22:39:51.539 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T22:39:51.540 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.541 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.543 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_URL": { 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_URL", 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.544 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.545 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.546 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.547 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.548 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.549 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.551 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.553 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.554 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.555 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.556 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.557 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.558 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.559 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T22:39:51.560 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T22:39:51.561 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T22:39:51.562 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8", 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.563 INFO:teuthology.orchestra.run.smithi040.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "45", 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.564 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.565 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.566 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.567 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.569 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.570 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.571 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "cross_origin_url": { 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cross_origin_url", 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.572 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "crt_file": { 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crt_file", 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.573 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "debug": { 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "debug", 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.574 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable/disable debug options", 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "jwt_token_ttl": { 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "jwt_token_ttl", 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "28800", 2024-09-11T22:39:51.575 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.576 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.579 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.580 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.581 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "motd": { 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "motd", 2024-09-11T22:39:51.582 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "The message of the day", 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect_resolve_ip_addr": { 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T22:39:51.583 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-09-11T22:39:51.584 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-09-11T22:39:51.585 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8080", 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-09-11T22:39:51.586 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.587 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl_server_port": { 2024-09-11T22:39:51.588 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl_server_port", 2024-09-11T22:39:51.588 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.588 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.588 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.588 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8443", 2024-09-11T22:39:51.588 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.588 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.588 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.588 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "redirect", 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.589 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect" 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.590 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "url_prefix": { 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url_prefix", 2024-09-11T22:39:51.591 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.592 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "devicehealth", 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_monitoring": { 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_monitoring", 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.593 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "monitor device health metrics", 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.594 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.595 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.596 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.597 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.598 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.599 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "mark_out_threshold": { 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mark_out_threshold", 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2419200", 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.600 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": { 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_name", 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "device_health_metrics", 2024-09-11T22:39:51.601 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "retention_period": { 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retention_period", 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.602 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15552000", 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain device health metrics", 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_frequency": { 2024-09-11T22:39:51.603 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_frequency", 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.604 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "self_heal": { 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "self_heal", 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.605 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.606 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_threshold": { 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_threshold", 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.607 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7257600", 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.608 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "diskprediction_local", 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.609 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.610 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.611 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.612 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.613 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.614 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "predict_interval": { 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predict_interval", 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.615 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "predictor_model": { 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predictor_model", 2024-09-11T22:39:51.616 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "prophetstor", 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.617 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.618 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "influx", 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": false, 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "influxdb python module not found", 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: "batch_size": { 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "batch_size", 2024-09-11T22:39:51.619 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5000", 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.620 INFO:teuthology.orchestra.run.smithi040.stdout: "database": { 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "database", 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "ceph", 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T22:39:51.621 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": { 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hostname", 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.622 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server hostname", 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "30", 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "5", 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.624 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.626 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.627 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.628 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.629 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "password": { 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "password", 2024-09-11T22:39:51.630 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "password of InfluxDB server user", 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.631 INFO:teuthology.orchestra.run.smithi040.stdout: "port": { 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "port", 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8086", 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server port", 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.632 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "false", 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.633 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "threads": { 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threads", 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:51.634 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "32", 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "username": { 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "username", 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "username of InfluxDB server user", 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "verify_ssl": { 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "verify_ssl", 2024-09-11T22:39:51.636 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "true", 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.637 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "insights", 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.638 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.639 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.640 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.641 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.642 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.643 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.644 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "iostat", 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.645 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.646 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.647 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.648 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.649 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.650 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "k8sevents", 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.651 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_event_retention_days": { 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ceph_event_retention_days", 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7", 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T22:39:51.652 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "config_check_secs": { 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_check_secs", 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "10", 2024-09-11T22:39:51.653 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.654 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.655 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.656 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.658 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.659 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.660 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "localpool", 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "failure_domain": { 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "failure_domain", 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "host", 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.661 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "failure domain for any created local pool", 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.662 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.663 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.664 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.665 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.666 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.667 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": { 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_size", 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.668 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default min_size for any created local pool", 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "num_rep": { 2024-09-11T22:39:51.669 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "num_rep", 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3", 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default replica count for any created local pool", 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.670 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.671 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": { 2024-09-11T22:39:51.671 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_num", 2024-09-11T22:39:51.671 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.671 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.671 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.671 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "128", 2024-09-11T22:39:51.671 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.671 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "prefix": { 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prefix", 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.672 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name prefix for any created local pool", 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "subtree": { 2024-09-11T22:39:51.673 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "subtree", 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "rack", 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.674 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mds_autoscaler", 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.675 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.677 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.678 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.679 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.680 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.681 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirroring", 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.682 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.683 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.685 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.686 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.687 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.688 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "nfs", 2024-09-11T22:39:51.689 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.689 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.689 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.689 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.689 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.689 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.689 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.689 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.689 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.690 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.693 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.694 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-09-11T22:39:51.695 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "fail_fs": { 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "fail_fs", 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.696 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.697 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.698 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.699 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.700 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.701 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.702 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.702 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.705 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator": { 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.706 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm", 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "rook", 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "test_orchestrator" 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Orchestrator backend", 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.707 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_perf_query", 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.708 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.709 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.710 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.711 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.712 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.713 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.714 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_support", 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.715 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.716 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.717 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.718 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.719 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.720 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_autoscaler", 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.721 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.722 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.723 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.724 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.725 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.726 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.727 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "threshold": { 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threshold", 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1.0", 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.729 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "scaling threshold", 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "progress", 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.730 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_pg_recovery_event": { 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_pg_recovery_event", 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T22:39:51.731 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.732 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.733 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.734 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.735 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.737 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.738 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "max_completed_events": { 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_completed_events", 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "50", 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.739 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "number of past completed events to remember", 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.740 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long the module is going to sleep", 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.741 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus", 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "cache": { 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cache", 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.742 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "exclude_perf_counters": { 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "exclude_perf_counters", 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.743 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.745 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.746 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.748 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.749 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools": { 2024-09-11T22:39:51.750 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools", 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.751 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "300", 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.752 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_interval": { 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_interval", 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15.0", 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.753 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-09-11T22:39:51.754 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.755 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "9283", 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "stale_cache_strategy": { 2024-09-11T22:39:51.756 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stale_cache_strategy", 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "log", 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.757 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "default", 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.758 INFO:teuthology.orchestra.run.smithi040.stdout: "default", 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "error" 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.759 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.760 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_support", 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.762 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.763 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.764 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.765 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.766 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_snap_create": { 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_snap_create", 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "mirror_snapshot_schedule": { 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.768 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "trash_purge_schedule": { 2024-09-11T22:39:51.769 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "trash_purge_schedule", 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.770 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "restful", 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_auth": { 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_auth", 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-09-11T22:39:51.772 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.773 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.774 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.775 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.776 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.777 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.778 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.780 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.782 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rgw", 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.783 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.784 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.785 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.786 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.786 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.786 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.786 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.786 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.786 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.786 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.786 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.787 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.787 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.787 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.787 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.787 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.787 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.787 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.787 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.788 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.789 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.789 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.789 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.789 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.789 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.789 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.790 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rook", 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.791 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.792 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.793 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.794 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.795 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.796 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_class": { 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "storage_class", 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.797 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "local", 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.798 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "selftest", 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.799 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.800 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.801 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.802 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.803 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.804 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "roption1": { 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption1", 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.805 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "roption2": { 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption2", 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.806 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "xyz", 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption1": { 2024-09-11T22:39:51.807 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption1", 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.808 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption2": { 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption2", 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.809 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption3": { 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption3", 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.810 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption4": { 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption4", 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.811 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption5": { 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption5", 2024-09-11T22:39:51.812 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.813 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption6": { 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption6", 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.814 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption7": { 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption7", 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "42", 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.815 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "testkey": { 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testkey", 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.816 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "testlkey": { 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testlkey", 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "testnewline": { 2024-09-11T22:39:51.818 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testnewline", 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.819 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snap_schedule", 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_m_granularity": { 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_m_granularity", 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.820 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "dump_on_update": { 2024-09-11T22:39:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dump_on_update", 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "dump database to debug log on update", 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.822 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.823 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.824 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.826 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.827 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.828 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stats", 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.829 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.830 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.831 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.832 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.833 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.834 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.835 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "status", 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.836 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.837 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.838 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.839 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.840 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telegraf", 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.842 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "address": { 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "address", 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.843 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15", 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.844 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.845 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.846 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.847 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.848 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.849 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.850 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telemetry", 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.851 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_basic": { 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_basic", 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T22:39:51.852 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_crash": { 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_crash", 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.853 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_device": { 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_device", 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.854 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_ident": { 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_ident", 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.855 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.856 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_perf": { 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_perf", 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.857 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "contact": { 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "contact", 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.858 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "description": { 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "description", 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.859 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: "device_url": { 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_url", 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-09-11T22:39:51.861 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.862 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "24", 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "8", 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.863 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "last_opt_revision": { 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "last_opt_revision", 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1", 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.864 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard": { 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard", 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard_description": { 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard_description", 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.866 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.868 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.869 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.870 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.871 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: "organization": { 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "organization", 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.874 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "proxy": { 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "proxy", 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "url": { 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url", 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "test_orchestrator", 2024-09-11T22:39:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "volumes", 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_clones": { 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_clones", 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4", 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.891 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "periodic_async_work": { 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "periodic_async_work", 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.892 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Periodically check for async work", 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_delay": { 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_delay", 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_no_wait": { 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix", 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: "discovery_interval": { 2024-09-11T22:39:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "discovery_interval", 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "100", 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "identifier": { 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "identifier", 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_host": { 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_host", 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_port": { 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_port", 2024-09-11T22:39:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10051", 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_sender": { 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_sender", 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: "modules": [ 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm", 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: "dashboard", 2024-09-11T22:39:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: "iostat", 2024-09-11T22:39:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: "nfs", 2024-09-11T22:39:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: "restful" 2024-09-11T22:39:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: "available_modules": [ 2024-09-11T22:39:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "alerts", 2024-09-11T22:39:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.912 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.913 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:51.913 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:51.913 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.913 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.913 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.913 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.913 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.913 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.914 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.915 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.916 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.917 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.919 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.920 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_destination": { 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_destination", 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email address to send alerts to", 2024-09-11T22:39:51.921 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_from_name": { 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_from_name", 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "Ceph", 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.922 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Email From: name", 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_host": { 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_host", 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.923 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP server", 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_password": { 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_password", 2024-09-11T22:39:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Password to authenticate with", 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_port": { 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_port", 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "465", 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP port", 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_sender": { 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_sender", 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.927 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SMTP envelope sender", 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_ssl": { 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_ssl", 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.928 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "smtp_user": { 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "smtp_user", 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.929 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "User to authenticate as", 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.930 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "balancer", 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "active": { 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "active", 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.931 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_time": { 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_time", 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.932 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0000", 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "begin_weekday": { 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "begin_weekday", 2024-09-11T22:39:51.933 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.934 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_max_iterations": { 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_max_iterations", 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "25", 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "250", 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.935 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_metrics": { 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_metrics", 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.936 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "crush_compat_step": { 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crush_compat_step", 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.5", 2024-09-11T22:39:51.937 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0.001", 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "0.999", 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "aggressiveness of optimization", 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "end_time": { 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_time", 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.938 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2359", 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "end_weekday": { 2024-09-11T22:39:51.939 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "end_weekday", 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "0", 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "6", 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.940 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.941 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:51.942 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.943 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:51.944 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:51.945 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.946 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "min_score": { 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_score", 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.947 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "upmap", 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "crush-compat", 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "none", 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "read", 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap", 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap-read" 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Balancer mode", 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.949 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_ids": { 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_ids", 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.950 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.951 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_deviation": { 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_deviation", 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:51.952 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "upmap_max_optimizations": { 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "upmap_max_optimizations", 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.953 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm", 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_down_multiplier": { 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_down_multiplier", 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-09-11T22:39:51.955 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_refresh_rate": { 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_refresh_rate", 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.956 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "20", 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "agent_starting_port": { 2024-09-11T22:39:51.957 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "agent_starting_port", 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4721", 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.958 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_ptrace": { 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_ptrace", 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T22:39:51.959 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_interval": { 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_interval", 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.960 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "autotune_memory_target_ratio": { 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.961 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0.7", 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm_log_destination": { 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cephadm_log_destination", 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "file", 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "file,syslog", 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "syslog" 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.963 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "cgroups_split": { 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cgroups_split", 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.964 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "config_checks_enabled": { 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_checks_enabled", 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.965 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "config_dashboard": { 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_dashboard", 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.966 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_alertmanager": { 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_alertmanager", 2024-09-11T22:39:51.967 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.968 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_base": { 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_base", 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Container image name, without the tag", 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.969 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_elasticsearch": { 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_elasticsearch", 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "elasticsearch container image", 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_grafana": { 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_grafana", 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.971 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_haproxy": { 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_haproxy", 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.972 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "HAproxy container image", 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.973 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_agent": { 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_agent", 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger agent container image", 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.974 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_collector": { 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_collector", 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.975 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger collector container image", 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_jaeger_query": { 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_jaeger_query", 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T22:39:51.976 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Jaeger query container image", 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_keepalived": { 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_keepalived", 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.977 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Keepalived container image", 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_loki": { 2024-09-11T22:39:51.978 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_loki", 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Loki container image", 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_node_exporter": { 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_node_exporter", 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.980 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_nvmeof": { 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_nvmeof", 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.981 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Nvme-of container image", 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_prometheus": { 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_prometheus", 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T22:39:51.982 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Prometheus container image", 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_promtail": { 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_promtail", 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.983 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Promtail container image", 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.984 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_samba": { 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_samba", 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.985 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Samba/SMB container image", 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "container_image_snmp_gateway": { 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_image_snmp_gateway", 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.986 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "SNMP Gateway container image", 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: "container_init": { 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "container_init", 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.987 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "daemon_cache_timeout": { 2024-09-11T22:39:51.988 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "daemon_cache_timeout", 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.989 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "default_cephadm_command_timeout": { 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "900", 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.990 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: "default_registry": { 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "default_registry", 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "docker.io", 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "device_cache_timeout": { 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_cache_timeout", 2024-09-11T22:39:51.992 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1800", 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache device inventory", 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "device_enhanced_scan": { 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_enhanced_scan", 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.994 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "facts_cache_timeout": { 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "facts_cache_timeout", 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.995 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "seconds to cache host facts data", 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "grafana_dashboards_path": { 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "grafana_dashboards_path", 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T22:39:51.996 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "host_check_interval": { 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "host_check_interval", 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.997 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to perform a host check", 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "hw_monitoring": { 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hw_monitoring", 2024-09-11T22:39:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:51.999 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "inventory_list_all": { 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "inventory_list_all", 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.000 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.001 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.002 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "log_refresh_metadata": { 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_refresh_metadata", 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T22:39:52.003 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.004 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.005 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.007 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.008 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.009 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "*", 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.010 INFO:teuthology.orchestra.run.smithi040.stdout: "max_count_per_host": { 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_count_per_host", 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of daemons per service per host", 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.011 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "max_osd_draining_count": { 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_osd_draining_count", 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.012 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "migration_current": { 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "migration_current", 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.013 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "internal - do not modify", 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "mode": { 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mode", 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.014 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "root", 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm-package", 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "root" 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.015 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "oob_default_addr": { 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "oob_default_addr", 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "169.254.1.1", 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.016 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: "prometheus_alerts_path": { 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus_alerts_path", 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.017 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_insecure": { 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_insecure", 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.018 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.019 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_password": { 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_password", 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.020 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_url": { 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_url", 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "registry_username": { 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "registry_username", 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.022 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "secure_monitoring_stack": { 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "secure_monitoring_stack", 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.023 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.024 INFO:teuthology.orchestra.run.smithi040.stdout: "service_discovery_port": { 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "service_discovery_port", 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8765", 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "cephadm service discovery port", 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.025 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "ssh_config_file": { 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssh_config_file", 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.026 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "use_agent": { 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_agent", 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.027 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "use_repo_digest": { 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "use_repo_digest", 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.028 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_failed_host_check": { 2024-09-11T22:39:52.029 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_failed_host_check", 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.030 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_daemons": { 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_daemons", 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.031 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_on_stray_hosts": { 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_on_stray_hosts", 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.032 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.033 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crash", 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.034 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.035 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.036 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.037 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.038 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.039 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "retain_interval": { 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retain_interval", 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.040 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "31536000", 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_recent_interval": { 2024-09-11T22:39:52.041 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_recent_interval", 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1209600", 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.042 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dashboard", 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T22:39:52.044 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.045 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.046 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_ENABLED": { 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.047 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.048 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.049 INFO:teuthology.orchestra.run.smithi040.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.050 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.051 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.052 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.053 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T22:39:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.055 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.056 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.057 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T22:39:52.059 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.060 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.061 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.062 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_URL": { 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_URL", 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.063 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T22:39:52.064 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.065 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.066 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.067 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.068 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.069 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T22:39:52.070 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.071 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.072 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.073 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.074 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.075 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.076 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.077 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.078 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.079 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T22:39:52.080 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.082 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.083 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.084 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.085 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8", 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.086 INFO:teuthology.orchestra.run.smithi040.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "45", 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.087 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.088 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "admin", 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.089 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.090 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T22:39:52.091 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.092 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.093 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.094 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.095 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "cross_origin_url": { 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cross_origin_url", 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.096 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "crt_file": { 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "crt_file", 2024-09-11T22:39:52.097 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.098 INFO:teuthology.orchestra.run.smithi040.stdout: "debug": { 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "debug", 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Enable/disable debug options", 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.099 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "jwt_token_ttl": { 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "jwt_token_ttl", 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "28800", 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.100 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.101 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.102 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.105 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.106 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.107 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "motd": { 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "motd", 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.108 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "The message of the day", 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect_resolve_ip_addr": { 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T22:39:52.109 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.110 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.111 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8080", 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.112 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.114 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.114 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.114 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.114 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.114 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.114 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.116 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl_server_port": { 2024-09-11T22:39:52.116 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl_server_port", 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8443", 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.117 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "redirect", 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.118 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: "redirect" 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.119 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.120 INFO:teuthology.orchestra.run.smithi040.stdout: "url_prefix": { 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url_prefix", 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.121 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "devicehealth", 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_monitoring": { 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_monitoring", 2024-09-11T22:39:52.122 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "monitor device health metrics", 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.123 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.124 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.125 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.126 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.128 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.129 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "mark_out_threshold": { 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mark_out_threshold", 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "2419200", 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T22:39:52.130 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "pool_name": { 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pool_name", 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "device_health_metrics", 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.131 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "retention_period": { 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "retention_period", 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15552000", 2024-09-11T22:39:52.132 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long to retain device health metrics", 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_frequency": { 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_frequency", 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "self_heal": { 2024-09-11T22:39:52.134 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "self_heal", 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.135 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.136 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "warn_threshold": { 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "warn_threshold", 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7257600", 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.137 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "diskprediction_local", 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.138 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.139 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.140 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.142 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.143 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "predict_interval": { 2024-09-11T22:39:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predict_interval", 2024-09-11T22:39:52.145 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.145 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.145 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.145 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "86400", 2024-09-11T22:39:52.145 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.145 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.145 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.145 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "predictor_model": { 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "predictor_model", 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "prophetstor", 2024-09-11T22:39:52.146 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "600", 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.148 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "influx", 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": false, 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "influxdb python module not found", 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "batch_size": { 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "batch_size", 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5000", 2024-09-11T22:39:52.149 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "database": { 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "database", 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.150 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "ceph", 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": { 2024-09-11T22:39:52.151 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "hostname", 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server hostname", 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.152 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "30", 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "5", 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T22:39:52.153 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.154 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.155 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.157 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.158 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.159 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "password": { 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "password", 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.160 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "password of InfluxDB server user", 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "port": { 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "port", 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "8086", 2024-09-11T22:39:52.161 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "InfluxDB server port", 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "ssl": { 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ssl", 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.162 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "false", 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "threads": { 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threads", 2024-09-11T22:39:52.163 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "32", 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.164 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "username": { 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "username", 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "username of InfluxDB server user", 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.165 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "verify_ssl": { 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "verify_ssl", 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "true", 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "insights", 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.167 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.168 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.169 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.170 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.171 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.172 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.173 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "iostat", 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.174 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.175 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.176 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.177 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.178 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.179 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "k8sevents", 2024-09-11T22:39:52.180 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_event_retention_days": { 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "ceph_event_retention_days", 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "7", 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.181 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "config_check_secs": { 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "config_check_secs", 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "10", 2024-09-11T22:39:52.182 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.183 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.185 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.186 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.187 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.188 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.189 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "localpool", 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "failure_domain": { 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "failure_domain", 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "host", 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.190 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "failure domain for any created local pool", 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.191 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.192 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.193 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.194 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.195 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.196 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "min_size": { 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "min_size", 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.197 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default min_size for any created local pool", 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "num_rep": { 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "num_rep", 2024-09-11T22:39:52.198 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3", 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default replica count for any created local pool", 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.199 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_num": { 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_num", 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "128", 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.200 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "prefix": { 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prefix", 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.201 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "name prefix for any created local pool", 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "subtree": { 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "subtree", 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "rack", 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.202 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mds_autoscaler", 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.204 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.205 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.206 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.207 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.208 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.209 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirroring", 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.210 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.211 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.213 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.214 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.215 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.216 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "nfs", 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.217 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.218 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.219 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.220 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.221 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.222 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.223 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.225 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:50 smithi146 ceph-mon[34996]: pgmap v652: 129 pgs: 129 active+clean; 7.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 381 KiB/s wr, 186 op/s 2024-09-11T22:39:52.225 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:50 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2549746324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-11T22:39:52.225 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:51 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/177653298' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T22:39:52.226 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:50 smithi177 ceph-mon[35530]: pgmap v652: 129 pgs: 129 active+clean; 7.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 381 KiB/s wr, 186 op/s 2024-09-11T22:39:52.226 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:50 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2549746324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-11T22:39:52.226 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:51 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/177653298' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T22:39:52.226 INFO:teuthology.orchestra.run.smithi040.stdout: "fail_fs": { 2024-09-11T22:39:52.226 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "fail_fs", 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.227 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.228 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.229 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.230 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.231 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator": { 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "orchestrator", 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.234 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: "cephadm", 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: "rook", 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: "test_orchestrator" 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Orchestrator backend", 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.235 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_perf_query", 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.237 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.239 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.240 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.241 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "osd_support", 2024-09-11T22:39:52.242 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.243 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.244 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.245 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.246 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.247 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.248 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "pg_autoscaler", 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.250 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.251 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.252 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.253 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.254 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:52.255 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.256 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "threshold": { 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "threshold", 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "3.0", 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1.0", 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "scaling threshold", 2024-09-11T22:39:52.257 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "progress", 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.258 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_pg_recovery_event": { 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_pg_recovery_event", 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.261 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.262 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.263 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.264 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.266 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "max_completed_events": { 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_completed_events", 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "50", 2024-09-11T22:39:52.267 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "number of past completed events to remember", 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: "sleep_interval": { 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "sleep_interval", 2024-09-11T22:39:52.268 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "5", 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "how long the module is going to sleep", 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.269 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "prometheus", 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: "cache": { 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "cache", 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.270 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "exclude_perf_counters": { 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "exclude_perf_counters", 2024-09-11T22:39:52.271 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.272 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.273 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.274 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.275 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.276 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.278 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools": { 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools", 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.279 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "300", 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.280 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "scrape_interval": { 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "scrape_interval", 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15.0", 2024-09-11T22:39:52.281 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.282 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "::", 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-09-11T22:39:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "9283", 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.284 INFO:teuthology.orchestra.run.smithi040.stdout: "stale_cache_strategy": { 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stale_cache_strategy", 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "log", 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.285 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_behaviour": { 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_behaviour", 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "default", 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.286 INFO:teuthology.orchestra.run.smithi040.stdout: "default", 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: "error" 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: "standby_error_status_code": { 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "standby_error_status_code", 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "500", 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "400", 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "599", 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.288 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_support", 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.289 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.290 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.291 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.292 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.294 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_snap_create": { 2024-09-11T22:39:52.295 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_snap_create", 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10", 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "mirror_snapshot_schedule": { 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.297 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "trash_purge_schedule": { 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "trash_purge_schedule", 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.298 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "restful", 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "enable_auth": { 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enable_auth", 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.300 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "key_file": { 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "key_file", 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.304 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.305 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.306 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.307 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "server_addr": { 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_addr", 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.308 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "server_port": { 2024-09-11T22:39:52.309 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "server_port", 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.310 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rgw", 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.311 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.312 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.313 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.314 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.315 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.316 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.317 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.317 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.317 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.317 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rook", 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.321 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.322 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.323 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.324 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.325 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.326 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "storage_class": { 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "storage_class", 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "local", 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.327 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "selftest", 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.328 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.329 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.330 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.331 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.332 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "roption1": { 2024-09-11T22:39:52.333 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption1", 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.334 INFO:teuthology.orchestra.run.smithi040.stdout: "roption2": { 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "roption2", 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "xyz", 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.335 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption1": { 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption1", 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.336 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption2": { 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption2", 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.337 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption3": { 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption3", 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "float", 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.338 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption4": { 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption4", 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.339 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption5": { 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption5", 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.340 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption6": { 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption6", 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.341 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "rwoption7": { 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rwoption7", 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "1", 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "42", 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.342 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "testkey": { 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testkey", 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.343 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "testlkey": { 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testlkey", 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.344 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "testnewline": { 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "testnewline", 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.345 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snap_schedule", 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "allow_m_granularity": { 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "allow_m_granularity", 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.346 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "dump_on_update": { 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "dump_on_update", 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.347 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "dump database to debug log on update", 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.348 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.349 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.350 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.351 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.352 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.353 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "stats", 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.354 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.355 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.356 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.358 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "status", 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.359 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.360 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.361 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.362 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.363 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.364 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telegraf", 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "address": { 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "address", 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T22:39:52.365 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "15", 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.366 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.367 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.368 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.370 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.371 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "telemetry", 2024-09-11T22:39:52.372 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_basic": { 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_basic", 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T22:39:52.373 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_crash": { 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_crash", 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.374 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_device": { 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_device", 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.375 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_ident": { 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_ident", 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.376 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "channel_perf": { 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "channel_perf", 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "contact": { 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "contact", 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.378 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "description": { 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "description", 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.379 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "device_url": { 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "device_url", 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.380 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "enabled": { 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "enabled", 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.381 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "24", 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "8", 2024-09-11T22:39:52.382 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "last_opt_revision": { 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "last_opt_revision", 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "1", 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.383 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard": { 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard", 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.384 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "leaderboard_description": { 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "leaderboard_description", 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.385 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.386 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.387 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.388 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.390 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "organization": { 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "organization", 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.391 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "proxy": { 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "proxy", 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "url": { 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "url", 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.393 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.394 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "test_orchestrator", 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.395 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.396 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.397 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.398 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "volumes", 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.400 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.401 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.402 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.403 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.404 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.405 INFO:teuthology.orchestra.run.smithi040.stdout: "max_concurrent_clones": { 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "max_concurrent_clones", 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "4", 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.406 INFO:teuthology.orchestra.run.smithi040.stdout: "periodic_async_work": { 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "periodic_async_work", 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Periodically check for async work", 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.407 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_delay": { 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_delay", 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "0", 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.408 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "snapshot_clone_no_wait": { 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "True", 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.409 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix", 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: "can_run": true, 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: "error_string": "", 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: "module_options": { 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: "discovery_interval": { 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "discovery_interval", 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "uint", 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.410 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "100", 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "identifier": { 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "identifier", 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.411 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "interval": { 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "interval", 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "secs", 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "60", 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "log_level": { 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_level", 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.413 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.414 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster": { 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster", 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.415 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_cluster_level": { 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_cluster_level", 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "info", 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [ 2024-09-11T22:39:52.416 INFO:teuthology.orchestra.run.smithi040.stdout: "", 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "critical", 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "debug", 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "error", 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "info", 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "warning" 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "log_to_file": { 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "log_to_file", 2024-09-11T22:39:52.417 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "bool", 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 1, 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "False", 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_host": { 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_host", 2024-09-11T22:39:52.418 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "", 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_port": { 2024-09-11T22:39:52.419 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_port", 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "int", 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "10051", 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "zabbix_sender": { 2024-09-11T22:39:52.420 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "zabbix_sender", 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "str", 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "level": "advanced", 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "flags": 0, 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "min": "", 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "max": "", 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "enum_allowed": [], 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "desc": "", 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "long_desc": "", 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "tags": [], 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: "see_also": [] 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "services": { 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "dashboard": "https://172.21.15.40:8443/" 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "always_on_modules": { 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "octopus": [ 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-09-11T22:39:52.422 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "pacific": [ 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-09-11T22:39:52.423 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "quincy": [ 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-09-11T22:39:52.424 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "reef": [ 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "squid": [ 2024-09-11T22:39:52.425 INFO:teuthology.orchestra.run.smithi040.stdout: "balancer", 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "crash", 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "devicehealth", 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "orchestrator", 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "pg_autoscaler", 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "progress", 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "rbd_support", 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "status", 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "telemetry", 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "volumes" 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "last_failure_osd_epoch": 3, 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: "active_clients": [ 2024-09-11T22:39:52.426 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "devicehealth", 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1863219122 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "libcephsqlite", 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-09-11T22:39:52.427 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 4013177470 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "rbd_support", 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1704917296 2024-09-11T22:39:52.428 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "volumes", 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v2", 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3649124703 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-11T22:39:52.429 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:39:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4000a2d90 msgr2=0x7fa4000a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4000a2d90 0x7fa4000a5250 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa40c005fd0 tx=0x7fa40c005c70 comp rx=0 tx=0).stop 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa418101680 msgr2=0x7fa4181a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa418101680 0x7fa4181a5a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa410009fd0 tx=0x7fa41000ef10 comp rx=0 tx=0).stop 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 shutdown_connections 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa4000a2d90 0x7fa4000a5250 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa418101680 0x7fa4181a5a40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa418100ce0 0x7fa41819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 --2- 172.21.15.40:0/177653298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4181003a0 0x7fa41819e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.925+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 >> 172.21.15.40:0/177653298 conn(0x7fa4180fc1b0 msgr2=0x7fa4180fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.927+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 shutdown_connections 2024-09-11T22:39:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:39:50.927+0000 7fa41f600640 1 -- 172.21.15.40:0/177653298 wait complete. 2024-09-11T22:39:52.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:50 smithi040 ceph-mon[30787]: pgmap v652: 129 pgs: 129 active+clean; 7.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 381 KiB/s wr, 186 op/s 2024-09-11T22:39:52.432 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:50 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2549746324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-11T22:39:52.501 DEBUG:tasks.check_counter:Getting stats from a 2024-09-11T22:39:52.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-11T22:39:52.502 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:51 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/177653298' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-11T22:39:52.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:52 smithi040 ceph-mon[30787]: pgmap v653: 129 pgs: 129 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 288 KiB/s wr, 215 op/s 2024-09-11T22:39:53.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:52 smithi177 ceph-mon[35530]: pgmap v653: 129 pgs: 129 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 288 KiB/s wr, 215 op/s 2024-09-11T22:39:53.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:52 smithi146 ceph-mon[34996]: pgmap v653: 129 pgs: 129 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 288 KiB/s wr, 215 op/s 2024-09-11T22:39:54.887 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:54 smithi146 ceph-mon[34996]: pgmap v654: 129 pgs: 129 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 118 KiB/s wr, 245 op/s 2024-09-11T22:39:54.954 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:54.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:54 smithi040 ceph-mon[30787]: pgmap v654: 129 pgs: 129 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 118 KiB/s wr, 245 op/s 2024-09-11T22:39:55.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:54 smithi177 ceph-mon[35530]: pgmap v654: 129 pgs: 129 active+clean; 2.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 118 KiB/s wr, 245 op/s 2024-09-11T22:39:56.934 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:56 smithi040 ceph-mon[30787]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 89 KiB/s wr, 247 op/s 2024-09-11T22:39:56.935 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:39:56.935 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:56.935 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 4, 2024-09-11T22:39:56.935 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 5, 2024-09-11T22:39:56.935 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 2992, 2024-09-11T22:39:56.935 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 448, 2024-09-11T22:39:56.935 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 5, 2024-09-11T22:39:56.935 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.006365547, 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.000063349, 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.003420423, 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 3, 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.006158131, 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.002052710 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:39:56.936 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 197, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 194, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 610832, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 117648, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 2, 2024-09-11T22:39:56.937 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.059305063, 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.029154813, 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.029876856, 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 192, 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.038674536, 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000201429 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:39:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 610832, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 117648 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 1, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 146, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 160, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 106336, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 3, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.024178544, 2024-09-11T22:39:56.939 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.020999851, 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.001427357, 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 144, 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.026280958, 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000182506 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 106336 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "cct": { 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "total_workers": 0, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "unhealthy_workers": 0 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "mempool": { 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:56.941 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:56.942 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_items": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:56.943 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_anon_bytes": 148919, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_anon_items": 27, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_bytes": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_items": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:56.944 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_items": 0, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "pgmap_items": 0, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_co_items": 2, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_1_items": 0, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_2_items": 0 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:56.945 INFO:teuthology.orchestra.run.smithi040.stdout: "val": 0, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "max": 104857600, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "get_started": 0, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "get": 198, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "get_sum": 583008, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "get_or_fail_success": 198, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "take": 0, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "take_sum": 0, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "put": 198, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "put_sum": 583008, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "wait": { 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:39:56.946 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:39:56.947 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:56.947 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:56.947 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:39:57.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:56 smithi177 ceph-mon[35530]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 89 KiB/s wr, 247 op/s 2024-09-11T22:39:57.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:56 smithi146 ceph-mon[34996]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 89 KiB/s wr, 247 op/s 2024-09-11T22:39:57.879 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-11T22:39:57.879 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-11T22:39:57.879 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-11T22:39:57.879 DEBUG:tasks.check_counter:Getting stats from d 2024-09-11T22:39:57.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-11T22:39:58.260 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:39:58.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:39:58 smithi040 ceph-mon[30787]: pgmap v656: 129 pgs: 129 active+clean; 301 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 89 KiB/s wr, 268 op/s 2024-09-11T22:39:59.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:39:58 smithi177 ceph-mon[35530]: pgmap v656: 129 pgs: 129 active+clean; 301 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 89 KiB/s wr, 268 op/s 2024-09-11T22:39:59.074 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:39:59.074 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:39:59.074 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 4, 2024-09-11T22:39:59.074 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 4, 2024-09-11T22:39:59.074 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 2992, 2024-09-11T22:39:59.074 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 448, 2024-09-11T22:39:59.074 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 4, 2024-09-11T22:39:59.074 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 0, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.006237966, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.000073656, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.003526131, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 3, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.006120038, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.002040012 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:39:59.075 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 1, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 150, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 160, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 104880, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 3, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 2, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.020749191, 2024-09-11T22:39:59.076 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.017355308, 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.001574156, 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 148, 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.024700378, 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000166894 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.077 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 104880 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 201, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 198, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 473280, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 121504, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 2, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 1, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.060406311, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.037503730, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.027223687, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:39:59.078 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 197, 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.047968989, 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000243497 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 473280, 2024-09-11T22:39:59.079 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 121504 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: "cct": { 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: "total_workers": 0, 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: "unhealthy_workers": 0 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: "mempool": { 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: "bloom_filter_items": 0, 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:39:59.080 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_extent_items": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:39:59.081 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_blob_items": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_txc_items": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_items": 0, 2024-09-11T22:39:59.082 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_bytes": 0, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_items": 0, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_anon_bytes": 149998, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_anon_items": 30, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_meta_items": 0, 2024-09-11T22:39:59.083 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_bytes": 0, 2024-09-11T22:39:59.084 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_items": 0, 2024-09-11T22:39:59.084 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:39:59.084 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_mapbl_items": 0, 2024-09-11T22:39:59.084 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:39:59.084 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_pglog_items": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_bytes": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_items": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "pgmap_bytes": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "pgmap_items": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_co_bytes": 928, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_co_items": 2, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_1_bytes": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_1_items": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_2_bytes": 0, 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_2_items": 0 2024-09-11T22:39:59.085 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "val": 0, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "max": 104857600, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "get_started": 0, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "get": 202, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "get_sum": 444884, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "get_or_fail_fail": 0, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "get_or_fail_success": 202, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "take": 0, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "take_sum": 0, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "put": 202, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "put_sum": 444884, 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "wait": { 2024-09-11T22:39:59.086 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:39:59.087 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:39:59.087 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:39:59.087 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:59.087 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:39:59.087 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:39:59.088 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:39:58 smithi146 ceph-mon[34996]: pgmap v656: 129 pgs: 129 active+clean; 301 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 89 KiB/s wr, 268 op/s 2024-09-11T22:40:00.326 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-11T22:40:00.326 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-11T22:40:00.326 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-11T22:40:00.326 DEBUG:tasks.check_counter:Getting stats from g 2024-09-11T22:40:00.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-11T22:40:00.714 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:00.899 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:00 smithi040 ceph-mon[30787]: pgmap v657: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.9 KiB/s wr, 206 op/s 2024-09-11T22:40:00.899 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:00 smithi040 ceph-mon[30787]: overall HEALTH_OK 2024-09-11T22:40:01.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:00 smithi177 ceph-mon[35530]: pgmap v657: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.9 KiB/s wr, 206 op/s 2024-09-11T22:40:01.033 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:00 smithi177 ceph-mon[35530]: overall HEALTH_OK 2024-09-11T22:40:01.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:00 smithi146 ceph-mon[34996]: pgmap v657: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.9 KiB/s wr, 206 op/s 2024-09-11T22:40:01.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:00 smithi146 ceph-mon[34996]: overall HEALTH_OK 2024-09-11T22:40:01.333 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 4, 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 4, 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 2992, 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 448, 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 4, 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 0, 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.006284143, 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.000065492, 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.003395453, 2024-09-11T22:40:01.334 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 3, 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.006195325, 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.002065108 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:40:01.335 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 196, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 193, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 471296, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 118608, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 2, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 1, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.056153948, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.031902442, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.027666148, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:01.336 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 192, 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.044413521, 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000231320 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 471296, 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 118608 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 1, 2024-09-11T22:40:01.337 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 147, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 160, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 104352, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 3, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 2, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.019102277, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.015578232, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.001660536, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 145, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.019043517, 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000131334 2024-09-11T22:40:01.338 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 104352 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "cct": { 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "total_workers": 0, 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "unhealthy_workers": 0 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "mempool": { 2024-09-11T22:40:01.339 INFO:teuthology.orchestra.run.smithi040.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:01.340 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:01.341 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_items": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_anon_bytes": 148984, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_anon_items": 30, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_meta_items": 0, 2024-09-11T22:40:01.342 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_bytes": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_items": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_bytes": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_items": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "pgmap_items": 0, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_co_bytes": 928, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_co_items": 2, 2024-09-11T22:40:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_1_items": 0, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_2_items": 0 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "val": 0, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "max": 104857600, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "get_started": 0, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "get": 197, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "get_sum": 443597, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "get_or_fail_success": 197, 2024-09-11T22:40:01.344 INFO:teuthology.orchestra.run.smithi040.stdout: "take": 0, 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout: "take_sum": 0, 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout: "put": 197, 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout: "put_sum": 443597, 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout: "wait": { 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:40:01.345 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:40:02.122 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-11T22:40:02.122 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-11T22:40:02.122 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-11T22:40:02.122 DEBUG:tasks.check_counter:Getting stats from j 2024-09-11T22:40:02.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-11T22:40:02.503 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:02.936 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:02 smithi040 ceph-mon[30787]: pgmap v658: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 177 op/s 2024-09-11T22:40:03.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:02 smithi177 ceph-mon[35530]: pgmap v658: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 177 op/s 2024-09-11T22:40:03.083 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-11T22:40:03.083 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:03.083 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 0, 2024-09-11T22:40:03.083 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 2, 2024-09-11T22:40:03.083 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:40:03.083 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 0, 2024-09-11T22:40:03.083 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 4, 2024-09-11T22:40:03.083 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 0, 2024-09-11T22:40:03.083 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.003199788, 2024-09-11T22:40:03.084 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:40:03.084 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.000646883, 2024-09-11T22:40:03.084 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:03.084 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:03.084 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:40:03.084 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:40:03.084 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:40:03.084 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 203, 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 200, 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 473824, 2024-09-11T22:40:03.085 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 122784, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 2, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 1, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.056011734, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.030442088, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.027260373, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 199, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.029277256, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000147121 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:03.086 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 473824, 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 122784 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_messages": 5, 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages": 154, 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_bytes": 3152, 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_bytes": 105680, 2024-09-11T22:40:03.087 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_created_connections": 3, 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_active_connections": 2, 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_total_time": 0.022997102, 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_send_time": 0.016498960, 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_recv_time": 0.004676299, 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 153, 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.018206986, 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000118999 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:03.088 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "msgr_send_encrypted_bytes": 105680 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "cct": { 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "total_workers": 0, 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "unhealthy_workers": 0 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "mempool": { 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:03.089 INFO:teuthology.orchestra.run.smithi040.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:03.090 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:03.090 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:03.090 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:03.090 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:03.090 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:03.090 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:03.091 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:03.091 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:03.091 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:03.091 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:03.091 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:03.091 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:03.093 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:03.094 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:03.094 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:03.094 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:03.094 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:03.094 INFO:teuthology.orchestra.run.smithi040.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:03.094 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:03.095 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_items": 0, 2024-09-11T22:40:03.095 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:03.095 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:03.095 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:03.095 INFO:teuthology.orchestra.run.smithi040.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:03.095 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_anon_bytes": 148984, 2024-09-11T22:40:03.095 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_anon_items": 30, 2024-09-11T22:40:03.095 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "buffer_meta_items": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_bytes": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_items": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_bytes": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_items": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:03.096 INFO:teuthology.orchestra.run.smithi040.stdout: "pgmap_items": 0, 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_co_bytes": 928, 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_co_items": 2, 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_1_items": 0, 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "unittest_2_items": 0 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "val": 0, 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "max": 104857600, 2024-09-11T22:40:03.097 INFO:teuthology.orchestra.run.smithi040.stdout: "get_started": 0, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "get": 204, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "get_sum": 445144, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "get_or_fail_success": 204, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "take": 0, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "take_sum": 0, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "put": 204, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "put_sum": 445144, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "wait": { 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "avgcount": 0, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "sum": 0.000000000, 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: "avgtime": 0.000000000 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:40:03.098 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-11T22:40:03.099 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-11T22:40:03.099 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:02 smithi146 ceph-mon[34996]: pgmap v658: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.4 KiB/s wr, 177 op/s 2024-09-11T22:40:03.996 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-11T22:40:03.998 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-11T22:40:04.000 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-11T22:40:04.000 DEBUG:tasks.check_counter:Getting stats from b 2024-09-11T22:40:04.000 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-11T22:40:04.345 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:40:04.821 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:04 smithi146 ceph-mon[34996]: pgmap v659: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 127 op/s 2024-09-11T22:40:04.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:04 smithi040 ceph-mon[30787]: pgmap v659: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 127 op/s 2024-09-11T22:40:05.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:04 smithi177 ceph-mon[35530]: pgmap v659: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 127 op/s 2024-09-11T22:40:05.488 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-11T22:40:05.488 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:05.488 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 2237, 2024-09-11T22:40:05.488 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 2370, 2024-09-11T22:40:05.488 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 641347, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 7907556, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 10, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.186894121, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.067763659, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.072645234, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.042880196, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2368, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.375425496, 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000158541 2024-09-11T22:40:05.489 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1381, 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000253564, 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000183 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 11157, 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 14467, 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 3824730, 2024-09-11T22:40:05.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 7952141, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 12, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 7, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.672641650, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.267736777, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.454827967, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.062752264, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 14466, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.839621446, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000127168 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 9709, 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.003110760, 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000320 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 64560, 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 373920 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 2912, 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 2962, 2024-09-11T22:40:05.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 1658491, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 7497295, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 12, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 6, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.249456370, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.090326483, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.120827533, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.050750066, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2961, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.279701200, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000094461 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2173, 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000424174, 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000195 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 557312, 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 127168 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-11T22:40:05.494 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1720, 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.456539698, 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001428220 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2535, 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.150811508, 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000059491 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:05.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 2443, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 2442, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2442, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 13.905462818, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.005694292 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 1, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 0, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-09-11T22:40:05.496 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 12, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 86, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 0, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 7, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 79, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 85, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 327, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 2, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 2, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 3, 2024-09-11T22:40:05.497 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 3338, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 3167, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 1, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 2, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 50, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 25, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 7, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 303, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 7, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 322, 2024-09-11T22:40:05.498 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 4, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 234, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:40:05.499 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 6, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 375, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 2470, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 6, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 6607, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 5571, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 147, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 1322 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.500 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 2, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 0, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 0, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 2, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 15, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 1, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 848, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 786, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 61, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-09-11T22:40:05.501 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 7, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.502 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 8999, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 8999, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 12, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-09-11T22:40:05.503 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 12, 2024-09-11T22:40:05.504 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 2, 2024-09-11T22:40:05.504 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-09-11T22:40:05.504 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-09-11T22:40:05.504 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-09-11T22:40:05.504 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 19056498, 2024-09-11T22:40:05.504 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2024-09-11T22:40:05.504 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-09-11T22:40:05.504 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 844, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 32.596095551, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.038620966 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 26, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 1022, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 996, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 21, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 194, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 173, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 86, 2024-09-11T22:40:05.505 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 1715, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 1629, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 2, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 1072, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 1070, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 65796, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 231712 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 3150, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 8, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 2443, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 23, 2024-09-11T22:40:05.506 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 67, 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 663, 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.714376691, 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001077491 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 92, 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.016602674, 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000180463 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.507 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 61, 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.046187935, 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000757179 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 335, 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.147392793, 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000439978 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-09-11T22:40:05.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000381779, 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000381779 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.509 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-09-11T22:40:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.511 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.511 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.511 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-09-11T22:40:05.511 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 105, 2024-09-11T22:40:05.511 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.092819565, 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000883995 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.512 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 54, 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.014595457, 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000270286 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 170, 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.856490280, 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.005038178 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 111, 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 10.208783111, 2024-09-11T22:40:05.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.091971019 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-09-11T22:40:05.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 97, 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.942389216, 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.009715352 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8, 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.031218468, 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.003902308 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4, 2024-09-11T22:40:05.516 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.001212476, 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000303119 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8, 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.021434364, 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002679295 2024-09-11T22:40:05.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 13, 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.007457156, 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000573627 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 720, 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.804120853, 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001116834 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:40:05.518 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 3, 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 2, 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 419, 2024-09-11T22:40:05.519 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 419, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 539, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:05.520 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:05.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 306576, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 123, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 616, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 7, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 8776, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 166, 2024-09-11T22:40:05.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 152506, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 1396, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-09-11T22:40:05.524 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 4188, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 15060403, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 37, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 4188, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4188, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 159.330519944, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.038044536 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-09-11T22:40:05.525 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4188, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 4359 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 4188, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 24, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 4164, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 0, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 11, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 24, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 868, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 51, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-09-11T22:40:05.526 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 3082, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 22, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-09-11T22:40:05.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 6, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-09-11T22:40:05.528 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 95, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 11, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 12, 2024-09-11T22:40:05.529 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 12, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 215, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 0, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 80 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "osd-slow-ops": { 2024-09-11T22:40:05.530 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 0 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 26, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 12, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 2567, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 786, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-11T22:40:05.531 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 16302, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 4793908, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 16302, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 16302, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 4793908, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.532 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 4188, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 15145205, 2024-09-11T22:40:05.533 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 4188, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 15145205, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:05.534 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 4188, 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 4188, 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 4188, 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 4188, 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:40:05.535 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 786, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 84802, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 786, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 24, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 84802, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.536 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55c64e950960": { 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 8999, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 14862194, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 8999, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:05.537 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 844, 2024-09-11T22:40:05.538 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 14862194, 2024-09-11T22:40:05.538 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:05.538 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:05.538 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:05.538 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:05.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:05.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:05.538 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-11T22:40:06.613 INFO:tasks.check_counter:Daemon mds.b mds.exported=7 2024-09-11T22:40:06.613 INFO:tasks.check_counter:Daemon mds.b mds.imported=7 2024-09-11T22:40:06.613 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-09-11T22:40:06.613 DEBUG:tasks.check_counter:Getting stats from e 2024-09-11T22:40:06.613 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-11T22:40:06.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:06 smithi146 ceph-mon[34996]: pgmap v660: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 64 op/s 2024-09-11T22:40:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:40:06.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:06 smithi040 ceph-mon[30787]: pgmap v660: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 64 op/s 2024-09-11T22:40:07.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:06 smithi177 ceph-mon[35530]: pgmap v660: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 64 op/s 2024-09-11T22:40:07.489 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-11T22:40:07.489 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 585, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 585, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 4351839, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 185270, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 6, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 2, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.053570239, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.017575603, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.016911394, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.014345281, 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:07.490 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 584, 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.028134384, 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000048175 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:07.491 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 699, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 686, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 944101, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 276295, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 4, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.072271073, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.023609201, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.032586106, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.017532547, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 685, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.033253466, 2024-09-11T22:40:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000048545 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 532384, 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 123968 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 637, 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 788, 2024-09-11T22:40:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 207286, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 526741, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 5, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.074061809, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.026026736, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.018334070, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.022640564, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 786, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.051903711, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000066035 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.494 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 324416 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-09-11T22:40:07.495 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2906, 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.076694254, 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000026391 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.496 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 0, 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 0, 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 0, 2024-09-11T22:40:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 0, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 45, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 0, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 45, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 45, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 0, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 0, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 0, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 1, 2024-09-11T22:40:07.498 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-09-11T22:40:07.499 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2024-09-11T22:40:07.500 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 0 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 0, 2024-09-11T22:40:07.501 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:40:07.502 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-09-11T22:40:07.503 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 0, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 3701, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 0, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 6, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 2, 2024-09-11T22:40:07.504 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 8681221, 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 8679570, 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 3701 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-09-11T22:40:07.505 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 4, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 58, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 54, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 2, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 15, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 13, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 45, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 99, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 54, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 0, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 0, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 0, 2024-09-11T22:40:07.506 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 52116, 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 215328 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 0, 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 0, 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 0, 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.507 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.508 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.509 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.510 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.511 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-09-11T22:40:07.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.512 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.512 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-09-11T22:40:07.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.512 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.512 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.513 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.514 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-09-11T22:40:07.515 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-09-11T22:40:07.517 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.518 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:07.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 2, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 1, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 0, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 0, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 1935, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:07.521 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:07.522 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 199031, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 58, 2024-09-11T22:40:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 8776, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 166, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:07.524 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 43728, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 208, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 1696, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 21, 2024-09-11T22:40:07.525 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 3, 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 1696, 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1696, 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 93.473528971, 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.055114109 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1696, 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1697 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 1696, 2024-09-11T22:40:07.526 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 1696, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 1023, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 671, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-09-11T22:40:07.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 1, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:40:07.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-09-11T22:40:07.529 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 95, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 2, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 6, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 6, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-09-11T22:40:07.530 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 0, 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 2, 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 0 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 0, 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "osd-slow-ops": { 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 0 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.531 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 0, 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 0, 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 0, 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-11T22:40:07.532 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 1917, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 5316467, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 1917, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 1917, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 5316467, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:07.533 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 1696, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 4490012, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 1696, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 4490012, 2024-09-11T22:40:07.534 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:07.535 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 1696, 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 1696, 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 1696, 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 1696, 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.536 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55b2b9b82b40": { 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:07.538 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:07.539 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 0, 2024-09-11T22:40:07.539 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 0, 2024-09-11T22:40:07.539 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:07.539 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:07.539 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:07.539 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:07.539 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:07.539 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:07.539 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-11T22:40:08.533 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-11T22:40:08.533 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-11T22:40:08.533 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-11T22:40:08.533 DEBUG:tasks.check_counter:Getting stats from h 2024-09-11T22:40:08.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-11T22:40:08.791 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:40:08.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:08 smithi146 ceph-mon[34996]: pgmap v661: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 48 op/s 2024-09-11T22:40:08.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:08 smithi040 ceph-mon[30787]: pgmap v661: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 48 op/s 2024-09-11T22:40:09.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:08 smithi177 ceph-mon[35530]: pgmap v661: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 48 op/s 2024-09-11T22:40:09.345 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-11T22:40:09.345 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:09.345 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 1409, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 1409, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 13000631, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 447245, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 6, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 2, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.125168507, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.035142216, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.041858180, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.038852000, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1408, 2024-09-11T22:40:09.346 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.051709366, 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000036725 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 559, 2024-09-11T22:40:09.347 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 546, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 2402095, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 231188, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 4, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.062428777, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.019504505, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.031994740, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.013339309, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 545, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.025001890, 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000045875 2024-09-11T22:40:09.348 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 531840, 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 122688 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 2, 2024-09-11T22:40:09.349 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 151, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 428, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 326174, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 4, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.008176516, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.005987052, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.000890209, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.000026199, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 149, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.009154500, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000061439 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.350 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 325856 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-09-11T22:40:09.351 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3014, 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.068639515, 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000022773 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 0, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 0, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 0, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-09-11T22:40:09.353 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 0, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 44, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 0, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 44, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 44, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 0, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 0, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 0, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 1, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 0, 2024-09-11T22:40:09.354 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-09-11T22:40:09.355 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:40:09.356 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-09-11T22:40:09.356 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2024-09-11T22:40:09.356 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2024-09-11T22:40:09.356 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2024-09-11T22:40:09.356 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:40:09.356 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-09-11T22:40:09.356 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:40:09.356 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:40:09.356 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 0, 2024-09-11T22:40:09.357 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 0 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 0, 2024-09-11T22:40:09.358 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2024-09-11T22:40:09.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 6850, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 8, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 2, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-09-11T22:40:09.360 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-09-11T22:40:09.361 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-09-11T22:40:09.361 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 18561057, 2024-09-11T22:40:09.361 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 18559919, 2024-09-11T22:40:09.361 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-09-11T22:40:09.361 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.361 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.361 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.361 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 6850 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 5, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 333, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 328, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 3, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 101, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 98, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 44, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 475, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 431, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 0, 2024-09-11T22:40:09.362 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 0, 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 0, 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 51404, 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 215328 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 0, 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 0, 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 0, 2024-09-11T22:40:09.363 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.364 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-09-11T22:40:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.366 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.368 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-09-11T22:40:09.368 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.368 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.368 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.369 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.370 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-09-11T22:40:09.371 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.373 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-09-11T22:40:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.375 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 2, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 1, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 0, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 0, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 1934, 2024-09-11T22:40:09.376 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:09.377 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:09.378 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:09.379 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 190123, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 52, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 8776, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 166, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:09.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:09.381 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:09.381 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-09-11T22:40:09.381 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 46536, 2024-09-11T22:40:09.381 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 216, 2024-09-11T22:40:09.381 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:09.381 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-09-11T22:40:09.381 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:09.381 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-09-11T22:40:09.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 1747, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 21, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 3, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 1747, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1747, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 96.899472976, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.055466212 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-09-11T22:40:09.382 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1747, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1748 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 1747, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 1747, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 0, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 1023, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 0, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 722, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 0, 2024-09-11T22:40:09.383 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 1, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 0, 2024-09-11T22:40:09.384 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-09-11T22:40:09.385 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-09-11T22:40:09.386 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 95, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 2, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 5, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 5, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 0, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 2, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 0 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 0, 2024-09-11T22:40:09.387 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "osd-slow-ops": { 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 0 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 0, 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 0, 2024-09-11T22:40:09.388 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 0, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 1966, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 15212089, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 1966, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:09.389 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 1966, 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 15212089, 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:09.390 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 1747, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 14377702, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 1747, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 14377702, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.391 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 1747, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 1747, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 1747, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 1747, 2024-09-11T22:40:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 0, 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 0, 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x56228c208b40": { 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-11T22:40:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:09.395 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:09.396 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-11T22:40:10.125 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-11T22:40:10.125 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-11T22:40:10.125 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-11T22:40:10.125 DEBUG:tasks.check_counter:Getting stats from k 2024-09-11T22:40:10.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-11T22:40:10.374 INFO:teuthology.orchestra.run.smithi146.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T22:40:10.791 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:10 smithi146 ceph-mon[34996]: pgmap v662: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-11T22:40:10.895 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-11T22:40:10.895 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:10.895 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 0, 2024-09-11T22:40:10.895 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 2, 2024-09-11T22:40:10.895 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 0, 2024-09-11T22:40:10.895 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 0, 2024-09-11T22:40:10.895 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 4, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 0, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.000971674, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.000129951, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:10.896 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 206, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 203, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 474640, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 124704, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 2, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 1, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.028962655, 2024-09-11T22:40:10.897 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.012724873, 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.020226027, 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 202, 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.010506171, 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000052010 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.898 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 474640, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 124704 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 5, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 156, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 3152, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 106032, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 3, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 2, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.010579768, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.006477447, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.002706231, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:10.899 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 155, 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.011953336, 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000077118 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 106032 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-09-11T22:40:10.900 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:10.901 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:10.902 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 148945, 2024-09-11T22:40:10.903 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 29, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:10.904 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 928, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 2, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-11T22:40:10.905 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 207, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 445534, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 207, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 207, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 445534, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-11T22:40:10.906 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-11T22:40:10.907 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:10.907 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-11T22:40:10.907 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-11T22:40:10.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:10 smithi040 ceph-mon[30787]: pgmap v662: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-11T22:40:11.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:10 smithi177 ceph-mon[35530]: pgmap v662: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-11T22:40:11.614 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-11T22:40:11.614 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-11T22:40:11.614 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-11T22:40:11.615 DEBUG:tasks.check_counter:Getting stats from c 2024-09-11T22:40:11.615 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-11T22:40:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:40:12.389 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:12 smithi177 ceph-mon[35530]: pgmap v663: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:40:12.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:12 smithi040 ceph-mon[30787]: pgmap v663: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:40:12.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:12 smithi146 ceph-mon[34996]: pgmap v663: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-11T22:40:12.686 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1580, 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 1436, 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 915319, 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 4132917, 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 8, 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 3, 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.155752866, 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.057363578, 2024-09-11T22:40:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.078603205, 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.027646816, 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1437, 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.088520947, 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000061601 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1402, 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000275218, 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000196 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 542400, 2024-09-11T22:40:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 128944 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1079, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 1769, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 381511, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 1243231, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 12, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 8, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.129949010, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.057551267, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.049208034, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.018064285, 2024-09-11T22:40:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1770, 2024-09-11T22:40:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.121066006, 2024-09-11T22:40:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000068398 2024-09-11T22:40:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1591, 2024-09-11T22:40:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000561906, 2024-09-11T22:40:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000353 2024-09-11T22:40:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 326480 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 4374, 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 4605, 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 1459813, 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 1645024, 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 11, 2024-09-11T22:40:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 9, 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.258041397, 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.087654439, 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.207070273, 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.013771269, 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 4599, 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.289573378, 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000062964 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3109, 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.001027023, 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000330 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 1440 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-09-11T22:40:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 392, 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.621257558, 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001584840 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-11T22:40:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1170, 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.040381831, 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000034514 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 207, 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 200, 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 200, 2024-09-11T22:40:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.206238110, 2024-09-11T22:40:12.696 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001031190 2024-09-11T22:40:12.696 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.696 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 0, 2024-09-11T22:40:12.696 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 7, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 0, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 11, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 0, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 0, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 11, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 0, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 1, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 10, 2024-09-11T22:40:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 10, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 27, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 0, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 0, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 2, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 452, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 355, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 6, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 8, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:40:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 0, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 0, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 0, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 3, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 12, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 3, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 44, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 325, 2024-09-11T22:40:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 13424230454, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 3, 2024-09-11T22:40:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 328, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 3593, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 3409, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 10, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 91 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 0, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 3, 2024-09-11T22:40:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 2, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 11, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 0, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 0, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 44, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 44, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:40:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:40:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-09-11T22:40:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-09-11T22:40:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:40:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:40:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:40:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 3, 2024-09-11T22:40:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-09-11T22:40:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:40:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 0, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 3701, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 0, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 0, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 3701, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 0, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 6, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 0, 2024-09-11T22:40:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 0, 2024-09-11T22:40:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 6, 2024-09-11T22:40:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 2, 2024-09-11T22:40:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-09-11T22:40:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 0, 2024-09-11T22:40:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 4194304, 2024-09-11T22:40:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 8681221, 2024-09-11T22:40:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 0, 2024-09-11T22:40:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-09-11T22:40:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 129, 2024-09-11T22:40:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 16.329153998, 2024-09-11T22:40:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.126582589 2024-09-11T22:40:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 0 2024-09-11T22:40:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-09-11T22:40:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 16, 2024-09-11T22:40:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 71, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 55, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 13, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 29, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 16, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 11, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 114, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 103, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 0, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 91, 2024-09-11T22:40:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 91, 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 56524, 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 223520 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 366, 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 2, 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 207, 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 11, 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 51, 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-09-11T22:40:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1, 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000199682, 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000199682 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 151, 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.064535973, 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000427390 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-09-11T22:40:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-09-11T22:40:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-09-11T22:40:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-09-11T22:40:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1, 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000376042, 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000376042 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3, 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.001643058, 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000547686 2024-09-11T22:40:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-09-11T22:40:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 44, 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.139483355, 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.003170076 2024-09-11T22:40:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 1, 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 2, 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 1, 2024-09-11T22:40:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 1, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 107, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 107, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 466, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 277117, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 115, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:40:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 8776, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 166, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 60968, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 247, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 1423, 2024-09-11T22:40:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 4515171, 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 33, 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 1423, 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1423, 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 110.962880255, 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.077978130 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1423, 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 1522 2024-09-11T22:40:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 1423, 2024-09-11T22:40:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 1, 2024-09-11T22:40:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 1422, 2024-09-11T22:40:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-09-11T22:40:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-09-11T22:40:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 0, 2024-09-11T22:40:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 10, 2024-09-11T22:40:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 1, 2024-09-11T22:40:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 130, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 34, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 0, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 1157, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 0, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 20, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:40:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-09-11T22:40:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-09-11T22:40:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-09-11T22:40:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-09-11T22:40:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-09-11T22:40:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-09-11T22:40:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 95, 2024-09-11T22:40:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-09-11T22:40:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 2, 2024-09-11T22:40:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 12, 2024-09-11T22:40:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 12, 2024-09-11T22:40:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 120, 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 0, 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 50 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 1, 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "osd-slow-ops": { 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 0 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 26, 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 1, 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 1144, 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 44, 2024-09-11T22:40:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 7029, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 2171413, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 7029, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 7029, 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 2171413, 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-11T22:40:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-11T22:40:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-11T22:40:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 1423, 2024-09-11T22:40:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 4519967, 2024-09-11T22:40:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1423, 2024-09-11T22:40:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 4519967, 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-11T22:40:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 1423, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 1423, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1423, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 1423, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 44, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 4796, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 44, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 4796, 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x555577ff6960": { 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 3701, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 4486917, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 3701, 2024-09-11T22:40:12.742 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 129, 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 4486917, 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:12.743 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-11T22:40:13.715 INFO:tasks.check_counter:Daemon mds.c mds.exported=3 2024-09-11T22:40:13.715 INFO:tasks.check_counter:Daemon mds.c mds.imported=3 2024-09-11T22:40:13.715 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-11T22:40:13.715 DEBUG:tasks.check_counter:Getting stats from f 2024-09-11T22:40:13.715 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-11T22:40:13.972 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:40:14.620 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-11T22:40:14.620 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:14.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 300, 2024-09-11T22:40:14.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 302, 2024-09-11T22:40:14.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 4269953, 2024-09-11T22:40:14.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 95407, 2024-09-11T22:40:14.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 6, 2024-09-11T22:40:14.620 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 2, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.030043596, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.009364773, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.009012492, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.008453529, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 300, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.011164232, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000037214 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.621 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1512, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 1499, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 9300627, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 535049, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 4, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 3, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.153302452, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.048752771, 2024-09-11T22:40:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.058539701, 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.041728324, 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1498, 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.069389714, 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000046321 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 532816, 2024-09-11T22:40:14.623 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 124768 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 403, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 552, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 2383942, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 454845, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 5, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 4, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.054766053, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.014907056, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.018133164, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.017500220, 2024-09-11T22:40:14.624 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 551, 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.036567339, 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000066365 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 328272 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-09-11T22:40:14.625 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3343, 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.084976108, 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000025419 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-11T22:40:14.626 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 0, 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 0, 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 0, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 0, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 0, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 0, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 0, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 0, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 866, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 0, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 866, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 0, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 866, 2024-09-11T22:40:14.628 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 2, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 0, 2024-09-11T22:40:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 4, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 234, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:40:14.630 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 0, 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 0 2024-09-11T22:40:14.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-09-11T22:40:14.632 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-09-11T22:40:14.633 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 0, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 0, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 0, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 0, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 8999, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 0, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 0, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 0, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 0, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 12, 2024-09-11T22:40:14.634 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 2, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 0, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 4194304, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 19056498, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 19055899, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 8999 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-09-11T22:40:14.635 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 18, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 1019, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 1001, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 13, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 188, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 175, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 866, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 1674, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 808, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 0, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 0, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 0, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 52488, 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 215328 2024-09-11T22:40:14.636 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 0, 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 0, 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 0, 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 0, 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 0, 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.637 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.638 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.639 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.640 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.641 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-09-11T22:40:14.642 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.643 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.644 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.645 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.646 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.647 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:14.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 1, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 3, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 2, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 1, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 0, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 0, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 1946, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-09-11T22:40:14.649 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:14.650 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:14.651 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 197478, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 55, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-09-11T22:40:14.652 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 8776, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 166, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 666970, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 3784, 2024-09-11T22:40:14.653 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 1988, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 26, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 4, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 1988, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1988, 2024-09-11T22:40:14.654 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 64.996123989, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.032694227 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1988, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 1989 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 1988, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 1988, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 0, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 1204, 2024-09-11T22:40:14.655 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 781, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 2, 2024-09-11T22:40:14.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-09-11T22:40:14.657 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 95, 2024-09-11T22:40:14.658 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 2, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 6, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 6, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 0, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 2, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 0 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 0, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-09-11T22:40:14.659 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "osd-slow-ops": { 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 0 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 0, 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 0, 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 0, 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.660 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 2211, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 15741205, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 2211, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 2211, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 15741205, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.661 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 1988, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 14863972, 2024-09-11T22:40:14.662 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1988, 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 14863972, 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-11T22:40:14.663 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 1988, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 1988, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1988, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 1988, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:40:14.664 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.665 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x56066abe0b40": { 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 0, 2024-09-11T22:40:14.666 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 0, 2024-09-11T22:40:14.667 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:14.667 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:14.667 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:14.667 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:14.667 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:14.667 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:14.667 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-11T22:40:14.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:14 smithi177 ceph-mon[35530]: pgmap v664: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:40:14.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:14 smithi146 ceph-mon[34996]: pgmap v664: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:40:14.971 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:14 smithi040 ceph-mon[30787]: pgmap v664: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-11T22:40:15.536 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-11T22:40:15.536 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-11T22:40:15.536 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-11T22:40:15.536 DEBUG:tasks.check_counter:Getting stats from i 2024-09-11T22:40:15.537 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-11T22:40:15.784 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:40:16.320 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1983, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 1426, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 1109165, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 2468747, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 12, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 6, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.153288127, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.059405040, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.085698995, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.022295516, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1426, 2024-09-11T22:40:16.321 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.115011524, 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000080653 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1705, 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000232075, 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000136 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 548144, 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 128656 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 9224, 2024-09-11T22:40:16.322 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 10534, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 3027253, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 16620075, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 11, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 8, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.586523555, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.236986650, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.422560383, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.047465823, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 10530, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.894147069, 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000084914 2024-09-11T22:40:16.323 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.324 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:16.324 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 6456, 2024-09-11T22:40:16.324 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.002602900, 2024-09-11T22:40:16.324 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000403 2024-09-11T22:40:16.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.324 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-11T22:40:16.324 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 330000 2024-09-11T22:40:16.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.324 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1564, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 1494, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 716933, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 844472, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 8, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 5, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.124846147, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.041098554, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.071103337, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.018103136, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1494, 2024-09-11T22:40:16.325 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.095106597, 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000063659 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2161, 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000416345, 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000192 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.326 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-09-11T22:40:16.327 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 1, 2024-09-11T22:40:16.327 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-09-11T22:40:16.327 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.327 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-MDSRank": { 2024-09-11T22:40:16.327 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-11T22:40:16.327 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-11T22:40:16.327 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2338, 2024-09-11T22:40:16.327 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 2.166476736, 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000926636 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: "finisher-PurgeQueue": { 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: "queue_len": 0, 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: "complete_latency": { 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1038, 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.035634008, 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000034329 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": { 2024-09-11T22:40:16.328 INFO:teuthology.orchestra.run.smithi177.stdout: "request": 420, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "reply": 402, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "reply_latency": { 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 402, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.371100880, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000923136 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_reply": 0, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "forward": 18, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_complete": 0, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_fetch_keys": 0, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_commit": 20, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_split": 1, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_merge": 0, 2024-09-11T22:40:16.329 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes": 17, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_top": 2, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_bottom": 2, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pin_tail": 13, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_pinned": 13, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_expired": 416, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "inodes_with_caps": 1, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": 1, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "subtrees": 4, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse": 690, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_hit": 663, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_forward": 12, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_discover": 6, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_dir_fetch": 0, 2024-09-11T22:40:16.330 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_remote_ino": 0, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "traverse_lock": 0, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "load_cent": 0, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "q": 0, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "exported": 10, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "exported_inodes": 366, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "imported": 10, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "imported_inodes": 315, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_dir_fetch": 0, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_backtrace_fetch": 0, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "openino_peer_discover": 0, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rfiles": 325, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rbytes": 13424230454, 2024-09-11T22:40:16.331 INFO:teuthology.orchestra.run.smithi177.stdout: "root_rsnaps": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_set_tag": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_inotable_repaired": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_inodes": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "scrub_file_inodes": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_inode_file_caps": 6, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_revoke": 11, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_grant": 1257, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T22:40:16.332 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps": 7273, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_caps_dirty": 6878, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_cap_release": 10, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "process_request_cap_release": 98 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_cache": { 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update": 0, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_update_receipt": 3, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_try_discover": 2, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_send_discover": 8, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "dir_handle_discover": 6, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays": 0, 2024-09-11T22:40:16.333 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_delayed": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "num_strays_enqueuing": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_created": 42, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_enqueued": 42, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_reintegrated": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "strays_migrated": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_processing": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_enqueued": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "num_recovering_prioritized": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_started": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_completed": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_path": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_quiesce_inode": 0, 2024-09-11T22:40:16.334 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_exportdir": 10, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_flush": 0, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragmentdir": 1, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_fragstats": 0, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "ireq_inodestats": 0 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_log": { 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "evlrg": 0, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "evadd": 6850, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "evex": 0, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "evtrm": 0, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "ev": 6850, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "evexg": 0, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "evexd": 0, 2024-09-11T22:40:16.335 INFO:teuthology.orchestra.run.smithi177.stdout: "segadd": 8, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "segex": 0, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "segtrm": 0, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "seg": 8, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "segmjr": 2, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "segexg": 0, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "segexd": 0, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "expos": 4194304, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "wrpos": 18561057, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "rdpos": 0, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "jlat": { 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1088, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 47.806153490, 2024-09-11T22:40:16.336 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.043939479 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "replayed": 0 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_mem": { 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "ino": 22, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "ino+": 344, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "ino-": 322, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "dir": 21, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "dir+": 113, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "dir-": 92, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "dn": 17, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "dn+": 526, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "dn-": 509, 2024-09-11T22:40:16.337 INFO:teuthology.orchestra.run.smithi177.stdout: "cap": 1, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "cap+": 357, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "cap-": 356, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "rss": 62764, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "heap": 223520 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_server": { 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_client_request": 438, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "dispatch_server_request": 96, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_request": 420, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_client_session": 20, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "handle_peer_request": 203, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "req_create_latency": { 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 102, 2024-09-11T22:40:16.338 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.098384479, 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000964553 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getattr_latency": { 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2, 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.001807578, 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000903789 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getfilelock_latency": { 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "req_link_latency": { 2024-09-11T22:40:16.339 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookup_latency": { 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 246, 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.158915865, 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000645999 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookuphash_latency": { 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.340 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupino_latency": { 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 1, 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000137033, 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000137033 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupname_latency": { 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupparent_latency": { 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.341 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lookupsnap_latency": { 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: "req_lssnap_latency": { 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.342 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.343 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.343 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.343 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mkdir_latency": { 2024-09-11T22:40:16.343 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mknod_latency": { 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "req_mksnap_latency": { 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "req_open_latency": { 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 5, 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.002641368, 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000528273 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "req_readdir_latency": { 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 4, 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.002209268, 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000552317 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rename_latency": { 2024-09-11T22:40:16.345 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2, 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.003578105, 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001789052 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: "req_renamesnap_latency": { 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: "req_snapdiff_latency": { 2024-09-11T22:40:16.346 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmdir_latency": { 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2, 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.061314290, 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.030657145 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmsnap_latency": { 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.347 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: "req_rmxattr_latency": { 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setattr_latency": { 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.348 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setdirlayout_latency": { 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setfilelock_latency": { 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setlayout_latency": { 2024-09-11T22:40:16.349 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "req_setxattr_latency": { 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "req_symlink_latency": { 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.350 INFO:teuthology.orchestra.run.smithi177.stdout: "req_unlink_latency": { 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 38, 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.042112894, 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001108234 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_revoke_eviction": 0, 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: "cap_acquisition_throttle": 0, 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: "req_getvxattr_latency": { 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:16.351 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_sessions": { 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "session_count": 1, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "session_add": 2, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "session_remove": 1, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_open": 1, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "sessions_stale": 0, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "total_load": 104, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "average_load": 104, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "avg_session_uptime": 547, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "mdthresh_evicted": 0 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-09-11T22:40:16.352 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:16.353 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:16.354 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 292271, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 118, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 88, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 1, 2024-09-11T22:40:16.355 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 8776, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 166, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 89485, 2024-09-11T22:40:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 370, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "objecter": { 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "op_active": 0, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "op_laggy": 0, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send": 2325, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "op_send_bytes": 14569475, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "op_resend": 27, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "op_reply": 2325, 2024-09-11T22:40:16.357 INFO:teuthology.orchestra.run.smithi177.stdout: "op_latency": { 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2325, 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 132.308258767, 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.056906777 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "op_inflight": 0, 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "oplen_avg": { 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 2325, 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 2538 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "op": 2325, 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "op_r": 4, 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "op_w": 2321, 2024-09-11T22:40:16.358 INFO:teuthology.orchestra.run.smithi177.stdout: "op_rmw": 0, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "op_pg": 0, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_stat": 0, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_create": 10, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_read": 4, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_write": 1092, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writefull": 36, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_writesame": 0, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_append": 0, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_zero": 0, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_truncate": 1, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_delete": 1017, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_mapext": 0, 2024-09-11T22:40:16.359 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_sparse_read": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_clonerange": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_getxattr": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_setxattr": 20, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_cmpxattr": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_rmxattr": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_resetxattrs": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_call": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_watch": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_notify": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_pgls_filter": 0, 2024-09-11T22:40:16.360 INFO:teuthology.orchestra.run.smithi177.stdout: "osdop_other": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_active": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_send": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_resend": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "linger_ping": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_active": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_send": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "poolop_resend": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_active": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_send": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "poolstat_resend": 0, 2024-09-11T22:40:16.361 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_active": 0, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_send": 0, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "statfs_resend": 0, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "command_active": 0, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "command_send": 0, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "command_resend": 0, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "map_epoch": 95, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "map_full": 0, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "map_inc": 2, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_sessions": 12, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_open": 12, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_session_close": 0, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_laggy": 0, 2024-09-11T22:40:16.362 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_wr": 251, 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_rd": 0, 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_del": 107 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "oft": { 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_objs": 1, 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_kv_pairs": 0, 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_updates": 0, 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "omap_total_removes": 0 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "osd-slow-ops": { 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "slow_ops_count": 0 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.363 INFO:teuthology.orchestra.run.smithi177.stdout: "purge_queue": { 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops": 0, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_ops_high_water": 27, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing": 0, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executing_high_water": 2, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed_ops": 1002, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_executed": 42, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pq_item_in_journal": 0 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 12767, 2024-09-11T22:40:16.364 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 3815020, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 12767, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 12767, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 3815020, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_bytes": { 2024-09-11T22:40:16.365 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:16.366 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-11T22:40:16.366 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:16.366 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-11T22:40:16.366 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-11T22:40:16.366 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:16.366 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:16.367 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 2325, 2024-09-11T22:40:16.367 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 14574045, 2024-09-11T22:40:16.367 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 2325, 2024-09-11T22:40:16.367 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 14574045, 2024-09-11T22:40:16.367 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:16.367 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.367 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-objecter_ops": { 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 1024, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 0, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 0, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 0, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 2325, 2024-09-11T22:40:16.368 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 2325, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 2325, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 2325, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle": { 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 42, 2024-09-11T22:40:16.369 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 4570, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 42, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 4, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 4570, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:16.370 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-write_buf_throttle-0x565163676960": { 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 3758096384, 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 6850, 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 14366753, 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 6850, 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:16.371 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 1088, 2024-09-11T22:40:16.372 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 14366753, 2024-09-11T22:40:16.372 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:16.372 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:16.372 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:16.372 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:16.372 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:16.372 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:16.372 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-11T22:40:16.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:16 smithi177 ceph-mon[35530]: pgmap v665: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:40:16.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:16 smithi146 ceph-mon[34996]: pgmap v665: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:40:16.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:16 smithi040 ceph-mon[30787]: pgmap v665: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T22:40:17.105 INFO:tasks.check_counter:Daemon mds.i mds.exported=10 2024-09-11T22:40:17.105 INFO:tasks.check_counter:Daemon mds.i mds.imported=10 2024-09-11T22:40:17.105 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=1 2024-09-11T22:40:17.105 DEBUG:tasks.check_counter:Getting stats from l 2024-09-11T22:40:17.105 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-11T22:40:17.352 INFO:teuthology.orchestra.run.smithi177.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T22:40:17.856 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 209, 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 206, 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 475456, 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 126624, 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 4, 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 0, 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.030515210, 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.012668724, 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.021471996, 2024-09-11T22:40:17.857 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 205, 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.011465404, 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000055928 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 475456, 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 126624 2024-09-11T22:40:17.858 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 1, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 156, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 160, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 105936, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 3, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 2, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.008708600, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.006289494, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.000747545, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:17.859 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 154, 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.010676808, 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000069329 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 105936 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T22:40:17.860 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_messages": 4, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages": 4, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_bytes": 2992, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_bytes": 448, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_created_connections": 2, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_active_connections": 1, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_total_time": 0.002290707, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_send_time": 0.000029533, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_recv_time": 0.002242191, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 3, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.004173106, 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.001391035 2024-09-11T22:40:17.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_handle_ack_lat": { 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "cct": { 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "total_workers": 0, 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "unhealthy_workers": 0 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.862 INFO:teuthology.orchestra.run.smithi177.stdout: "mempool": { 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_bytes": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bloom_filter_items": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_alloc_items": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_data_items": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_other_items": 0, 2024-09-11T22:40:17.863 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_bytes": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_extent_items": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_bytes": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_blob_items": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_fsck_items": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_bytes": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_txc_items": 0, 2024-09-11T22:40:17.864 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_bytes": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bluestore_writing_items": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_bytes": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_items": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_reader_items": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "bluefs_file_writer_items": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_bytes": 148984, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_anon_items": 30, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_bytes": 0, 2024-09-11T22:40:17.865 INFO:teuthology.orchestra.run.smithi177.stdout: "buffer_meta_items": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_bytes": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_items": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_bytes": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_mapbl_items": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_bytes": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_pglog_items": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_bytes": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_items": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_mapping_items": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_bytes": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "pgmap_items": 0, 2024-09-11T22:40:17.866 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_bytes": 928, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_co_items": 2, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_bytes": 0, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_1_items": 0, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_bytes": 0, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "unittest_2_items": 0 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "val": 0, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "max": 104857600, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "get_started": 0, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "get": 210, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "get_sum": 445924, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_fail": 0, 2024-09-11T22:40:17.867 INFO:teuthology.orchestra.run.smithi177.stdout: "get_or_fail_success": 210, 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: "take": 0, 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: "take_sum": 0, 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: "put": 210, 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: "put_sum": 445924, 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: "wait": { 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: "avgcount": 0, 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: "sum": 0.000000000, 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: "avgtime": 0.000000000 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout: } 2024-09-11T22:40:17.868 INFO:teuthology.orchestra.run.smithi177.stdout:} 2024-09-11T22:40:18.603 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-11T22:40:18.603 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-11T22:40:18.603 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-11T22:40:18.603 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-11T22:40:18.613 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-11T22:40:18.613 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:40:18.613 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:40:18.673 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-11T22:40:18.674 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:40:18.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T22:40:18.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:18 smithi177 ceph-mon[35530]: pgmap v666: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:40:18.822 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:18 smithi146 ceph-mon[34996]: pgmap v666: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:40:18.845 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:18 smithi040 ceph-mon[30787]: pgmap v666: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T22:40:19.182 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:19.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.753+0000 7fadc7e00640 1 -- 172.21.15.40:0/4188131753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc81079c0 msgr2=0x7fadc8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.753+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4188131753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc81079c0 0x7fadc8107da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009930 tx=0x7fadb802a420 comp rx=0 tx=0).stop 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.753+0000 7fadc7e00640 1 -- 172.21.15.40:0/4188131753 shutdown_connections 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.753+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4188131753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc8102360 0x7fadc810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.753+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4188131753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadc81019c0 0x7fadc8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.753+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4188131753 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc81079c0 0x7fadc8107da0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.753+0000 7fadc7e00640 1 -- 172.21.15.40:0/4188131753 >> 172.21.15.40:0/4188131753 conn(0x7fadc80fd740 msgr2=0x7fadc80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.753+0000 7fadc7e00640 1 -- 172.21.15.40:0/4188131753 shutdown_connections 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.753+0000 7fadc7e00640 1 -- 172.21.15.40:0/4188131753 wait complete. 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.754+0000 7fadc7e00640 1 Processor -- start 2024-09-11T22:40:19.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.754+0000 7fadc7e00640 1 -- start start 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.754+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc81019c0 0x7fadc81982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.754+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc8102360 0x7fadc81987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.754+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadc81079c0 0x7fadc819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.754+0000 7fadc7e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fadc8111dc0 con 0x7fadc8102360 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.754+0000 7fadc7e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fadc8111c40 con 0x7fadc81079c0 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.754+0000 7fadc7e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fadc8111f40 con 0x7fadc81019c0 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadbfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc8102360 0x7fadc81987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadbfe00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc8102360 0x7fadc81987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50664/0 (socket says 172.21.15.40:50664) 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadc7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadc81079c0 0x7fadc819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadbfe00640 1 -- 172.21.15.40:0/4235883373 learned_addr learned my addr 172.21.15.40:0/4235883373 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:40:19.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadc6a00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc81019c0 0x7fadc81982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadbfe00640 1 -- 172.21.15.40:0/4235883373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc81019c0 msgr2=0x7fadc81982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadbfe00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc81019c0 0x7fadc81982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadbfe00640 1 -- 172.21.15.40:0/4235883373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadc81079c0 msgr2=0x7fadc819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadbfe00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadc81079c0 0x7fadc819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.755+0000 7fadbfe00640 1 -- 172.21.15.40:0/4235883373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc819d250 con 0x7fadc8102360 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.756+0000 7fadbfe00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc8102360 0x7fadc81987e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fadb000d950 tx=0x7fadb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.756+0000 7fadcca00640 1 -- 172.21.15.40:0/4235883373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0017070 con 0x7fadc8102360 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.756+0000 7fadcca00640 1 -- 172.21.15.40:0/4235883373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadb0009c30 con 0x7fadc8102360 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.756+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc819d540 con 0x7fadc8102360 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.756+0000 7fadcca00640 1 -- 172.21.15.40:0/4235883373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb000f6b0 con 0x7fadc8102360 2024-09-11T22:40:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.756+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc81a4e20 con 0x7fadc8102360 2024-09-11T22:40:19.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.757+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc8101e20 con 0x7fadc8102360 2024-09-11T22:40:19.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.759+0000 7fadcca00640 1 -- 172.21.15.40:0/4235883373 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fadb00109d0 con 0x7fadc8102360 2024-09-11T22:40:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.760+0000 7fadcca00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fadac0a2b80 0x7fadac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.760+0000 7fadcca00640 1 -- 172.21.15.40:0/4235883373 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fadb00cefb0 con 0x7fadc8102360 2024-09-11T22:40:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.761+0000 7fadc6a00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fadac0a2b80 0x7fadac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:19.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.761+0000 7fadc6a00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fadac0a2b80 0x7fadac0a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009900 tx=0x7fadb80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:19.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.763+0000 7fadcca00640 1 -- 172.21.15.40:0/4235883373 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadb0009de0 con 0x7fadc8102360 2024-09-11T22:40:19.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.964+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fadc802d7c0 con 0x7fadc8102360 2024-09-11T22:40:19.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.964+0000 7fadcca00640 1 -- 172.21.15.40:0/4235883373 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v95) ==== 81+0+592 (secure 0 0 0) 0x7fadb009b4d0 con 0x7fadc8102360 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3768094180 2024-09-12T22:20:56.889250+0000 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2421714119 2024-09-12T22:20:56.889250+0000 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3054635908 2024-09-12T22:20:56.889250+0000 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/2835470410 2024-09-12T22:20:56.889250+0000 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2148182783 2024-09-12T22:20:29.708392+0000 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3034121439 2024-09-12T22:20:29.708392+0000 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6801/2370914626 2024-09-12T22:20:29.708392+0000 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/2370914626 2024-09-12T22:20:29.708392+0000 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6800/2835470410 2024-09-12T22:20:56.889250+0000 2024-09-11T22:40:19.966 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2543187724 2024-09-12T22:20:29.708392+0000 2024-09-11T22:40:19.967 INFO:teuthology.orchestra.run.smithi040.stderr:listed 10 entries 2024-09-11T22:40:19.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fadac0a2b80 msgr2=0x7fadac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fadac0a2b80 0x7fadac0a5040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009900 tx=0x7fadb80058d0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc8102360 msgr2=0x7fadc81987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc8102360 0x7fadc81987e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fadb000d950 tx=0x7fadb000de10 comp rx=0 tx=0).stop 2024-09-11T22:40:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 shutdown_connections 2024-09-11T22:40:19.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fadac0a2b80 0x7fadac0a5040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadc81079c0 0x7fadc819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc8102360 0x7fadc81987e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 --2- 172.21.15.40:0/4235883373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc81019c0 0x7fadc81982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 >> 172.21.15.40:0/4235883373 conn(0x7fadc80fd740 msgr2=0x7fadc80fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 shutdown_connections 2024-09-11T22:40:19.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:19.967+0000 7fadc7e00640 1 -- 172.21.15.40:0/4235883373 wait complete. 2024-09-11T22:40:20.718 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:20 smithi040 ceph-mon[30787]: pgmap v667: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:40:20.719 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:20 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/4235883373' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:40:20.760 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T22:40:20.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:40:20.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T22:40:20.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:20 smithi177 ceph-mon[35530]: pgmap v667: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:40:20.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:20 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/4235883373' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:40:20.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:20 smithi146 ceph-mon[34996]: pgmap v667: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-11T22:40:20.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:20 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/4235883373' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-11T22:40:20.888 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T22:40:20.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:40:20.889 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:40:20.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:40:20.955 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-11T22:40:21.025 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:40:21.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:40:21.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:40:21.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:40:21.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-09-11T22:40:21.417 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T22:40:21.585 INFO:tasks.cephadm:Teardown begin 2024-09-11T22:40:21.585 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:40:21.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:40:21.968 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:22.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.556+0000 7efe28a00640 1 -- 172.21.15.40:0/2744858831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe24109120 msgr2=0x7efe24110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:22.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.556+0000 7efe28a00640 1 --2- 172.21.15.40:0/2744858831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe24109120 0x7efe24110ca0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009ca0 tx=0x7efe1c02a8c0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.557+0000 7efe28a00640 1 -- 172.21.15.40:0/2744858831 shutdown_connections 2024-09-11T22:40:22.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.557+0000 7efe28a00640 1 --2- 172.21.15.40:0/2744858831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe24109120 0x7efe24110ca0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.557+0000 7efe28a00640 1 --2- 172.21.15.40:0/2744858831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe241049a0 0x7efe241089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.557+0000 7efe28a00640 1 --2- 172.21.15.40:0/2744858831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe24103ff0 0x7efe241043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.557+0000 7efe28a00640 1 -- 172.21.15.40:0/2744858831 >> 172.21.15.40:0/2744858831 conn(0x7efe240ffa90 msgr2=0x7efe24101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:22.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.557+0000 7efe28a00640 1 -- 172.21.15.40:0/2744858831 shutdown_connections 2024-09-11T22:40:22.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.557+0000 7efe28a00640 1 -- 172.21.15.40:0/2744858831 wait complete. 2024-09-11T22:40:22.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.558+0000 7efe28a00640 1 Processor -- start 2024-09-11T22:40:22.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.558+0000 7efe28a00640 1 -- start start 2024-09-11T22:40:22.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe28a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe24103ff0 0x7efe2419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:22.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe28a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe241049a0 0x7efe2419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:22.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe28a00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe24109120 0x7efe2419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:22.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe28a00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efe24114150 con 0x7efe24109120 2024-09-11T22:40:22.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe28a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efe24113fd0 con 0x7efe241049a0 2024-09-11T22:40:22.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe28a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe241142d0 con 0x7efe24103ff0 2024-09-11T22:40:22.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe22800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe24109120 0x7efe2419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:22.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe21e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe24103ff0 0x7efe2419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:22.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe1be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe241049a0 0x7efe2419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:22.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe21e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe24103ff0 0x7efe2419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:40502/0 (socket says 172.21.15.40:40502) 2024-09-11T22:40:22.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.559+0000 7efe21e00640 1 -- 172.21.15.40:0/2289171858 learned_addr learned my addr 172.21.15.40:0/2289171858 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:40:22.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe1be00640 1 -- 172.21.15.40:0/2289171858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe24103ff0 msgr2=0x7efe2419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:22.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe1be00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe24103ff0 0x7efe2419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe1be00640 1 -- 172.21.15.40:0/2289171858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe24109120 msgr2=0x7efe2419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:22.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe1be00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe24109120 0x7efe2419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe1be00640 1 -- 172.21.15.40:0/2289171858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2419f5e0 con 0x7efe241049a0 2024-09-11T22:40:22.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe1be00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe241049a0 0x7efe2419ab70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e9f0 tx=0x7efe0c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:22.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe1aa00640 1 -- 172.21.15.40:0/2289171858 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00ccc0 con 0x7efe241049a0 2024-09-11T22:40:22.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe1aa00640 1 -- 172.21.15.40:0/2289171858 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe0c010910 con 0x7efe241049a0 2024-09-11T22:40:22.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2419f8d0 con 0x7efe241049a0 2024-09-11T22:40:22.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe1aa00640 1 -- 172.21.15.40:0/2289171858 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c018960 con 0x7efe241049a0 2024-09-11T22:40:22.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.560+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe241a71b0 con 0x7efe241049a0 2024-09-11T22:40:22.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.561+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe241043d0 con 0x7efe241049a0 2024-09-11T22:40:22.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.564+0000 7efe1aa00640 1 -- 172.21.15.40:0/2289171858 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efe0c010ac0 con 0x7efe241049a0 2024-09-11T22:40:22.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.565+0000 7efe1aa00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efe080a2b80 0x7efe080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:22.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.566+0000 7efe1aa00640 1 -- 172.21.15.40:0/2289171858 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7efe0c0cfb00 con 0x7efe241049a0 2024-09-11T22:40:22.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.566+0000 7efe21e00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efe080a2b80 0x7efe080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:22.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.567+0000 7efe21e00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efe080a2b80 0x7efe080a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efe14009cd0 tx=0x7efe14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:22.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.567+0000 7efe1aa00640 1 -- 172.21.15.40:0/2289171858 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe0c09c020 con 0x7efe241049a0 2024-09-11T22:40:22.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:22 smithi040 ceph-mon[30787]: pgmap v668: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T22:40:22.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:22 smithi177 ceph-mon[35530]: pgmap v668: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T22:40:22.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.792+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe241a7410 con 0x7efe241049a0 2024-09-11T22:40:22.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.793+0000 7efe1aa00640 1 -- 172.21.15.40:0/2289171858 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11929 (secure 0 0 0) 0x7efe0c0a0320 con 0x7efe241049a0 2024-09-11T22:40:22.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:40:22.796 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":34,"btime":"2024-09-11T22:39:43:553604+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:39:43.030239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24517,"mds_2":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24527,24517,24499]},"id":1}]} 2024-09-11T22:40:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 34 2024-09-11T22:40:22.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efe080a2b80 msgr2=0x7efe080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efe080a2b80 0x7efe080a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efe14009cd0 tx=0x7efe14005f90 comp rx=0 tx=0).stop 2024-09-11T22:40:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe241049a0 msgr2=0x7efe2419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe241049a0 0x7efe2419ab70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e9f0 tx=0x7efe0c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 shutdown_connections 2024-09-11T22:40:22.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7efe080a2b80 0x7efe080a5040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe24109120 0x7efe2419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe241049a0 0x7efe2419ab70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 --2- 172.21.15.40:0/2289171858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe24103ff0 0x7efe2419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:22.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 >> 172.21.15.40:0/2289171858 conn(0x7efe240ffa90 msgr2=0x7efe241005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 shutdown_connections 2024-09-11T22:40:22.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:22.796+0000 7efe28a00640 1 -- 172.21.15.40:0/2289171858 wait complete. 2024-09-11T22:40:22.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:22 smithi146 ceph-mon[34996]: pgmap v668: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T22:40:23.571 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T22:40:23.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:23 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2289171858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:40:23.871 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:23 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2289171858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:40:23.966 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:24.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:23 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2289171858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:40:24.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.673+0000 7fdcb0e00640 1 -- 172.21.15.40:0/2806277467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcac1047e0 msgr2=0x7fdcac108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:24.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.673+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/2806277467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcac1047e0 0x7fdcac108830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009900 tx=0x7fdc9402a400 comp rx=0 tx=0).stop 2024-09-11T22:40:24.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.673+0000 7fdcb0e00640 1 -- 172.21.15.40:0/2806277467 shutdown_connections 2024-09-11T22:40:24.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.673+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/2806277467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcac108f60 0x7fdcac110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:24.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.673+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/2806277467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcac1047e0 0x7fdcac108830 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:24.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.673+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/2806277467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcac103e30 0x7fdcac104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:24.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.673+0000 7fdcb0e00640 1 -- 172.21.15.40:0/2806277467 >> 172.21.15.40:0/2806277467 conn(0x7fdcac0ff8d0 msgr2=0x7fdcac101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:24.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.673+0000 7fdcb0e00640 1 -- 172.21.15.40:0/2806277467 shutdown_connections 2024-09-11T22:40:24.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.673+0000 7fdcb0e00640 1 -- 172.21.15.40:0/2806277467 wait complete. 2024-09-11T22:40:24.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.674+0000 7fdcb0e00640 1 Processor -- start 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.674+0000 7fdcb0e00640 1 -- start start 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.674+0000 7fdcb0e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcac103e30 0x7fdcac19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.674+0000 7fdcb0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcac1047e0 0x7fdcac19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.674+0000 7fdcb0e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcac108f60 0x7fdcac19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.674+0000 7fdcb0e00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac114010 con 0x7fdcac103e30 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.674+0000 7fdcb0e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac113e90 con 0x7fdcac1047e0 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.674+0000 7fdcb0e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac114190 con 0x7fdcac108f60 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdcab400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcac103e30 0x7fdcac19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdca3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcac1047e0 0x7fdcac19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdcab400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcac103e30 0x7fdcac19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52580/0 (socket says 172.21.15.40:52580) 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdcab400640 1 -- 172.21.15.40:0/188043972 learned_addr learned my addr 172.21.15.40:0/188043972 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:40:24.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdcabe00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcac108f60 0x7fdcac19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:24.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdca3e00640 1 -- 172.21.15.40:0/188043972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcac108f60 msgr2=0x7fdcac19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:24.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdca3e00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcac108f60 0x7fdcac19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdca3e00640 1 -- 172.21.15.40:0/188043972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcac103e30 msgr2=0x7fdcac19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdca3e00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcac103e30 0x7fdcac19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.675+0000 7fdca3e00640 1 -- 172.21.15.40:0/188043972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac19f420 con 0x7fdcac1047e0 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.676+0000 7fdca3e00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcac1047e0 0x7fdcac19a9b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc9402a920 tx=0x7fdc94003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.676+0000 7fdca8c00640 1 -- 172.21.15.40:0/188043972 <== mon.2 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9403f070 con 0x7fdcac1047e0 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.676+0000 7fdca8c00640 1 -- 172.21.15.40:0/188043972 <== mon.2 v2:172.21.15.146:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc94031c90 con 0x7fdcac1047e0 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.676+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcac19f6b0 con 0x7fdcac1047e0 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.676+0000 7fdca8c00640 1 -- 172.21.15.40:0/188043972 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94035030 con 0x7fdcac1047e0 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.676+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcac1a6ff0 con 0x7fdcac1047e0 2024-09-11T22:40:24.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.677+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcac105310 con 0x7fdcac1047e0 2024-09-11T22:40:24.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.679+0000 7fdca8c00640 1 -- 172.21.15.40:0/188043972 <== mon.2 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdc94042070 con 0x7fdcac1047e0 2024-09-11T22:40:24.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.680+0000 7fdca8c00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdc900a2c00 0x7fdc900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:24.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.680+0000 7fdca8c00640 1 -- 172.21.15.40:0/188043972 <== mon.2 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7fdc940efc90 con 0x7fdcac1047e0 2024-09-11T22:40:24.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.681+0000 7fdcab400640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdc900a2c00 0x7fdc900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:24.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.681+0000 7fdcab400640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdc900a2c00 0x7fdc900a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009c90 tx=0x7fdc9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:24.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.684+0000 7fdca8c00640 1 -- 172.21.15.40:0/188043972 <== mon.2 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc940bc1b0 con 0x7fdcac1047e0 2024-09-11T22:40:24.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:24 smithi146 ceph-mon[34996]: pgmap v669: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:40:24.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.905+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcac19b7d0 con 0x7fdcac1047e0 2024-09-11T22:40:24.906 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:24 smithi040 ceph-mon[30787]: pgmap v669: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:40:24.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.906+0000 7fdca8c00640 1 -- 172.21.15.40:0/188043972 <== mon.2 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11929 (secure 0 0 0) 0x7fdc940c04b0 con 0x7fdcac1047e0 2024-09-11T22:40:24.907 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:40:24.908 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":34,"btime":"2024-09-11T22:39:43:553604+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/756098246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":756098246},{"type":"v1","addr":"172.21.15.40:6835","nonce":756098246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/2129624525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":2129624525},{"type":"v1","addr":"172.21.15.40:6837","nonce":2129624525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/3846797192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":3846797192},{"type":"v1","addr":"172.21.15.40:6839","nonce":3846797192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6841/3832269180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6840","nonce":3832269180},{"type":"v1","addr":"172.21.15.40:6841","nonce":3832269180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3511870643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3511870643},{"type":"v1","addr":"172.21.15.146:6833","nonce":3511870643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24445,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2871952691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2871952691},{"type":"v1","addr":"172.21.15.177:6833","nonce":2871952691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T22:28:22.255886+0000","modified":"2024-09-11T22:39:43.030239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24517,"mds_2":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24464":{"gid":24464,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6835/2793379680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2793379680},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793379680}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6837/321001142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":321001142},{"type":"v1","addr":"172.21.15.146:6837","nonce":321001142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.177:6835/2874658115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2874658115},{"type":"v1","addr":"172.21.15.177:6835","nonce":2874658115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.177:6837/1976954611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6836","nonce":1976954611},{"type":"v1","addr":"172.21.15.177:6837","nonce":1976954611}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.177:6839/2764150178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6838","nonce":2764150178},{"type":"v1","addr":"172.21.15.177:6839","nonce":2764150178}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.146:6839/2365077357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6838","nonce":2365077357},{"type":"v1","addr":"172.21.15.146:6839","nonce":2365077357}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24527,24517,24499]},"id":1}]} 2024-09-11T22:40:24.908 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 34 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdc900a2c00 msgr2=0x7fdc900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdc900a2c00 0x7fdc900a50c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009c90 tx=0x7fdc9c005f90 comp rx=0 tx=0).stop 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcac1047e0 msgr2=0x7fdcac19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcac1047e0 0x7fdcac19a9b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc9402a920 tx=0x7fdc94003b20 comp rx=0 tx=0).stop 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 shutdown_connections 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fdc900a2c00 0x7fdc900a50c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcac108f60 0x7fdcac19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcac1047e0 0x7fdcac19a9b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 --2- 172.21.15.40:0/188043972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcac103e30 0x7fdcac19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:24.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 >> 172.21.15.40:0/188043972 conn(0x7fdcac0ff8d0 msgr2=0x7fdcac100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:24.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 shutdown_connections 2024-09-11T22:40:24.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:24.909+0000 7fdcb0e00640 1 -- 172.21.15.40:0/188043972 wait complete. 2024-09-11T22:40:25.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:24 smithi177 ceph-mon[35530]: pgmap v669: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:40:25.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T22:40:25.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:25 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/188043972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:40:25.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:25 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:40:25.903 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:25 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/188043972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:40:25.903 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:25 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:40:25.984 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:25 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/188043972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T22:40:25.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:25 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T22:40:26.041 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.580+0000 7f99ccc00640 1 -- 172.21.15.40:0/688968092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c8076720 msgr2=0x7f99c8076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.580+0000 7f99ccc00640 1 --2- 172.21.15.40:0/688968092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c8076720 0x7f99c8076b00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009900 tx=0x7f99b802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.581+0000 7f99ccc00640 1 -- 172.21.15.40:0/688968092 shutdown_connections 2024-09-11T22:40:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.581+0000 7f99ccc00640 1 --2- 172.21.15.40:0/688968092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99c8112a30 0x7f99c8114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.581+0000 7f99ccc00640 1 --2- 172.21.15.40:0/688968092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c8077040 0x7f99c81124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.581+0000 7f99ccc00640 1 --2- 172.21.15.40:0/688968092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c8076720 0x7f99c8076b00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.581+0000 7f99ccc00640 1 -- 172.21.15.40:0/688968092 >> 172.21.15.40:0/688968092 conn(0x7f99c80ffa90 msgr2=0x7f99c8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.581+0000 7f99ccc00640 1 -- 172.21.15.40:0/688968092 shutdown_connections 2024-09-11T22:40:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.581+0000 7f99ccc00640 1 -- 172.21.15.40:0/688968092 wait complete. 2024-09-11T22:40:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.581+0000 7f99ccc00640 1 Processor -- start 2024-09-11T22:40:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99ccc00640 1 -- start start 2024-09-11T22:40:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99ccc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c8076720 0x7f99c81a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99ccc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c8077040 0x7f99c81a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99ccc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99c8112a30 0x7f99c819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99ccc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81185c0 con 0x7f99c8112a30 2024-09-11T22:40:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99ccc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8118440 con 0x7f99c8077040 2024-09-11T22:40:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99ccc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99c8118740 con 0x7f99c8076720 2024-09-11T22:40:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99c5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c8076720 0x7f99c81a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99bfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c8077040 0x7f99c81a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99c5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c8076720 0x7f99c81a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:40538/0 (socket says 172.21.15.40:40538) 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99c5e00640 1 -- 172.21.15.40:0/1297349336 learned_addr learned my addr 172.21.15.40:0/1297349336 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.582+0000 7f99c6800640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99c8112a30 0x7f99c819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99c5e00640 1 -- 172.21.15.40:0/1297349336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c8077040 msgr2=0x7f99c81a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99c5e00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c8077040 0x7f99c81a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99c5e00640 1 -- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99c8112a30 msgr2=0x7f99c819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99c5e00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99c8112a30 0x7f99c819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99c5e00640 1 -- 172.21.15.40:0/1297349336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c819efc0 con 0x7f99c8076720 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99c5e00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c8076720 0x7f99c81a46d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99b8006010 tx=0x7f99b8004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99bea00640 1 -- 172.21.15.40:0/1297349336 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b803f030 con 0x7f99c8076720 2024-09-11T22:40:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99bea00640 1 -- 172.21.15.40:0/1297349336 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b8004440 con 0x7f99c8076720 2024-09-11T22:40:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c819f250 con 0x7f99c8076720 2024-09-11T22:40:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.583+0000 7f99bea00640 1 -- 172.21.15.40:0/1297349336 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8035070 con 0x7f99c8076720 2024-09-11T22:40:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.584+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c81ab5a0 con 0x7f99c8076720 2024-09-11T22:40:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.585+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c8076b00 con 0x7f99c8076720 2024-09-11T22:40:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.587+0000 7f99bea00640 1 -- 172.21.15.40:0/1297349336 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f99b8042030 con 0x7f99c8076720 2024-09-11T22:40:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.589+0000 7f99bea00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f99ac0a2c00 0x7f99ac0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.589+0000 7f99bea00640 1 -- 172.21.15.40:0/1297349336 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f99b80ef860 con 0x7f99c8076720 2024-09-11T22:40:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.589+0000 7f99bfe00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f99ac0a2c00 0x7f99ac0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:26.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.589+0000 7f99bfe00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f99ac0a2c00 0x7f99ac0a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f99c8079300 tx=0x7f99b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:26.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.594+0000 7f99bea00640 1 -- 172.21.15.40:0/1297349336 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f99b80bc3d0 con 0x7f99c8076720 2024-09-11T22:40:26.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:26 smithi040 ceph-mon[30787]: pgmap v670: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T22:40:26.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.781+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99c81ab7d0 con 0x7f99c8076720 2024-09-11T22:40:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.784+0000 7f99bea00640 1 -- 172.21.15.40:0/1297349336 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24848 (secure 0 0 0) 0x7f99b80bbcd0 con 0x7f99c8076720 2024-09-11T22:40:26.785 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-11T22:40:26.786 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":95,"fsid":"c836ee3e-708b-11ef-bcea-c7b262605968","created":"2024-09-11T22:20:05.625066+0000","modified":"2024-09-11T22:29:59.079781+0000","last_up_change":"2024-09-11T22:27:21.381946+0000","last_in_change":"2024-09-11T22:26:57.615660+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:23:19.500985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:28:17.106068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:28:20.087828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:28:28.693002+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"82d9fecb-4353-4e63-991f-ef618ea5ae21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6803","nonce":3907265678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6805","nonce":3907265678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6809","nonce":3907265678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3907265678},{"type":"v1","addr":"172.21.15.40:6807","nonce":3907265678}]},"public_addr":"172.21.15.40:6803/3907265678","cluster_addr":"172.21.15.40:6805/3907265678","heartbeat_back_addr":"172.21.15.40:6809/3907265678","heartbeat_front_addr":"172.21.15.40:6807/3907265678","state":["exists","up"]},{"osd":1,"uuid":"7b36cbf5-f4e4-462a-bbb9-81d2853f01bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6801","nonce":2916155681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6803","nonce":2916155681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6807","nonce":2916155681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":2916155681},{"type":"v1","addr":"172.21.15.146:6805","nonce":2916155681}]},"public_addr":"172.21.15.146:6801/2916155681","cluster_addr":"172.21.15.146:6803/2916155681","heartbeat_back_addr":"172.21.15.146:6807/2916155681","heartbeat_front_addr":"172.21.15.146:6805/2916155681","state":["exists","up"]},{"osd":2,"uuid":"58cf9867-bceb-454d-9fce-95755e4ab2fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6801","nonce":3950599839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6803","nonce":3950599839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6807","nonce":3950599839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3950599839},{"type":"v1","addr":"172.21.15.177:6805","nonce":3950599839}]},"public_addr":"172.21.15.177:6801/3950599839","cluster_addr":"172.21.15.177:6803/3950599839","heartbeat_back_addr":"172.21.15.177:6807/3950599839","heartbeat_front_addr":"172.21.15.177:6805/3950599839","state":["exists","up"]},{"osd":3,"uuid":"194a6e6d-dc39-44b3-9e96-2b0420de5f53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6811","nonce":3405850528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6813","nonce":3405850528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6817","nonce":3405850528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3405850528},{"type":"v1","addr":"172.21.15.40:6815","nonce":3405850528}]},"public_addr":"172.21.15.40:6811/3405850528","cluster_addr":"172.21.15.40:6813/3405850528","heartbeat_back_addr":"172.21.15.40:6817/3405850528","heartbeat_front_addr":"172.21.15.40:6815/3405850528","state":["exists","up"]},{"osd":4,"uuid":"6b8f7992-9ad7-4a0c-82eb-5e56257c79d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6809","nonce":1955239185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6811","nonce":1955239185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6815","nonce":1955239185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":1955239185},{"type":"v1","addr":"172.21.15.146:6813","nonce":1955239185}]},"public_addr":"172.21.15.146:6809/1955239185","cluster_addr":"172.21.15.146:6811/1955239185","heartbeat_back_addr":"172.21.15.146:6815/1955239185","heartbeat_front_addr":"172.21.15.146:6813/1955239185","state":["exists","up"]},{"osd":5,"uuid":"30dda4ee-fb76-4fc6-accf-c8e15cef504b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6809","nonce":4157148249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6811","nonce":4157148249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6815","nonce":4157148249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":4157148249},{"type":"v1","addr":"172.21.15.177:6813","nonce":4157148249}]},"public_addr":"172.21.15.177:6809/4157148249","cluster_addr":"172.21.15.177:6811/4157148249","heartbeat_back_addr":"172.21.15.177:6815/4157148249","heartbeat_front_addr":"172.21.15.177:6813/4157148249","state":["exists","up"]},{"osd":6,"uuid":"e2f90ba7-c6f0-4dab-be23-4ee01254e8e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6819","nonce":3328210363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6821","nonce":3328210363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6825","nonce":3328210363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3328210363},{"type":"v1","addr":"172.21.15.40:6823","nonce":3328210363}]},"public_addr":"172.21.15.40:6819/3328210363","cluster_addr":"172.21.15.40:6821/3328210363","heartbeat_back_addr":"172.21.15.40:6825/3328210363","heartbeat_front_addr":"172.21.15.40:6823/3328210363","state":["exists","up"]},{"osd":7,"uuid":"aa3c1448-5e50-42c5-8ec9-d4415f3612e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6817","nonce":3017121713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6819","nonce":3017121713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6823","nonce":3017121713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":3017121713},{"type":"v1","addr":"172.21.15.146:6821","nonce":3017121713}]},"public_addr":"172.21.15.146:6817/3017121713","cluster_addr":"172.21.15.146:6819/3017121713","heartbeat_back_addr":"172.21.15.146:6823/3017121713","heartbeat_front_addr":"172.21.15.146:6821/3017121713","state":["exists","up"]},{"osd":8,"uuid":"d4f387bb-f93a-4e1e-b1f5-e31f63d1f9c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6817","nonce":323204474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6819","nonce":323204474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6823","nonce":323204474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":323204474},{"type":"v1","addr":"172.21.15.177:6821","nonce":323204474}]},"public_addr":"172.21.15.177:6817/323204474","cluster_addr":"172.21.15.177:6819/323204474","heartbeat_back_addr":"172.21.15.177:6823/323204474","heartbeat_front_addr":"172.21.15.177:6821/323204474","state":["exists","up"]},{"osd":9,"uuid":"afd5d9ce-baf0-4331-b5f2-5803295060c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6827","nonce":4209555544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6829","nonce":4209555544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6833","nonce":4209555544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4209555544},{"type":"v1","addr":"172.21.15.40:6831","nonce":4209555544}]},"public_addr":"172.21.15.40:6827/4209555544","cluster_addr":"172.21.15.40:6829/4209555544","heartbeat_back_addr":"172.21.15.40:6833/4209555544","heartbeat_front_addr":"172.21.15.40:6831/4209555544","state":["exists","up"]},{"osd":10,"uuid":"7de50dd1-146c-445f-8825-345170538fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6825","nonce":3331275182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6827","nonce":3331275182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6831","nonce":3331275182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":3331275182},{"type":"v1","addr":"172.21.15.146:6829","nonce":3331275182}]},"public_addr":"172.21.15.146:6825/3331275182","cluster_addr":"172.21.15.146:6827/3331275182","heartbeat_back_addr":"172.21.15.146:6831/3331275182","heartbeat_front_addr":"172.21.15.146:6829/3331275182","state":["exists","up"]},{"osd":11,"uuid":"bd819162-017f-4323-b587-1ed164135d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6825","nonce":153711058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6827","nonce":153711058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6831","nonce":153711058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":153711058},{"type":"v1","addr":"172.21.15.177:6829","nonce":153711058}]},"public_addr":"172.21.15.177:6825/153711058","cluster_addr":"172.21.15.177:6827/153711058","heartbeat_back_addr":"172.21.15.177:6831/153711058","heartbeat_front_addr":"172.21.15.177:6829/153711058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:23.494678+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:22:49.823284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:14.731212+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:23:42.618953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:09.734878+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:24:35.306941+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:05.516519+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:32.000942+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:25:57.622174+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:27.018251+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:26:54.337317+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:27:19.545612+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6},{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3768094180":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2421714119":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/3054635908":"2024-09-12T22:20:56.889250+0000","172.21.15.40:6801/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2148182783":"2024-09-12T22:20:29.708392+0000","172.21.15.40:0/3034121439":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6801/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2370914626":"2024-09-12T22:20:29.708392+0000","172.21.15.40:6800/2835470410":"2024-09-12T22:20:56.889250+0000","172.21.15.40:0/2543187724":"2024-09-12T22:20:29.708392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:40:26.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f99ac0a2c00 msgr2=0x7f99ac0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:26.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f99ac0a2c00 0x7f99ac0a50c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f99c8079300 tx=0x7f99b0005f90 comp rx=0 tx=0).stop 2024-09-11T22:40:26.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c8076720 msgr2=0x7f99c81a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:26.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c8076720 0x7f99c81a46d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99b8006010 tx=0x7f99b8004040 comp rx=0 tx=0).stop 2024-09-11T22:40:26.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 shutdown_connections 2024-09-11T22:40:26.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f99ac0a2c00 0x7f99ac0a50c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99c8112a30 0x7f99c819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c8077040 0x7f99c81a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 --2- 172.21.15.40:0/1297349336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f99c8076720 0x7f99c81a46d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:26.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 >> 172.21.15.40:0/1297349336 conn(0x7f99c80ffa90 msgr2=0x7f99c8101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:26.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 shutdown_connections 2024-09-11T22:40:26.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:26.787+0000 7f99ccc00640 1 -- 172.21.15.40:0/1297349336 wait complete. 2024-09-11T22:40:26.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:26 smithi146 ceph-mon[34996]: pgmap v670: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T22:40:27.032 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:26 smithi177 ceph-mon[35530]: pgmap v670: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-11T22:40:27.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-11T22:40:27.770 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:27.770 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:27.770 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:27.770 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:27 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1297349336' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:40:27.770 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:27.770 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:40:27.770 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:40:27.770 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:27 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:27.770 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:27 smithi177 ceph-mon[35530]: pgmap v671: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:40:27.902 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:27 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1297349336' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:27 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.041 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:27 smithi040 ceph-mon[30787]: pgmap v671: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:40:28.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:27 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1297349336' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T22:40:28.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.084 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T22:40:28.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T22:40:28.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:27 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' 2024-09-11T22:40:28.085 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:27 smithi146 ceph-mon[34996]: pgmap v671: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T22:40:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.456+0000 7f4558400640 1 -- 172.21.15.40:0/3944183787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4550109140 msgr2=0x7f4550110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.456+0000 7f4558400640 1 --2- 172.21.15.40:0/3944183787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4550109140 0x7f4550110cc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4548009ca0 tx=0x7f454802a8c0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.456+0000 7f4558400640 1 -- 172.21.15.40:0/3944183787 shutdown_connections 2024-09-11T22:40:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.456+0000 7f4558400640 1 --2- 172.21.15.40:0/3944183787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4550109140 0x7f4550110cc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.456+0000 7f4558400640 1 --2- 172.21.15.40:0/3944183787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45501049c0 0x7f4550108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.456+0000 7f4558400640 1 --2- 172.21.15.40:0/3944183787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4550104010 0x7f45501043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.456+0000 7f4558400640 1 -- 172.21.15.40:0/3944183787 >> 172.21.15.40:0/3944183787 conn(0x7f45500ffa50 msgr2=0x7f4550101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.457+0000 7f4558400640 1 -- 172.21.15.40:0/3944183787 shutdown_connections 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.457+0000 7f4558400640 1 -- 172.21.15.40:0/3944183787 wait complete. 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4558400640 1 Processor -- start 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4558400640 1 -- start start 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4558400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4550104010 0x7f455019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4558400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45501049c0 0x7f455019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4558400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4550109140 0x7f455019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4558400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4550114150 con 0x7f45501049c0 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4558400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4550113fd0 con 0x7f4550104010 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4558400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f45501142d0 con 0x7f4550109140 2024-09-11T22:40:28.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4555000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45501049c0 0x7f455019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.458+0000 7f4555000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45501049c0 0x7f455019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52606/0 (socket says 172.21.15.40:52606) 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f4555000640 1 -- 172.21.15.40:0/1945073313 learned_addr learned my addr 172.21.15.40:0/1945073313 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f4555a00640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4550104010 0x7f455019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f4556400640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4550109140 0x7f455019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f4555000640 1 -- 172.21.15.40:0/1945073313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4550109140 msgr2=0x7f455019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f4555000640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4550109140 0x7f455019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f4555000640 1 -- 172.21.15.40:0/1945073313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4550104010 msgr2=0x7f455019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f4555000640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4550104010 0x7f455019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f4555000640 1 -- 172.21.15.40:0/1945073313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455019f620 con 0x7f45501049c0 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f4555000640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45501049c0 0x7f455019abb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f453c00e9f0 tx=0x7f453c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.459+0000 7f454e000640 1 -- 172.21.15.40:0/1945073313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c00cd80 con 0x7f45501049c0 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.460+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455019f910 con 0x7f45501049c0 2024-09-11T22:40:28.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.460+0000 7f454e000640 1 -- 172.21.15.40:0/1945073313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f453c010910 con 0x7f45501049c0 2024-09-11T22:40:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.460+0000 7f454e000640 1 -- 172.21.15.40:0/1945073313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c0188f0 con 0x7f45501049c0 2024-09-11T22:40:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.460+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45501a71f0 con 0x7f45501049c0 2024-09-11T22:40:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.461+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45501043f0 con 0x7f45501049c0 2024-09-11T22:40:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.463+0000 7f454e000640 1 -- 172.21.15.40:0/1945073313 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f453c010ac0 con 0x7f45501049c0 2024-09-11T22:40:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.464+0000 7f454e000640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f45380a2b80 0x7f45380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.464+0000 7f454e000640 1 -- 172.21.15.40:0/1945073313 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9137+0+0 (secure 0 0 0) 0x7f453c0cf740 con 0x7f45501049c0 2024-09-11T22:40:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.464+0000 7f4555a00640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f45380a2b80 0x7f45380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.465+0000 7f4555a00640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f45380a2b80 0x7f45380a5040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4544009bd0 tx=0x7f4544005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:28.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.468+0000 7f454e000640 1 -- 172.21.15.40:0/1945073313 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f453c09bc60 con 0x7f45501049c0 2024-09-11T22:40:28.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.687+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f455010c3e0 con 0x7f45501049c0 2024-09-11T22:40:28.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.706+0000 7f454e000640 1 -- 172.21.15.40:0/1945073313 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f453c09ff60 con 0x7f45501049c0 2024-09-11T22:40:28.707 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:40:28.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f45380a2b80 msgr2=0x7f45380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f45380a2b80 0x7f45380a5040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4544009bd0 tx=0x7f4544005f90 comp rx=0 tx=0).stop 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45501049c0 msgr2=0x7f455019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45501049c0 0x7f455019abb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f453c00e9f0 tx=0x7f453c00eeb0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 shutdown_connections 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f45380a2b80 0x7f45380a5040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4550109140 0x7f455019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45501049c0 0x7f455019abb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 --2- 172.21.15.40:0/1945073313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4550104010 0x7f455019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.708+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 >> 172.21.15.40:0/1945073313 conn(0x7f45500ffa50 msgr2=0x7f4550100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.709+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 shutdown_connections 2024-09-11T22:40:28.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:28.709+0000 7f4558400640 1 -- 172.21.15.40:0/1945073313 wait complete. 2024-09-11T22:40:28.985 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a[30783]: 2024-09-11T22:40:28.704+0000 7f3190200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:40:29.032 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c[65070]: ignoring --setuser ceph since I am not root 2024-09-11T22:40:29.033 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c[65070]: ignoring --setgroup ceph since I am not root 2024-09-11T22:40:29.033 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c[65070]: starting mds.c at 2024-09-11T22:40:29.033 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f[64770]: ignoring --setuser ceph since I am not root 2024-09-11T22:40:29.033 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f[64770]: ignoring --setgroup ceph since I am not root 2024-09-11T22:40:29.033 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-mds[64774]: -- 172.21.15.177:0/2046448921 <== mon.2 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606e1978680 con 0x5606e194d000 2024-09-11T22:40:29.033 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-mds[64774]: -- 172.21.15.177:0/2046448921 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5606e196f860 con 0x5606e194d000 2024-09-11T22:40:29.033 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f[64770]: starting mds.f at 2024-09-11T22:40:29.034 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i[65372]: ignoring --setuser ceph since I am not root 2024-09-11T22:40:29.034 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i[65372]: ignoring --setgroup ceph since I am not root 2024-09-11T22:40:29.034 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-mds[65376]: -- 172.21.15.177:0/2302258566 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a039171860 con 0x55a03914f000 2024-09-11T22:40:29.034 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:40:28 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i[65372]: starting mds.i at 2024-09-11T22:40:29.084 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b[65343]: ignoring --setuser ceph since I am not root 2024-09-11T22:40:29.084 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b[65343]: ignoring --setgroup ceph since I am not root 2024-09-11T22:40:29.085 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-mds[65347]: -- 172.21.15.146:0/1589139025 <== mon.2 v2:172.21.15.146:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b86e1b860 con 0x560b86df9000 2024-09-11T22:40:29.085 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b[65343]: starting mds.b at 2024-09-11T22:40:29.085 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e[64727]: ignoring --setuser ceph since I am not root 2024-09-11T22:40:29.085 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e[64727]: ignoring --setgroup ceph since I am not root 2024-09-11T22:40:29.085 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-mds[64731]: -- 172.21.15.146:0/3695924502 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f37ee1860 con 0x557f37ebf400 2024-09-11T22:40:29.085 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e[64727]: starting mds.e at 2024-09-11T22:40:29.085 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e[64727]: 2024-09-11T22:40:28.788+0000 7f65028ae640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-11T22:40:29.086 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h[65039]: ignoring --setuser ceph since I am not root 2024-09-11T22:40:29.086 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h[65039]: ignoring --setgroup ceph since I am not root 2024-09-11T22:40:29.086 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-mds[65043]: -- 172.21.15.146:0/2413510954 <== mon.1 v2:172.21.15.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564862905860 con 0x5648628e3000 2024-09-11T22:40:29.086 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:40:28 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h[65039]: starting mds.h at 2024-09-11T22:40:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:29 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1945073313' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T22:40:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:29 smithi040 ceph-mon[30787]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T22:40:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:29 smithi040 ceph-mon[30787]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:40:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:29 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1945073313' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T22:40:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:29 smithi040 ceph-mon[30787]: osdmap e96: 12 total, 12 up, 12 in 2024-09-11T22:40:29.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:29 smithi040 ceph-mon[30787]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T22:40:29.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:40:29.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:29 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1945073313' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T22:40:29.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:29 smithi177 ceph-mon[35530]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T22:40:29.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:29 smithi177 ceph-mon[35530]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:40:29.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:29 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1945073313' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T22:40:29.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:29 smithi177 ceph-mon[35530]: osdmap e96: 12 total, 12 up, 12 in 2024-09-11T22:40:29.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:29 smithi177 ceph-mon[35530]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T22:40:29.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:29 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1945073313' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-11T22:40:29.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:29 smithi146 ceph-mon[34996]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T22:40:29.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:29 smithi146 ceph-mon[34996]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T22:40:29.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:29 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1945073313' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T22:40:29.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:29 smithi146 ceph-mon[34996]: osdmap e96: 12 total, 12 up, 12 in 2024-09-11T22:40:29.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:29 smithi146 ceph-mon[34996]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T22:40:29.912 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:30.397 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: pgmap v673: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-11T22:40:30.397 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.177:6834/1645508613,v1:172.21.15.177:6837/1645508613] up:boot 2024-09-11T22:40:30.397 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.177:6836/2041801224,v1:172.21.15.177:6839/2041801224] up:boot 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.177:6835/2479862531,v1:172.21.15.177:6838/2479862531] up:boot 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.146:6836/1735484394,v1:172.21.15.146:6839/1735484394] up:boot 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.146:6834/1469592183,v1:172.21.15.146:6837/1469592183] up:boot 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: mds.? [v2:172.21.15.146:6835/3096183398,v1:172.21.15.146:6838/3096183398] up:boot 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:40:30.398 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:30 smithi040 ceph-mon[30787]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:40:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.508+0000 7fcdc0000640 1 -- 172.21.15.40:0/2385492435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8109120 msgr2=0x7fcdb8110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.508+0000 7fcdc0000640 1 --2- 172.21.15.40:0/2385492435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8109120 0x7fcdb8110ca0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009900 tx=0x7fcdb002a410 comp rx=0 tx=0).stop 2024-09-11T22:40:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.508+0000 7fcdc0000640 1 -- 172.21.15.40:0/2385492435 shutdown_connections 2024-09-11T22:40:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.508+0000 7fcdc0000640 1 --2- 172.21.15.40:0/2385492435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8109120 0x7fcdb8110ca0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.508+0000 7fcdc0000640 1 --2- 172.21.15.40:0/2385492435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdb81049a0 0x7fcdb81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.508+0000 7fcdc0000640 1 --2- 172.21.15.40:0/2385492435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdb8103ff0 0x7fcdb81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.508+0000 7fcdc0000640 1 -- 172.21.15.40:0/2385492435 >> 172.21.15.40:0/2385492435 conn(0x7fcdb80ffa90 msgr2=0x7fcdb8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.508+0000 7fcdc0000640 1 -- 172.21.15.40:0/2385492435 shutdown_connections 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.508+0000 7fcdc0000640 1 -- 172.21.15.40:0/2385492435 wait complete. 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.509+0000 7fcdc0000640 1 Processor -- start 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.509+0000 7fcdc0000640 1 -- start start 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdc0000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdb8103ff0 0x7fcdb819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdc0000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdb81049a0 0x7fcdb819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdc0000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8109120 0x7fcdb819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdc0000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb8114150 con 0x7fcdb8109120 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdc0000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb8113fd0 con 0x7fcdb8103ff0 2024-09-11T22:40:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdc0000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb81142d0 con 0x7fcdb81049a0 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdbe000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8109120 0x7fcdb819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdbcc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdb81049a0 0x7fcdb819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdbcc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdb81049a0 0x7fcdb819ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.40:40586/0 (socket says 172.21.15.40:40586) 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdbcc00640 1 -- 172.21.15.40:0/1449923819 learned_addr learned my addr 172.21.15.40:0/1449923819 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdbe000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8109120 0x7fcdb819ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52618/0 (socket says 172.21.15.40:52618) 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.510+0000 7fcdbd600640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdb8103ff0 0x7fcdb819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdbcc00640 1 -- 172.21.15.40:0/1449923819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdb8103ff0 msgr2=0x7fcdb819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdbcc00640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdb8103ff0 0x7fcdb819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdbcc00640 1 -- 172.21.15.40:0/1449923819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8109120 msgr2=0x7fcdb819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdbcc00640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8109120 0x7fcdb819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdbcc00640 1 -- 172.21.15.40:0/1449923819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb819f5e0 con 0x7fcdb81049a0 2024-09-11T22:40:30.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdbcc00640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdb81049a0 0x7fcdb819ab70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e9f0 tx=0x7fcda400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:30.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdb6000640 1 -- 172.21.15.40:0/1449923819 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda400cd80 con 0x7fcdb81049a0 2024-09-11T22:40:30.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb819f8d0 con 0x7fcdb81049a0 2024-09-11T22:40:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdb6000640 1 -- 172.21.15.40:0/1449923819 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcda4010910 con 0x7fcdb81049a0 2024-09-11T22:40:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdb6000640 1 -- 172.21.15.40:0/1449923819 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda40188f0 con 0x7fcdb81049a0 2024-09-11T22:40:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.511+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb81a71b0 con 0x7fcdb81049a0 2024-09-11T22:40:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.512+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb81043d0 con 0x7fcdb81049a0 2024-09-11T22:40:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.514+0000 7fcdb6000640 1 -- 172.21.15.40:0/1449923819 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fcda4010ac0 con 0x7fcdb81049a0 2024-09-11T22:40:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.516+0000 7fcdb6000640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcda00a2c00 0x7fcda00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.516+0000 7fcdb6000640 1 -- 172.21.15.40:0/1449923819 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9395+0+0 (secure 0 0 0) 0x7fcda40cfd20 con 0x7fcdb81049a0 2024-09-11T22:40:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.516+0000 7fcdbd600640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcda00a2c00 0x7fcda00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.517+0000 7fcdbd600640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcda00a2c00 0x7fcda00a50c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcdac005fd0 tx=0x7fcdac009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.518+0000 7fcdb6000640 1 -- 172.21.15.40:0/1449923819 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcda409c140 con 0x7fcdb81049a0 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: pgmap v673: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.177:6834/1645508613,v1:172.21.15.177:6837/1645508613] up:boot 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.177:6836/2041801224,v1:172.21.15.177:6839/2041801224] up:boot 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.177:6835/2479862531,v1:172.21.15.177:6838/2479862531] up:boot 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.146:6836/1735484394,v1:172.21.15.146:6839/1735484394] up:boot 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.146:6834/1469592183,v1:172.21.15.146:6837/1469592183] up:boot 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: mds.? [v2:172.21.15.146:6835/3096183398,v1:172.21.15.146:6838/3096183398] up:boot 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:40:30.538 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:40:30.539 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:40:30.539 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:40:30.539 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:30 smithi177 ceph-mon[35530]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:40:30.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: pgmap v673: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-11T22:40:30.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.177:6834/1645508613,v1:172.21.15.177:6837/1645508613] up:boot 2024-09-11T22:40:30.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.177:6836/2041801224,v1:172.21.15.177:6839/2041801224] up:boot 2024-09-11T22:40:30.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.177:6835/2479862531,v1:172.21.15.177:6838/2479862531] up:boot 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.146:6836/1735484394,v1:172.21.15.146:6839/1735484394] up:boot 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.146:6834/1469592183,v1:172.21.15.146:6837/1469592183] up:boot 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: mds.? [v2:172.21.15.146:6835/3096183398,v1:172.21.15.146:6838/3096183398] up:boot 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T22:40:30.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:30 smithi146 ceph-mon[34996]: from='mgr.14150 172.21.15.40:0/3896259093' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T22:40:30.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:30.741+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcdb81a7410 con 0x7fcdb81049a0 2024-09-11T22:40:31.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.187+0000 7fcdb6000640 1 -- 172.21.15.40:0/1449923819 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7fcda40a0440 con 0x7fcdb81049a0 2024-09-11T22:40:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcda00a2c00 msgr2=0x7fcda00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcda00a2c00 0x7fcda00a50c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcdac005fd0 tx=0x7fcdac009500 comp rx=0 tx=0).stop 2024-09-11T22:40:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdb81049a0 msgr2=0x7fcdb819ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdb81049a0 0x7fcdb819ab70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e9f0 tx=0x7fcda400eeb0 comp rx=0 tx=0).stop 2024-09-11T22:40:31.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 shutdown_connections 2024-09-11T22:40:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fcda00a2c00 0x7fcda00a50c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdb8109120 0x7fcdb819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcdb81049a0 0x7fcdb819ab70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 --2- 172.21.15.40:0/1449923819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdb8103ff0 0x7fcdb819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.189+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 >> 172.21.15.40:0/1449923819 conn(0x7fcdb80ffa90 msgr2=0x7fcdb81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.190+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 shutdown_connections 2024-09-11T22:40:31.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:31.190+0000 7fcdc0000640 1 -- 172.21.15.40:0/1449923819 wait complete. 2024-09-11T22:40:31.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:31 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/1449923819' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:40:31.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:31 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:40:31.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:31 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/1449923819' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:40:31.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:31 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:40:31.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:31 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/1449923819' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:40:31.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:31 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T22:40:31.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:40:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:32 smithi040 ceph-mon[30787]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T22:40:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:32 smithi040 ceph-mon[30787]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T22:40:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:32 smithi040 ceph-mon[30787]: Cluster is now healthy 2024-09-11T22:40:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:32 smithi040 ceph-mon[30787]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:40:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:32 smithi040 ceph-mon[30787]: fsmap 12 up:standby 2024-09-11T22:40:32.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:32 smithi040 ceph-mon[30787]: pgmap v674: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 6 op/s 2024-09-11T22:40:32.352 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:32.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:32 smithi177 ceph-mon[35530]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T22:40:32.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:32 smithi177 ceph-mon[35530]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T22:40:32.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:32 smithi177 ceph-mon[35530]: Cluster is now healthy 2024-09-11T22:40:32.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:32 smithi177 ceph-mon[35530]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:40:32.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:32 smithi177 ceph-mon[35530]: fsmap 12 up:standby 2024-09-11T22:40:32.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:32 smithi177 ceph-mon[35530]: pgmap v674: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 6 op/s 2024-09-11T22:40:32.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:32 smithi146 ceph-mon[34996]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T22:40:32.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:32 smithi146 ceph-mon[34996]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T22:40:32.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:32 smithi146 ceph-mon[34996]: Cluster is now healthy 2024-09-11T22:40:32.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:32 smithi146 ceph-mon[34996]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T22:40:32.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:32 smithi146 ceph-mon[34996]: fsmap 12 up:standby 2024-09-11T22:40:32.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:32 smithi146 ceph-mon[34996]: pgmap v674: 129 pgs: 129 active+clean; 33 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 614 B/s wr, 6 op/s 2024-09-11T22:40:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.895+0000 7fa1fd400640 1 -- 172.21.15.40:0/3671732710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f81049a0 msgr2=0x7fa1f81089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.895+0000 7fa1fd400640 1 --2- 172.21.15.40:0/3671732710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f81049a0 0x7fa1f81089f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009900 tx=0x7fa1e002a3f0 comp rx=0 tx=0).stop 2024-09-11T22:40:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.895+0000 7fa1fd400640 1 -- 172.21.15.40:0/3671732710 shutdown_connections 2024-09-11T22:40:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.895+0000 7fa1fd400640 1 --2- 172.21.15.40:0/3671732710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f8109120 0x7fa1f8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.895+0000 7fa1fd400640 1 --2- 172.21.15.40:0/3671732710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f81049a0 0x7fa1f81089f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.895+0000 7fa1fd400640 1 --2- 172.21.15.40:0/3671732710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f8103ff0 0x7fa1f81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.895+0000 7fa1fd400640 1 -- 172.21.15.40:0/3671732710 >> 172.21.15.40:0/3671732710 conn(0x7fa1f80ffa90 msgr2=0x7fa1f8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.895+0000 7fa1fd400640 1 -- 172.21.15.40:0/3671732710 shutdown_connections 2024-09-11T22:40:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.895+0000 7fa1fd400640 1 -- 172.21.15.40:0/3671732710 wait complete. 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.896+0000 7fa1fd400640 1 Processor -- start 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.896+0000 7fa1fd400640 1 -- start start 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.896+0000 7fa1fd400640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f8103ff0 0x7fa1f819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.896+0000 7fa1fd400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f81049a0 0x7fa1f819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1fd400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f8109120 0x7fa1f819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1fd400640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f8114140 con 0x7fa1f8103ff0 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1fd400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f8113fc0 con 0x7fa1f8109120 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1fd400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81142c0 con 0x7fa1f81049a0 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1f6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f8103ff0 0x7fa1f819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1efe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f81049a0 0x7fa1f819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1f6800640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f8103ff0 0x7fa1f819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33054/0 (socket says 172.21.15.40:33054) 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1f6800640 1 -- 172.21.15.40:0/2237536138 learned_addr learned my addr 172.21.15.40:0/2237536138 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1f7200640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f8109120 0x7fa1f819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1f6800640 1 -- 172.21.15.40:0/2237536138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f81049a0 msgr2=0x7fa1f819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1f6800640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f81049a0 0x7fa1f819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1f6800640 1 -- 172.21.15.40:0/2237536138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f8109120 msgr2=0x7fa1f819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1f6800640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f8109120 0x7fa1f819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.897+0000 7fa1f6800640 1 -- 172.21.15.40:0/2237536138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f819f650 con 0x7fa1f8103ff0 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.898+0000 7fa1f6800640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f8103ff0 0x7fa1f819a6a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e9f0 tx=0x7fa1e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.898+0000 7fa1ef400640 1 -- 172.21.15.40:0/2237536138 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800cd80 con 0x7fa1f8103ff0 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.898+0000 7fa1ef400640 1 -- 172.21.15.40:0/2237536138 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e8010910 con 0x7fa1f8103ff0 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.898+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f819f940 con 0x7fa1f8103ff0 2024-09-11T22:40:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.898+0000 7fa1ef400640 1 -- 172.21.15.40:0/2237536138 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8018990 con 0x7fa1f8103ff0 2024-09-11T22:40:32.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.898+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f81a7220 con 0x7fa1f8103ff0 2024-09-11T22:40:32.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.899+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f81043d0 con 0x7fa1f8103ff0 2024-09-11T22:40:32.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.901+0000 7fa1ef400640 1 -- 172.21.15.40:0/2237536138 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa1e8010ac0 con 0x7fa1f8103ff0 2024-09-11T22:40:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.902+0000 7fa1ef400640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1dc0a2b80 0x7fa1dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.903+0000 7fa1ef400640 1 -- 172.21.15.40:0/2237536138 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9395+0+0 (secure 0 0 0) 0x7fa1e80cf840 con 0x7fa1f8103ff0 2024-09-11T22:40:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.903+0000 7fa1efe00640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1dc0a2b80 0x7fa1dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:32.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.903+0000 7fa1efe00640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1dc0a2b80 0x7fa1dc0a5040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009230 tx=0x7fa1e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:32.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:32.907+0000 7fa1ef400640 1 -- 172.21.15.40:0/2237536138 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1e809bc60 con 0x7fa1f8103ff0 2024-09-11T22:40:33.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.092+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa1f819ba00 con 0x7fa1f8103ff0 2024-09-11T22:40:33.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.197+0000 7fa1ef400640 1 -- 172.21.15.40:0/2237536138 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) ==== 181+0+0 (secure 0 0 0) 0x7fa1e809ff60 con 0x7fa1f8103ff0 2024-09-11T22:40:33.198 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:40:33.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1dc0a2b80 msgr2=0x7fa1dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:33.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1dc0a2b80 0x7fa1dc0a5040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009230 tx=0x7fa1e00058d0 comp rx=0 tx=0).stop 2024-09-11T22:40:33.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f8103ff0 msgr2=0x7fa1f819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:33.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f8103ff0 0x7fa1f819a6a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e9f0 tx=0x7fa1e800eeb0 comp rx=0 tx=0).stop 2024-09-11T22:40:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 shutdown_connections 2024-09-11T22:40:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7fa1dc0a2b80 0x7fa1dc0a5040 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1f8109120 0x7fa1f819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f81049a0 0x7fa1f819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 --2- 172.21.15.40:0/2237536138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1f8103ff0 0x7fa1f819a6a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.200+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 >> 172.21.15.40:0/2237536138 conn(0x7fa1f80ffa90 msgr2=0x7fa1f8100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.201+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 shutdown_connections 2024-09-11T22:40:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:33.201+0000 7fa1fd400640 1 -- 172.21.15.40:0/2237536138 wait complete. 2024-09-11T22:40:33.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:33 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2237536138' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:33.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:33 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2237536138' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:33.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:33 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2237536138' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:33.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:40:34.364 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:34 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/2237536138' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:34 smithi040 ceph-mon[30787]: osdmap e97: 12 total, 12 up, 12 in 2024-09-11T22:40:34.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:34 smithi040 ceph-mon[30787]: pgmap v676: 97 pgs: 97 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:34.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:34 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/2237536138' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:34.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:34 smithi177 ceph-mon[35530]: osdmap e97: 12 total, 12 up, 12 in 2024-09-11T22:40:34.533 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:34 smithi177 ceph-mon[35530]: pgmap v676: 97 pgs: 97 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:34.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:34 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/2237536138' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:34.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:34 smithi146 ceph-mon[34996]: osdmap e97: 12 total, 12 up, 12 in 2024-09-11T22:40:34.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:34 smithi146 ceph-mon[34996]: pgmap v676: 97 pgs: 97 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:34.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.955+0000 7f5461000640 1 -- 172.21.15.40:0/3060502565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 msgr2=0x7f545c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:34.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.955+0000 7f5461000640 1 --2- 172.21.15.40:0/3060502565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 0x7f545c1043d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f544c009900 tx=0x7f544c02a410 comp rx=0 tx=0).stop 2024-09-11T22:40:34.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.955+0000 7f5461000640 1 -- 172.21.15.40:0/3060502565 shutdown_connections 2024-09-11T22:40:34.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.955+0000 7f5461000640 1 --2- 172.21.15.40:0/3060502565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f545c109120 0x7f545c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.955+0000 7f5461000640 1 --2- 172.21.15.40:0/3060502565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f545c1049a0 0x7f545c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.955+0000 7f5461000640 1 --2- 172.21.15.40:0/3060502565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 0x7f545c1043d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.955+0000 7f5461000640 1 -- 172.21.15.40:0/3060502565 >> 172.21.15.40:0/3060502565 conn(0x7f545c0ffa90 msgr2=0x7f545c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.955+0000 7f5461000640 1 -- 172.21.15.40:0/3060502565 shutdown_connections 2024-09-11T22:40:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.955+0000 7f5461000640 1 -- 172.21.15.40:0/3060502565 wait complete. 2024-09-11T22:40:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.956+0000 7f5461000640 1 Processor -- start 2024-09-11T22:40:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5461000640 1 -- start start 2024-09-11T22:40:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5461000640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 0x7f545c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5461000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f545c1049a0 0x7f545c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5461000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f545c109120 0x7f545c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5461000640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f545c114140 con 0x7f545c103ff0 2024-09-11T22:40:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5461000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f545c113fc0 con 0x7f545c109120 2024-09-11T22:40:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5461000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1142c0 con 0x7f545c1049a0 2024-09-11T22:40:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5459e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 0x7f545c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:34.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5459e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 0x7f545c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33070/0 (socket says 172.21.15.40:33070) 2024-09-11T22:40:34.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f5459e00640 1 -- 172.21.15.40:0/894026161 learned_addr learned my addr 172.21.15.40:0/894026161 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:40:34.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.957+0000 7f545a800640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f545c109120 0x7f545c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5459400640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f545c1049a0 0x7f545c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5459e00640 1 -- 172.21.15.40:0/894026161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f545c1049a0 msgr2=0x7f545c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5459e00640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f545c1049a0 0x7f545c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5459e00640 1 -- 172.21.15.40:0/894026161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f545c109120 msgr2=0x7f545c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5459e00640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f545c109120 0x7f545c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5459e00640 1 -- 172.21.15.40:0/894026161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c19f5b0 con 0x7f545c103ff0 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5459e00640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 0x7f545c19a600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f544c006010 tx=0x7f544c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5452a00640 1 -- 172.21.15.40:0/894026161 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c03f030 con 0x7f545c103ff0 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5452a00640 1 -- 172.21.15.40:0/894026161 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f544c003ce0 con 0x7f545c103ff0 2024-09-11T22:40:34.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5452a00640 1 -- 172.21.15.40:0/894026161 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c035070 con 0x7f545c103ff0 2024-09-11T22:40:34.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.958+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c19f840 con 0x7f545c103ff0 2024-09-11T22:40:34.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.959+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c19fcd0 con 0x7f545c103ff0 2024-09-11T22:40:34.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.960+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c1043d0 con 0x7f545c103ff0 2024-09-11T22:40:34.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.962+0000 7f5452a00640 1 -- 172.21.15.40:0/894026161 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f544c042030 con 0x7f545c103ff0 2024-09-11T22:40:34.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.963+0000 7f5452a00640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f54400a2c00 0x7f54400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:34.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.963+0000 7f5452a00640 1 -- 172.21.15.40:0/894026161 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8862+0+0 (secure 0 0 0) 0x7f544c0ef7a0 con 0x7f545c103ff0 2024-09-11T22:40:34.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.963+0000 7f5459400640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f54400a2c00 0x7f54400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:34.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.964+0000 7f5459400640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f54400a2c00 0x7f54400a50c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f545c0fff90 tx=0x7f5448005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:34.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:34.967+0000 7f5452a00640 1 -- 172.21.15.40:0/894026161 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f544c0bbea0 con 0x7f545c103ff0 2024-09-11T22:40:35.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.153+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f545c02d7c0 con 0x7f545c103ff0 2024-09-11T22:40:35.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.209+0000 7f5452a00640 1 -- 172.21.15.40:0/894026161 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) ==== 169+0+0 (secure 0 0 0) 0x7f544c0c01a0 con 0x7f545c103ff0 2024-09-11T22:40:35.210 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.211+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f54400a2c00 msgr2=0x7f54400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.211+0000 7f5461000640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f54400a2c00 0x7f54400a50c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f545c0fff90 tx=0x7f5448005f90 comp rx=0 tx=0).stop 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.211+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 msgr2=0x7f545c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.211+0000 7f5461000640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 0x7f545c19a600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f544c006010 tx=0x7f544c0042f0 comp rx=0 tx=0).stop 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.212+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 shutdown_connections 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.212+0000 7f5461000640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f54400a2c00 0x7f54400a50c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.212+0000 7f5461000640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f545c109120 0x7f545c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.212+0000 7f5461000640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f545c1049a0 0x7f545c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.212+0000 7f5461000640 1 --2- 172.21.15.40:0/894026161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f545c103ff0 0x7f545c19a600 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.212+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 >> 172.21.15.40:0/894026161 conn(0x7f545c0ffa90 msgr2=0x7f545c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.212+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 shutdown_connections 2024-09-11T22:40:35.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:35.212+0000 7f5461000640 1 -- 172.21.15.40:0/894026161 wait complete. 2024-09-11T22:40:35.484 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:35 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/894026161' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:35.500 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:35 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/894026161' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:35.532 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:35 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/894026161' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:36.171 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid c836ee3e-708b-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-11T22:40:36.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:36 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/894026161' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:36.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:36 smithi040 ceph-mon[30787]: osdmap e98: 12 total, 12 up, 12 in 2024-09-11T22:40:36.485 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:36 smithi040 ceph-mon[30787]: pgmap v678: 33 pgs: 33 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:36.534 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:36 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/894026161' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:36.534 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:36 smithi177 ceph-mon[35530]: osdmap e98: 12 total, 12 up, 12 in 2024-09-11T22:40:36.534 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:36 smithi177 ceph-mon[35530]: pgmap v678: 33 pgs: 33 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:36.567 INFO:teuthology.orchestra.run.smithi040.stderr:Inferring config /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T22:40:36.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:36 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/894026161' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:36.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:36 smithi146 ceph-mon[34996]: osdmap e98: 12 total, 12 up, 12 in 2024-09-11T22:40:36.585 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:36 smithi146 ceph-mon[34996]: pgmap v678: 33 pgs: 33 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:37.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.124+0000 7f75dcc00640 1 -- 172.21.15.40:0/4046824407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 msgr2=0x7f75d81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:37.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.124+0000 7f75dcc00640 1 --2- 172.21.15.40:0/4046824407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 0x7f75d81043f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009900 tx=0x7f75c802a3f0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.124+0000 7f75dcc00640 1 -- 172.21.15.40:0/4046824407 shutdown_connections 2024-09-11T22:40:37.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.124+0000 7f75dcc00640 1 --2- 172.21.15.40:0/4046824407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d8109140 0x7f75d8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.124+0000 7f75dcc00640 1 --2- 172.21.15.40:0/4046824407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75d81049c0 0x7f75d8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.124+0000 7f75dcc00640 1 --2- 172.21.15.40:0/4046824407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 0x7f75d81043f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.124+0000 7f75dcc00640 1 -- 172.21.15.40:0/4046824407 >> 172.21.15.40:0/4046824407 conn(0x7f75d80ffa50 msgr2=0x7f75d8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:37.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.124+0000 7f75dcc00640 1 -- 172.21.15.40:0/4046824407 shutdown_connections 2024-09-11T22:40:37.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.124+0000 7f75dcc00640 1 -- 172.21.15.40:0/4046824407 wait complete. 2024-09-11T22:40:37.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.125+0000 7f75dcc00640 1 Processor -- start 2024-09-11T22:40:37.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.125+0000 7f75dcc00640 1 -- start start 2024-09-11T22:40:37.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.125+0000 7f75dcc00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 0x7f75d819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:37.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.125+0000 7f75dcc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75d81049c0 0x7f75d819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:37.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.125+0000 7f75dcc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d8109140 0x7f75d819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:37.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.125+0000 7f75dcc00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8114190 con 0x7f75d8104010 2024-09-11T22:40:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.125+0000 7f75dcc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8114010 con 0x7f75d81049c0 2024-09-11T22:40:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.125+0000 7f75dcc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8114310 con 0x7f75d8109140 2024-09-11T22:40:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75d5e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 0x7f75d819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75d5e00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 0x7f75d819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33086/0 (socket says 172.21.15.40:33086) 2024-09-11T22:40:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75d5e00640 1 -- 172.21.15.40:0/3926188785 learned_addr learned my addr 172.21.15.40:0/3926188785 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-11T22:40:37.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75cd400640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75d81049c0 0x7f75d819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:37.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75d6800640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d8109140 0x7f75d819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:37.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75d5e00640 1 -- 172.21.15.40:0/3926188785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d8109140 msgr2=0x7f75d819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:37.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75d5e00640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d8109140 0x7f75d819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75d5e00640 1 -- 172.21.15.40:0/3926188785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75d81049c0 msgr2=0x7f75d819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:37.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75d5e00640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75d81049c0 0x7f75d819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75d5e00640 1 -- 172.21.15.40:0/3926188785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d819f5b0 con 0x7f75d8104010 2024-09-11T22:40:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.126+0000 7f75cd400640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75d81049c0 0x7f75d819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:40:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.127+0000 7f75d5e00640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 0x7f75d819a600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75c8004770 tx=0x7f75c8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.127+0000 7f75cf400640 1 -- 172.21.15.40:0/3926188785 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c803f070 con 0x7f75d8104010 2024-09-11T22:40:37.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.127+0000 7f75cf400640 1 -- 172.21.15.40:0/3926188785 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75c8031ca0 con 0x7f75d8104010 2024-09-11T22:40:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.127+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d819f840 con 0x7f75d8104010 2024-09-11T22:40:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.127+0000 7f75cf400640 1 -- 172.21.15.40:0/3926188785 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c8035030 con 0x7f75d8104010 2024-09-11T22:40:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.127+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d81a7180 con 0x7f75d8104010 2024-09-11T22:40:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.128+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d81043f0 con 0x7f75d8104010 2024-09-11T22:40:37.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.130+0000 7f75cf400640 1 -- 172.21.15.40:0/3926188785 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f75c8042070 con 0x7f75d8104010 2024-09-11T22:40:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.131+0000 7f75cf400640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f75bc0a2b80 0x7f75bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:40:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.131+0000 7f75cf400640 1 -- 172.21.15.40:0/3926188785 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8324+0+0 (secure 0 0 0) 0x7f75c80ef410 con 0x7f75d8104010 2024-09-11T22:40:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.132+0000 7f75cd400640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f75bc0a2b80 0x7f75bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:40:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.132+0000 7f75cd400640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f75bc0a2b80 0x7f75bc0a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f75d80ffe70 tx=0x7f75c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:40:37.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.136+0000 7f75cf400640 1 -- 172.21.15.40:0/3926188785 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75c80bc370 con 0x7f75d8104010 2024-09-11T22:40:37.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.322+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f75d810c320 con 0x7f75d8104010 2024-09-11T22:40:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.375+0000 7f75cf400640 1 -- 172.21.15.40:0/3926188785 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v99) ==== 178+0+0 (secure 0 0 0) 0x7f75c80bbc70 con 0x7f75d8104010 2024-09-11T22:40:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' removed 2024-09-11T22:40:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.379+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f75bc0a2b80 msgr2=0x7f75bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.379+0000 7f75dcc00640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f75bc0a2b80 0x7f75bc0a5040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f75d80ffe70 tx=0x7f75c0005f90 comp rx=0 tx=0).stop 2024-09-11T22:40:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.379+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 msgr2=0x7f75d819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:40:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.379+0000 7f75dcc00640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 0x7f75d819a600 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f75c8004770 tx=0x7f75c8003c10 comp rx=0 tx=0).stop 2024-09-11T22:40:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.380+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 shutdown_connections 2024-09-11T22:40:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.380+0000 7f75dcc00640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:6800/3905506167,v1:172.21.15.40:6801/3905506167] conn(0x7f75bc0a2b80 0x7f75bc0a5040 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.380+0000 7f75dcc00640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d8109140 0x7f75d819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.380+0000 7f75dcc00640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75d81049c0 0x7f75d819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.380+0000 7f75dcc00640 1 --2- 172.21.15.40:0/3926188785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d8104010 0x7f75d819a600 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:40:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.380+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 >> 172.21.15.40:0/3926188785 conn(0x7f75d80ffa50 msgr2=0x7f75d8100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:40:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.380+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 shutdown_connections 2024-09-11T22:40:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-11T22:40:37.380+0000 7f75dcc00640 1 -- 172.21.15.40:0/3926188785 wait complete. 2024-09-11T22:40:37.734 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:37 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3926188785' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:37.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:37 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3926188785' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:37.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:37 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3926188785' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-11T22:40:38.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:40:38.216 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:40:38.264 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:40:38.306 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T22:40:38.307 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:40:38.372 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:40:38.420 DEBUG:teuthology.orchestra.run.smithi177:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T22:40:38.461 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T22:40:38.461 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T22:40:38.461 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.a 2024-09-11T22:40:38.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:38 smithi146 ceph-mon[34996]: from='client.? 172.21.15.40:0/3926188785' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:38.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:38 smithi146 ceph-mon[34996]: osdmap e99: 12 total, 12 up, 12 in 2024-09-11T22:40:38.584 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:38 smithi146 ceph-mon[34996]: pgmap v680: 1 pgs: 1 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:38.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:38 smithi040 ceph-mon[30787]: from='client.? 172.21.15.40:0/3926188785' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:38.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:38 smithi040 ceph-mon[30787]: osdmap e99: 12 total, 12 up, 12 in 2024-09-11T22:40:38.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:38 smithi040 ceph-mon[30787]: pgmap v680: 1 pgs: 1 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:38.735 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:38 smithi040 systemd[1]: Stopping Ceph mon.a for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:38.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:38 smithi177 ceph-mon[35530]: from='client.? 172.21.15.40:0/3926188785' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T22:40:38.782 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:38 smithi177 ceph-mon[35530]: osdmap e99: 12 total, 12 up, 12 in 2024-09-11T22:40:38.783 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:38 smithi177 ceph-mon[35530]: pgmap v680: 1 pgs: 1 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T22:40:39.234 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:38 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a[30783]: 2024-09-11T22:40:38.951+0000 7f3197000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:39.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:38 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a[30783]: 2024-09-11T22:40:38.951+0000 7f3197000640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T22:40:39.235 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:39 smithi040 podman[87552]: 2024-09-11 22:40:39.003541775 +0000 UTC m=+0.188872576 container died 7e01a1771198d7dc269364cb391fef43de3cd86e11ced3b7778fc974d7f176c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:40:39.701 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:39 smithi040 podman[87552]: 2024-09-11 22:40:39.449469328 +0000 UTC m=+0.634800119 container cleanup 7e01a1771198d7dc269364cb391fef43de3cd86e11ced3b7778fc974d7f176c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-11T22:40:39.701 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:39 smithi040 bash[87552]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a 2024-09-11T22:40:39.960 INFO:journalctl@ceph.mon.a.smithi040.stdout:Sep 11 22:40:39 smithi040 podman[87564]: 2024-09-11 22:40:39.700894021 +0000 UTC m=+0.687145709 container remove 7e01a1771198d7dc269364cb391fef43de3cd86e11ced3b7778fc974d7f176c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-11T22:40:39.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T22:40:40.081 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:40.081 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T22:40:40.081 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-11T22:40:40.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.b 2024-09-11T22:40:40.419 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:40 smithi146 systemd[1]: Stopping Ceph mon.b for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:40.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:40 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-b[34992]: 2024-09-11T22:40:40.418+0000 7f7ca3f2b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:40.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:40 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-b[34992]: 2024-09-11T22:40:40.418+0000 7f7ca3f2b640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T22:40:40.834 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:40 smithi146 podman[69547]: 2024-09-11 22:40:40.571629232 +0000 UTC m=+0.272479585 container died f8bd6c8361dc4932b08d5fec9381874283eeed3ebd976b398f01a88101901af8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-11T22:40:41.271 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:41 smithi146 podman[69547]: 2024-09-11 22:40:41.010854797 +0000 UTC m=+0.711705148 container cleanup f8bd6c8361dc4932b08d5fec9381874283eeed3ebd976b398f01a88101901af8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:40:41.271 INFO:journalctl@ceph.mon.b.smithi146.stdout:Sep 11 22:40:41 smithi146 bash[69547]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-b 2024-09-11T22:40:41.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T22:40:41.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:41.547 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-11T22:40:41.547 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-11T22:40:41.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.c 2024-09-11T22:40:41.900 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:41 smithi177 systemd[1]: Stopping Ceph mon.c for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:42.282 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:41 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-c[35526]: 2024-09-11T22:40:41.899+0000 7f25ba9d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:42.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:41 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-c[35526]: 2024-09-11T22:40:41.899+0000 7f25ba9d7640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T22:40:42.283 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:42 smithi177 podman[69480]: 2024-09-11 22:40:42.002226868 +0000 UTC m=+0.222795033 container died 4dbf9b00d293d2e14b2a19c5a29fba77013695690931a7f8d87e5fed9e31fa33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T22:40:42.676 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:42 smithi177 podman[69480]: 2024-09-11 22:40:42.391468421 +0000 UTC m=+0.612036579 container cleanup 4dbf9b00d293d2e14b2a19c5a29fba77013695690931a7f8d87e5fed9e31fa33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-c, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T22:40:42.677 INFO:journalctl@ceph.mon.c.smithi177.stdout:Sep 11 22:40:42 smithi177 bash[69480]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mon-c 2024-09-11T22:40:42.820 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T22:40:42.866 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:42.866 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-11T22:40:42.866 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T22:40:42.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.x 2024-09-11T22:40:43.235 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:40:42 smithi040 systemd[1]: Stopping Ceph mgr.x for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:44.485 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:40:44 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:40:44.124+0000 7f0e8a400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:44.485 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:40:44 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x[31009]: 2024-09-11T22:40:44.124+0000 7f0e8a400640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-11T22:40:44.485 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:40:44 smithi040 podman[87671]: 2024-09-11 22:40:44.217023609 +0000 UTC m=+1.050119694 container died 1eadf4c36052ffdaddb7846b6bc2f8e11cbaf73073f49677e773afa1562ff85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T22:40:44.941 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:40:44 smithi040 podman[87671]: 2024-09-11 22:40:44.688643185 +0000 UTC m=+1.521739269 container cleanup 1eadf4c36052ffdaddb7846b6bc2f8e11cbaf73073f49677e773afa1562ff85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-11T22:40:44.941 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:40:44 smithi040 bash[87671]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x 2024-09-11T22:40:45.208 INFO:journalctl@ceph.mgr.x.smithi040.stdout:Sep 11 22:40:44 smithi040 podman[87683]: 2024-09-11 22:40:44.940702104 +0000 UTC m=+0.707535156 container remove 1eadf4c36052ffdaddb7846b6bc2f8e11cbaf73073f49677e773afa1562ff85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-11T22:40:45.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T22:40:45.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:45.301 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T22:40:45.301 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T22:40:45.302 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.y 2024-09-11T22:40:45.584 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:40:45 smithi146 systemd[1]: Stopping Ceph mgr.y for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:45.942 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:40:45 smithi146 podman[69669]: 2024-09-11 22:40:45.636336941 +0000 UTC m=+0.142013876 container died a87c00a9e03af6c1dc19d598e9fec5e8435f435d995dbf4186c2050b9dd2d17b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-11T22:40:46.309 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:40:46 smithi146 podman[69669]: 2024-09-11 22:40:46.065900749 +0000 UTC m=+0.571577694 container cleanup a87c00a9e03af6c1dc19d598e9fec5e8435f435d995dbf4186c2050b9dd2d17b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T22:40:46.310 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:40:46 smithi146 bash[69669]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y 2024-09-11T22:40:46.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T22:40:46.560 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:40:46 smithi146 podman[69682]: 2024-09-11 22:40:46.309215165 +0000 UTC m=+0.663949396 container remove a87c00a9e03af6c1dc19d598e9fec5e8435f435d995dbf4186c2050b9dd2d17b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-11T22:40:46.560 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:40:46 smithi146 systemd[1]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-11T22:40:46.560 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:40:46 smithi146 systemd[1]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-11T22:40:46.560 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:40:46 smithi146 systemd[1]: Stopped Ceph mgr.y for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:40:46.560 INFO:journalctl@ceph.mgr.y.smithi146.stdout:Sep 11 22:40:46 smithi146 systemd[1]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.y.service: Consumed 6.561s CPU time. 2024-09-11T22:40:46.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:46.574 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T22:40:46.574 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-11T22:40:46.574 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.z 2024-09-11T22:40:46.900 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:40:46 smithi177 systemd[1]: Stopping Ceph mgr.z for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:47.215 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:40:46 smithi177 podman[69605]: 2024-09-11 22:40:46.900472779 +0000 UTC m=+0.136810400 container died 85c43e1283747ef6d203dd4754bd0a067b00eb83ca445ed3ab2ebbbd036d13a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T22:40:47.532 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:40:47 smithi177 podman[69605]: 2024-09-11 22:40:47.330563211 +0000 UTC m=+0.566900831 container cleanup 85c43e1283747ef6d203dd4754bd0a067b00eb83ca445ed3ab2ebbbd036d13a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T22:40:47.533 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:40:47 smithi177 bash[69605]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z 2024-09-11T22:40:47.812 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-11T22:40:47.834 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:40:47 smithi177 podman[69618]: 2024-09-11 22:40:47.582440966 +0000 UTC m=+0.676654304 container remove 85c43e1283747ef6d203dd4754bd0a067b00eb83ca445ed3ab2ebbbd036d13a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T22:40:47.834 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:40:47 smithi177 systemd[1]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-11T22:40:47.834 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:40:47 smithi177 systemd[1]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-11T22:40:47.834 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:40:47 smithi177 systemd[1]: Stopped Ceph mgr.z for c836ee3e-708b-11ef-bcea-c7b262605968. 2024-09-11T22:40:47.834 INFO:journalctl@ceph.mgr.z.smithi177.stdout:Sep 11 22:40:47 smithi177 systemd[1]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mgr.z.service: Consumed 6.673s CPU time. 2024-09-11T22:40:47.848 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:47.848 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-11T22:40:47.848 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T22:40:47.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.0 2024-09-11T22:40:48.235 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:47 smithi040 systemd[1]: Stopping Ceph osd.0 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:48.735 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:48 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0[42166]: 2024-09-11T22:40:48.279+0000 7f406ac00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:48.735 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:48 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0[42166]: 2024-09-11T22:40:48.279+0000 7f406ac00640 -1 osd.0 99 *** Got signal Terminated *** 2024-09-11T22:40:48.735 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:48 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0[42166]: 2024-09-11T22:40:48.279+0000 7f406ac00640 -1 osd.0 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:40:54.235 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:53 smithi040 podman[87790]: 2024-09-11 22:40:53.975988046 +0000 UTC m=+5.831508794 container died e79de3861541df79f0bbe5be239c687bc0c80d423f65d1be066017fdc45afbd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T22:40:54.696 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:54 smithi040 podman[87790]: 2024-09-11 22:40:54.419859668 +0000 UTC m=+6.275380415 container cleanup e79de3861541df79f0bbe5be239c687bc0c80d423f65d1be066017fdc45afbd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:40:54.697 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:54 smithi040 bash[87790]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0 2024-09-11T22:40:54.984 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:54 smithi040 podman[87807]: 2024-09-11 22:40:54.696384057 +0000 UTC m=+0.715328266 container remove e79de3861541df79f0bbe5be239c687bc0c80d423f65d1be066017fdc45afbd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:40:55.584 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:55 smithi040 podman[87895]: 2024-09-11 22:40:55.174383435 +0000 UTC m=+0.027431610 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:40:55.584 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:55 smithi040 podman[87895]: 2024-09-11 22:40:55.297782702 +0000 UTC m=+0.150830866 container create a5ee7ca7674668756b8130699e7baf65367415eda6461fb3069cf364e7776a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T22:40:55.584 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:55 smithi040 podman[87895]: 2024-09-11 22:40:55.583972177 +0000 UTC m=+0.437020342 container init a5ee7ca7674668756b8130699e7baf65367415eda6461fb3069cf364e7776a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T22:40:55.985 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:55 smithi040 podman[87895]: 2024-09-11 22:40:55.59145505 +0000 UTC m=+0.444503224 container start a5ee7ca7674668756b8130699e7baf65367415eda6461fb3069cf364e7776a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-11T22:40:55.985 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:55 smithi040 podman[87895]: 2024-09-11 22:40:55.683694631 +0000 UTC m=+0.536742806 container attach a5ee7ca7674668756b8130699e7baf65367415eda6461fb3069cf364e7776a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-11T22:40:56.430 INFO:journalctl@ceph.osd.0.smithi040.stdout:Sep 11 22:40:56 smithi040 podman[87917]: 2024-09-11 22:40:56.14933138 +0000 UTC m=+0.029169671 container died a5ee7ca7674668756b8130699e7baf65367415eda6461fb3069cf364e7776a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T22:40:56.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T22:40:56.867 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:40:56.868 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T22:40:56.868 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T22:40:56.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.1 2024-09-11T22:40:57.179 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:40:56 smithi146 systemd[1]: Stopping Ceph osd.1 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:40:57.584 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:40:57 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1[39449]: 2024-09-11T22:40:57.177+0000 7fbb904a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:40:57.584 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:40:57 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1[39449]: 2024-09-11T22:40:57.177+0000 7fbb904a4640 -1 osd.1 99 *** Got signal Terminated *** 2024-09-11T22:40:57.584 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:40:57 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1[39449]: 2024-09-11T22:40:57.177+0000 7fbb904a4640 -1 osd.1 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:03.072 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:02 smithi146 podman[69807]: 2024-09-11 22:41:02.760977823 +0000 UTC m=+5.698746147 container died 77def46e5bb22d352fe4c3e266f7aa43244ad4cf469efe44aaea9bab399cb691 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T22:41:03.335 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:03 smithi146 podman[69807]: 2024-09-11 22:41:03.153373005 +0000 UTC m=+6.091141334 container cleanup 77def46e5bb22d352fe4c3e266f7aa43244ad4cf469efe44aaea9bab399cb691 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-11T22:41:03.335 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:03 smithi146 bash[69807]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1 2024-09-11T22:41:03.745 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:03 smithi146 podman[69826]: 2024-09-11 22:41:03.436239748 +0000 UTC m=+0.672379235 container remove 77def46e5bb22d352fe4c3e266f7aa43244ad4cf469efe44aaea9bab399cb691 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:41:04.050 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:03 smithi146 podman[69913]: 2024-09-11 22:41:03.647664165 +0000 UTC m=+0.016019092 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:04.051 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:03 smithi146 podman[69913]: 2024-09-11 22:41:03.797741081 +0000 UTC m=+0.166095994 container create c1e75c81c210324bffec7aea54872a81a29bbb8d91955285994703d71ebfb442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:04.051 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:04 smithi146 podman[69913]: 2024-09-11 22:41:04.050346877 +0000 UTC m=+0.418701789 container init c1e75c81c210324bffec7aea54872a81a29bbb8d91955285994703d71ebfb442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T22:41:04.334 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:04 smithi146 podman[69913]: 2024-09-11 22:41:04.054248615 +0000 UTC m=+0.422603531 container start c1e75c81c210324bffec7aea54872a81a29bbb8d91955285994703d71ebfb442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-11T22:41:04.334 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:04 smithi146 podman[69913]: 2024-09-11 22:41:04.158906917 +0000 UTC m=+0.527261875 container attach c1e75c81c210324bffec7aea54872a81a29bbb8d91955285994703d71ebfb442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:04.729 INFO:journalctl@ceph.osd.1.smithi146.stdout:Sep 11 22:41:04 smithi146 podman[69913]: 2024-09-11 22:41:04.420994151 +0000 UTC m=+0.789349080 container died c1e75c81c210324bffec7aea54872a81a29bbb8d91955285994703d71ebfb442 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:05.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T22:41:05.128 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:05.128 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T22:41:05.128 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T22:41:05.128 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.2 2024-09-11T22:41:05.452 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:05 smithi177 systemd[1]: Stopping Ceph osd.2 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:05.783 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:05 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2[40487]: 2024-09-11T22:41:05.451+0000 7f1ac75b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:05.783 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:05 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2[40487]: 2024-09-11T22:41:05.451+0000 7f1ac75b7640 -1 osd.2 99 *** Got signal Terminated *** 2024-09-11T22:41:05.783 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:05 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2[40487]: 2024-09-11T22:41:05.451+0000 7f1ac75b7640 -1 osd.2 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:11.220 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:10 smithi177 podman[69738]: 2024-09-11 22:41:10.908206729 +0000 UTC m=+5.577984788 container died 3932567ceb096de1426a8a024885acedd94be0c2f7ba58b25c8ed101b13396e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T22:41:11.533 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:11 smithi177 podman[69738]: 2024-09-11 22:41:11.334973903 +0000 UTC m=+6.004751940 container cleanup 3932567ceb096de1426a8a024885acedd94be0c2f7ba58b25c8ed101b13396e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-11T22:41:11.533 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:11 smithi177 bash[69738]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2 2024-09-11T22:41:11.997 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:11 smithi177 podman[69754]: 2024-09-11 22:41:11.570077137 +0000 UTC m=+0.659394677 container remove 3932567ceb096de1426a8a024885acedd94be0c2f7ba58b25c8ed101b13396e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:12.282 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:11 smithi177 podman[69845]: 2024-09-11 22:41:11.900545071 +0000 UTC m=+0.015874668 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:12.282 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:12 smithi177 podman[69845]: 2024-09-11 22:41:12.037683342 +0000 UTC m=+0.153012983 container create 5c47c141cba5e8aefc8febaa2516fa4a782bfa157e24f4ac100886db87c1cb86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T22:41:12.630 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:12 smithi177 podman[69845]: 2024-09-11 22:41:12.340666645 +0000 UTC m=+0.455996241 container init 5c47c141cba5e8aefc8febaa2516fa4a782bfa157e24f4ac100886db87c1cb86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-11T22:41:12.630 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:12 smithi177 podman[69845]: 2024-09-11 22:41:12.344255133 +0000 UTC m=+0.459584747 container start 5c47c141cba5e8aefc8febaa2516fa4a782bfa157e24f4ac100886db87c1cb86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:12.630 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:12 smithi177 podman[69845]: 2024-09-11 22:41:12.440490198 +0000 UTC m=+0.555819797 container attach 5c47c141cba5e8aefc8febaa2516fa4a782bfa157e24f4ac100886db87c1cb86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T22:41:12.985 INFO:journalctl@ceph.osd.2.smithi177.stdout:Sep 11 22:41:12 smithi177 podman[69845]: 2024-09-11 22:41:12.630005921 +0000 UTC m=+0.745335520 container died 5c47c141cba5e8aefc8febaa2516fa4a782bfa157e24f4ac100886db87c1cb86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T22:41:13.316 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T22:41:13.357 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:13.358 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T22:41:13.358 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T22:41:13.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.3 2024-09-11T22:41:13.735 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:13 smithi040 systemd[1]: Stopping Ceph osd.3 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:14.234 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:13 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3[48792]: 2024-09-11T22:41:13.776+0000 7f6bfc600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:14.235 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:13 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3[48792]: 2024-09-11T22:41:13.776+0000 7f6bfc600640 -1 osd.3 99 *** Got signal Terminated *** 2024-09-11T22:41:14.235 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:13 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3[48792]: 2024-09-11T22:41:13.776+0000 7f6bfc600640 -1 osd.3 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:19.735 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:19 smithi040 podman[88020]: 2024-09-11 22:41:19.524949914 +0000 UTC m=+5.874144438 container died d2260919c676732c89181a345e2d4018be5e5cf0bb24e4d8c3fa39b7e74ddad2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T22:41:20.234 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:19 smithi040 podman[88020]: 2024-09-11 22:41:19.999650556 +0000 UTC m=+6.348845080 container cleanup d2260919c676732c89181a345e2d4018be5e5cf0bb24e4d8c3fa39b7e74ddad2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:20.235 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:19 smithi040 bash[88020]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3 2024-09-11T22:41:20.734 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:20 smithi040 podman[88040]: 2024-09-11 22:41:20.251386843 +0000 UTC m=+0.696878607 container remove d2260919c676732c89181a345e2d4018be5e5cf0bb24e4d8c3fa39b7e74ddad2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:21.105 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:20 smithi040 podman[88125]: 2024-09-11 22:41:20.71519474 +0000 UTC m=+0.028577982 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:21.105 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:20 smithi040 podman[88125]: 2024-09-11 22:41:20.835769795 +0000 UTC m=+0.149153043 container create 469d65ec2471e77cbe1dac40cca12cc5d14183d42f4f1f8f9586f6c7c40fb55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:21.387 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:21 smithi040 podman[88125]: 2024-09-11 22:41:21.105029387 +0000 UTC m=+0.418412629 container init 469d65ec2471e77cbe1dac40cca12cc5d14183d42f4f1f8f9586f6c7c40fb55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:21.387 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:21 smithi040 podman[88125]: 2024-09-11 22:41:21.111878341 +0000 UTC m=+0.425261584 container start 469d65ec2471e77cbe1dac40cca12cc5d14183d42f4f1f8f9586f6c7c40fb55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T22:41:21.387 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:21 smithi040 podman[88125]: 2024-09-11 22:41:21.238289047 +0000 UTC m=+0.551672293 container attach 469d65ec2471e77cbe1dac40cca12cc5d14183d42f4f1f8f9586f6c7c40fb55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-11T22:41:21.733 INFO:journalctl@ceph.osd.3.smithi040.stdout:Sep 11 22:41:21 smithi040 podman[88125]: 2024-09-11 22:41:21.386930888 +0000 UTC m=+0.700314138 container died 469d65ec2471e77cbe1dac40cca12cc5d14183d42f4f1f8f9586f6c7c40fb55e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-11T22:41:22.087 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T22:41:22.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:22.165 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T22:41:22.165 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T22:41:22.165 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.4 2024-09-11T22:41:22.482 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:22 smithi146 systemd[1]: Stopping Ceph osd.4 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:22.834 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:22 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4[46306]: 2024-09-11T22:41:22.480+0000 7f437ee8a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:22.834 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:22 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4[46306]: 2024-09-11T22:41:22.480+0000 7f437ee8a640 -1 osd.4 99 *** Got signal Terminated *** 2024-09-11T22:41:22.834 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:22 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4[46306]: 2024-09-11T22:41:22.480+0000 7f437ee8a640 -1 osd.4 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:28.441 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:28 smithi146 podman[70014]: 2024-09-11 22:41:28.141879231 +0000 UTC m=+5.785190573 container died ccef8da24d69f48017bbf0a4b2fb8dda51a6a6bc47a0d74999efe533d7a876d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:28.749 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:28 smithi146 podman[70014]: 2024-09-11 22:41:28.556057959 +0000 UTC m=+6.199369308 container cleanup ccef8da24d69f48017bbf0a4b2fb8dda51a6a6bc47a0d74999efe533d7a876d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T22:41:28.749 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:28 smithi146 bash[70014]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4 2024-09-11T22:41:29.084 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:28 smithi146 podman[70031]: 2024-09-11 22:41:28.749078193 +0000 UTC m=+0.607358782 container remove ccef8da24d69f48017bbf0a4b2fb8dda51a6a6bc47a0d74999efe533d7a876d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T22:41:29.495 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:29 smithi146 podman[70118]: 2024-09-11 22:41:29.066754118 +0000 UTC m=+0.015654985 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:29.495 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:29 smithi146 podman[70118]: 2024-09-11 22:41:29.199979025 +0000 UTC m=+0.148879881 container create 16ae8fdba2e49c8b6d39d2486ff72a154e5c5e31f922a296fc45344bbf81f382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-11T22:41:29.495 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:29 smithi146 podman[70118]: 2024-09-11 22:41:29.494474885 +0000 UTC m=+0.443375758 container init 16ae8fdba2e49c8b6d39d2486ff72a154e5c5e31f922a296fc45344bbf81f382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T22:41:29.834 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:29 smithi146 podman[70118]: 2024-09-11 22:41:29.498358359 +0000 UTC m=+0.447259219 container start 16ae8fdba2e49c8b6d39d2486ff72a154e5c5e31f922a296fc45344bbf81f382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-11T22:41:29.834 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:29 smithi146 podman[70118]: 2024-09-11 22:41:29.577644169 +0000 UTC m=+0.526545045 container attach 16ae8fdba2e49c8b6d39d2486ff72a154e5c5e31f922a296fc45344bbf81f382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T22:41:29.834 INFO:journalctl@ceph.osd.4.smithi146.stdout:Sep 11 22:41:29 smithi146 podman[70118]: 2024-09-11 22:41:29.694185402 +0000 UTC m=+0.643086268 container died 16ae8fdba2e49c8b6d39d2486ff72a154e5c5e31f922a296fc45344bbf81f382 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-11T22:41:30.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T22:41:30.401 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:30.402 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T22:41:30.402 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T22:41:30.402 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.5 2024-09-11T22:41:30.714 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:30 smithi177 systemd[1]: Stopping Ceph osd.5 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:31.032 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:30 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5[46963]: 2024-09-11T22:41:30.712+0000 7f35b36a0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:31.032 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:30 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5[46963]: 2024-09-11T22:41:30.712+0000 7f35b36a0640 -1 osd.5 99 *** Got signal Terminated *** 2024-09-11T22:41:31.033 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:30 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5[46963]: 2024-09-11T22:41:30.712+0000 7f35b36a0640 -1 osd.5 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:36.533 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:36 smithi177 podman[69970]: 2024-09-11 22:41:36.250787008 +0000 UTC m=+5.650906222 container died 1c1e57e5f596b7c5ef4f6f539544fd1597fe06e226b1551d7baea34b09aa2beb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T22:41:36.906 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:36 smithi177 podman[69970]: 2024-09-11 22:41:36.655121092 +0000 UTC m=+6.055240296 container cleanup 1c1e57e5f596b7c5ef4f6f539544fd1597fe06e226b1551d7baea34b09aa2beb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:36.907 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:36 smithi177 bash[69970]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5 2024-09-11T22:41:37.216 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:36 smithi177 podman[69988]: 2024-09-11 22:41:36.906704245 +0000 UTC m=+0.656731274 container remove 1c1e57e5f596b7c5ef4f6f539544fd1597fe06e226b1551d7baea34b09aa2beb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T22:41:37.527 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:37 smithi177 podman[70080]: 2024-09-11 22:41:37.119331989 +0000 UTC m=+0.015644231 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:37.527 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:37 smithi177 podman[70080]: 2024-09-11 22:41:37.240692164 +0000 UTC m=+0.137004401 container create 634edef095c3ca2d2151dd1c33d6cfd31a4f7f2023301b249cde7231dd4d4681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:37.527 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:37 smithi177 podman[70080]: 2024-09-11 22:41:37.526771381 +0000 UTC m=+0.423083618 container init 634edef095c3ca2d2151dd1c33d6cfd31a4f7f2023301b249cde7231dd4d4681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-11T22:41:37.783 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:37 smithi177 podman[70080]: 2024-09-11 22:41:37.530123636 +0000 UTC m=+0.426435884 container start 634edef095c3ca2d2151dd1c33d6cfd31a4f7f2023301b249cde7231dd4d4681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:37.783 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:37 smithi177 podman[70080]: 2024-09-11 22:41:37.618304532 +0000 UTC m=+0.514616772 container attach 634edef095c3ca2d2151dd1c33d6cfd31a4f7f2023301b249cde7231dd4d4681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-11T22:41:37.783 INFO:journalctl@ceph.osd.5.smithi177.stdout:Sep 11 22:41:37 smithi177 podman[70080]: 2024-09-11 22:41:37.717032628 +0000 UTC m=+0.613344867 container died 634edef095c3ca2d2151dd1c33d6cfd31a4f7f2023301b249cde7231dd4d4681 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T22:41:38.363 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T22:41:38.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:38.403 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T22:41:38.404 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T22:41:38.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.6 2024-09-11T22:41:38.717 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:38 smithi040 systemd[1]: Stopping Ceph osd.6 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:38.985 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:38 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6[55743]: 2024-09-11T22:41:38.822+0000 7f74b0e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:38.985 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:38 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6[55743]: 2024-09-11T22:41:38.822+0000 7f74b0e00640 -1 osd.6 99 *** Got signal Terminated *** 2024-09-11T22:41:38.985 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:38 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6[55743]: 2024-09-11T22:41:38.822+0000 7f74b0e00640 -1 osd.6 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:44.884 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:44 smithi040 podman[88225]: 2024-09-11 22:41:44.602542922 +0000 UTC m=+5.911237308 container died c2ef69988d58db674b89e722712fce6f177a30c16dd2fcf1e4ec976da2597f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T22:41:45.235 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:45 smithi040 podman[88225]: 2024-09-11 22:41:45.011000392 +0000 UTC m=+6.319694775 container cleanup c2ef69988d58db674b89e722712fce6f177a30c16dd2fcf1e4ec976da2597f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-11T22:41:45.235 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:45 smithi040 bash[88225]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6 2024-09-11T22:41:45.734 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:45 smithi040 podman[88254]: 2024-09-11 22:41:45.346569908 +0000 UTC m=+0.732601749 container remove c2ef69988d58db674b89e722712fce6f177a30c16dd2fcf1e4ec976da2597f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:46.050 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:45 smithi040 podman[88342]: 2024-09-11 22:41:45.689516945 +0000 UTC m=+0.027828845 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:46.050 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:45 smithi040 podman[88342]: 2024-09-11 22:41:45.788997977 +0000 UTC m=+0.127309875 container create 64ee3a60bc0a6a57ef2e270da287532eca9fca06055ad19394983b2908940a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T22:41:46.050 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:46 smithi040 podman[88342]: 2024-09-11 22:41:46.049995653 +0000 UTC m=+0.388307553 container init 64ee3a60bc0a6a57ef2e270da287532eca9fca06055ad19394983b2908940a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T22:41:46.324 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:46 smithi040 podman[88342]: 2024-09-11 22:41:46.057018116 +0000 UTC m=+0.395330025 container start 64ee3a60bc0a6a57ef2e270da287532eca9fca06055ad19394983b2908940a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T22:41:46.324 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:46 smithi040 podman[88342]: 2024-09-11 22:41:46.133237632 +0000 UTC m=+0.471549546 container attach 64ee3a60bc0a6a57ef2e270da287532eca9fca06055ad19394983b2908940a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T22:41:46.677 INFO:journalctl@ceph.osd.6.smithi040.stdout:Sep 11 22:41:46 smithi040 podman[88342]: 2024-09-11 22:41:46.324183737 +0000 UTC m=+0.662495644 container died 64ee3a60bc0a6a57ef2e270da287532eca9fca06055ad19394983b2908940a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:47.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T22:41:47.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:47.115 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T22:41:47.115 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T22:41:47.115 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.7 2024-09-11T22:41:47.433 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:47 smithi146 systemd[1]: Stopping Ceph osd.7 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:47.834 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:47 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7[52988]: 2024-09-11T22:41:47.432+0000 7f6fa9c9c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:47.834 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:47 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7[52988]: 2024-09-11T22:41:47.432+0000 7f6fa9c9c640 -1 osd.7 99 *** Got signal Terminated *** 2024-09-11T22:41:47.834 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:47 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7[52988]: 2024-09-11T22:41:47.432+0000 7f6fa9c9c640 -1 osd.7 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:53.399 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:53 smithi146 podman[70219]: 2024-09-11 22:41:53.119980448 +0000 UTC m=+5.818263512 container died df10085532928f4d79f840c38904f95ff220cbb55f9b758647f09f7e8b906ed7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:53.800 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:53 smithi146 podman[70219]: 2024-09-11 22:41:53.498158313 +0000 UTC m=+6.196441371 container cleanup df10085532928f4d79f840c38904f95ff220cbb55f9b758647f09f7e8b906ed7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-11T22:41:53.800 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:53 smithi146 bash[70219]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7 2024-09-11T22:41:54.084 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:53 smithi146 podman[70234]: 2024-09-11 22:41:53.799767583 +0000 UTC m=+0.683705566 container remove df10085532928f4d79f840c38904f95ff220cbb55f9b758647f09f7e8b906ed7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T22:41:54.412 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:54 smithi146 podman[70318]: 2024-09-11 22:41:54.01512223 +0000 UTC m=+0.015689950 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:41:54.412 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:54 smithi146 podman[70318]: 2024-09-11 22:41:54.125579398 +0000 UTC m=+0.126147118 container create 9b0e1bce133a13866cca47374d2153cbbb91a91068b55f45ded58c4cd63dc8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:41:54.412 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:54 smithi146 podman[70318]: 2024-09-11 22:41:54.336272316 +0000 UTC m=+0.336840035 container init 9b0e1bce133a13866cca47374d2153cbbb91a91068b55f45ded58c4cd63dc8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-11T22:41:54.412 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:54 smithi146 podman[70318]: 2024-09-11 22:41:54.339671858 +0000 UTC m=+0.340239583 container start 9b0e1bce133a13866cca47374d2153cbbb91a91068b55f45ded58c4cd63dc8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:41:54.412 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:54 smithi146 podman[70318]: 2024-09-11 22:41:54.410986532 +0000 UTC m=+0.411554268 container attach 9b0e1bce133a13866cca47374d2153cbbb91a91068b55f45ded58c4cd63dc8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T22:41:54.834 INFO:journalctl@ceph.osd.7.smithi146.stdout:Sep 11 22:41:54 smithi146 podman[70318]: 2024-09-11 22:41:54.54065767 +0000 UTC m=+0.541225405 container died 9b0e1bce133a13866cca47374d2153cbbb91a91068b55f45ded58c4cd63dc8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T22:41:55.263 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T22:41:55.304 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:41:55.304 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T22:41:55.304 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-11T22:41:55.304 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.8 2024-09-11T22:41:55.625 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:41:55 smithi177 systemd[1]: Stopping Ceph osd.8 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:41:55.879 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:41:55 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8[53462]: 2024-09-11T22:41:55.623+0000 7f06380a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:41:55.879 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:41:55 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8[53462]: 2024-09-11T22:41:55.623+0000 7f06380a9640 -1 osd.8 99 *** Got signal Terminated *** 2024-09-11T22:41:55.879 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:41:55 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8[53462]: 2024-09-11T22:41:55.623+0000 7f06380a9640 -1 osd.8 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:41:56.084 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:41:55 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:41:55.818+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:41:56.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:41:56 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:41:56.318+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:41:57.084 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:41:56 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:41:56.829+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:41:57.734 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:41:57 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:41:57.338+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:41:58.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:41:57 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:41:57.704+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:41:58.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:41:57 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:41:57.833+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:41:58.684 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:41:58 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8[53462]: 2024-09-11T22:41:58.307+0000 7f06346bf640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:50.620773+0000 front 2024-09-11T22:40:50.620729+0000 (oldest deadline 2024-09-11T22:41:57.621142+0000) 2024-09-11T22:41:58.734 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:41:58 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:41:58.347+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:41:59.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:41:58 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:41:58.683+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:41:59.235 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:41:58 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:41:58.845+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:41:59.710 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:41:59 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8[53462]: 2024-09-11T22:41:59.300+0000 7f06346bf640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:50.620773+0000 front 2024-09-11T22:40:50.620729+0000 (oldest deadline 2024-09-11T22:41:57.621142+0000) 2024-09-11T22:41:59.734 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:41:59 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:41:59.384+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:00.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:41:59 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:41:59.710+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:00.247 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:41:59 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:41:59.867+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:00.533 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:00 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8[53462]: 2024-09-11T22:42:00.276+0000 7f06346bf640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:50.620773+0000 front 2024-09-11T22:40:50.620729+0000 (oldest deadline 2024-09-11T22:41:57.621142+0000) 2024-09-11T22:42:00.734 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:00 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:00.401+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:01.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:00 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:00.708+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:01.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:00 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:00.843+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:01.533 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:01 smithi177 podman[70182]: 2024-09-11 22:42:01.231400595 +0000 UTC m=+5.733322473 container died 1f94ac969a9d0295fa7d2651d4734a4ec9a324e155a7f3588be26fa840d61b64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-11T22:42:01.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:01 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:01.381+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:01.886 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:01 smithi177 podman[70182]: 2024-09-11 22:42:01.648613406 +0000 UTC m=+6.150535275 container cleanup 1f94ac969a9d0295fa7d2651d4734a4ec9a324e155a7f3588be26fa840d61b64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:42:01.886 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:01 smithi177 bash[70182]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8 2024-09-11T22:42:01.886 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:01.743+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:02.282 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:01 smithi177 podman[70209]: 2024-09-11 22:42:01.885561574 +0000 UTC m=+0.653947401 container remove 1f94ac969a9d0295fa7d2651d4734a4ec9a324e155a7f3588be26fa840d61b64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-11T22:42:02.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:01 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:01.892+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:02.595 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:02 smithi177 podman[70298]: 2024-09-11 22:42:02.204914325 +0000 UTC m=+0.015972009 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:42:02.595 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:02 smithi177 podman[70298]: 2024-09-11 22:42:02.334094401 +0000 UTC m=+0.145152069 container create b0f7d1ce4cee7537a1145616d40030714f18d951122736d344d7a99ca4397686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-11T22:42:02.595 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:02 smithi177 podman[70298]: 2024-09-11 22:42:02.595015968 +0000 UTC m=+0.406073641 container init b0f7d1ce4cee7537a1145616d40030714f18d951122736d344d7a99ca4397686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3) 2024-09-11T22:42:02.734 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:02 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:02.354+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:03.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:02 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:02.723+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:03.033 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:02 smithi177 podman[70298]: 2024-09-11 22:42:02.598718502 +0000 UTC m=+0.409776172 container start b0f7d1ce4cee7537a1145616d40030714f18d951122736d344d7a99ca4397686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-11T22:42:03.033 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:02 smithi177 podman[70298]: 2024-09-11 22:42:02.720172465 +0000 UTC m=+0.531230148 container attach b0f7d1ce4cee7537a1145616d40030714f18d951122736d344d7a99ca4397686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T22:42:03.033 INFO:journalctl@ceph.osd.8.smithi177.stdout:Sep 11 22:42:02 smithi177 podman[70298]: 2024-09-11 22:42:02.786570842 +0000 UTC m=+0.597628521 container died b0f7d1ce4cee7537a1145616d40030714f18d951122736d344d7a99ca4397686 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-11T22:42:03.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:02 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:02.939+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:03.404 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.8.service' 2024-09-11T22:42:03.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:03.445 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-11T22:42:03.445 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-11T22:42:03.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.9 2024-09-11T22:42:03.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:03 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:03.361+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:03.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:03 smithi040 systemd[1]: Stopping Ceph osd.9 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:04.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:03 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:03.708+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:04.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:03 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:03.708+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:04.234 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:03 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:03.857+0000 7f8521c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:04.235 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:03 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:03.857+0000 7f8521c00640 -1 osd.9 99 *** Got signal Terminated *** 2024-09-11T22:42:04.235 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:03 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:03.857+0000 7f8521c00640 -1 osd.9 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:42:04.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:03 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:03.890+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:04.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:04 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:04.318+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:05.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:04 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:04.681+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:05.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:04 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:04.681+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:05.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:04 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:04.924+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:05.734 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:05 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:05.360+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:06.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:05 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:05.659+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:06.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:05 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:05.659+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:06.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:05 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:05.918+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:06.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:06 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:06.383+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:07.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:06 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:06.612+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:07.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:06 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:06.612+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:07.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:06 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:06.958+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:07.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:06 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:06.958+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:07.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:07 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:07.406+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:07.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:07 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:07.406+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.148343+0000 front 2024-09-11T22:41:01.148454+0000 (oldest deadline 2024-09-11T22:42:06.448441+0000) 2024-09-11T22:42:08.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:07 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:07.562+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:08.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:07 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:07.562+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:08.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:07 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:07.960+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:08.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:07 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:07.960+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:08.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:08 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:08.421+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.347009+0000 front 2024-09-11T22:40:52.347413+0000 (oldest deadline 2024-09-11T22:41:55.847171+0000) 2024-09-11T22:42:08.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:08 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9[62289]: 2024-09-11T22:42:08.421+0000 7f851d600640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.148343+0000 front 2024-09-11T22:41:01.148454+0000 (oldest deadline 2024-09-11T22:42:06.448441+0000) 2024-09-11T22:42:09.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:08 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:08.545+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:09.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:08 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:08.545+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:09.335 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:08 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:08.949+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:09.336 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:08 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:08.949+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:09.985 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:09 smithi040 podman[88444]: 2024-09-11 22:42:09.684870938 +0000 UTC m=+5.948547759 container stop 374feb03153694404d354ec87dbf539af2b73f826649b74405d3982de117082f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-11T22:42:09.985 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:09 smithi040 podman[88444]: 2024-09-11 22:42:09.71886477 +0000 UTC m=+5.982541592 container died 374feb03153694404d354ec87dbf539af2b73f826649b74405d3982de117082f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T22:42:10.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:09 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:09.577+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:10.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:09 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:09.577+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:10.288 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:09 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:09.945+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:10.289 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:09 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:09.945+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:10.306 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:10 smithi040 podman[88444]: 2024-09-11 22:42:10.130047642 +0000 UTC m=+6.393724463 container cleanup 374feb03153694404d354ec87dbf539af2b73f826649b74405d3982de117082f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:42:10.307 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:10 smithi040 bash[88444]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9 2024-09-11T22:42:10.735 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:10 smithi040 podman[88462]: 2024-09-11 22:42:10.306395312 +0000 UTC m=+0.606940465 container remove 374feb03153694404d354ec87dbf539af2b73f826649b74405d3982de117082f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T22:42:11.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:10 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:10.566+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:11.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:10 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:10.566+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:11.168 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:10 smithi040 podman[88547]: 2024-09-11 22:42:10.865630241 +0000 UTC m=+0.118015948 container create d960bce1f05ce862809a83f0398e5ddd715806f23b8af31940bb6edc2ded3ca6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T22:42:11.168 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:10 smithi040 podman[88547]: 2024-09-11 22:42:10.775125148 +0000 UTC m=+0.027510866 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:42:11.168 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:11 smithi040 podman[88547]: 2024-09-11 22:42:11.070463534 +0000 UTC m=+0.322849253 container init d960bce1f05ce862809a83f0398e5ddd715806f23b8af31940bb6edc2ded3ca6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T22:42:11.168 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:11 smithi040 podman[88547]: 2024-09-11 22:42:11.077989423 +0000 UTC m=+0.330375131 container start d960bce1f05ce862809a83f0398e5ddd715806f23b8af31940bb6edc2ded3ca6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T22:42:11.168 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:11 smithi040 podman[88547]: 2024-09-11 22:42:11.167924455 +0000 UTC m=+0.420310195 container attach d960bce1f05ce862809a83f0398e5ddd715806f23b8af31940bb6edc2ded3ca6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:42:11.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:10 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:10.902+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:11.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:10 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:10.902+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:11.485 INFO:journalctl@ceph.osd.9.smithi040.stdout:Sep 11 22:42:11 smithi040 podman[88547]: 2024-09-11 22:42:11.350971258 +0000 UTC m=+0.603356973 container died d960bce1f05ce862809a83f0398e5ddd715806f23b8af31940bb6edc2ded3ca6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T22:42:12.019 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.9.service' 2024-09-11T22:42:12.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:11 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:11.554+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:12.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:11 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:11.554+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:12.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:12.093 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-11T22:42:12.093 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-11T22:42:12.093 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.10 2024-09-11T22:42:12.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:11 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:11.906+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:12.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:11 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:11.906+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:12.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:12 smithi146 systemd[1]: Stopping Ceph osd.10 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:12.834 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:12 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:12.416+0000 7fc1634ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:12.834 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:12 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:12.416+0000 7fc1634ba640 -1 osd.10 99 *** Got signal Terminated *** 2024-09-11T22:42:12.834 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:12 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:12.416+0000 7fc1634ba640 -1 osd.10 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:42:13.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:12 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:12.594+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:13.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:12 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:12.594+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:13.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:12 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:12.877+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:13.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:12 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:12.877+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:13.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:12 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:12.877+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:07.213777+0000 front 2024-09-11T22:41:07.213795+0000 (oldest deadline 2024-09-11T22:42:11.913646+0000) 2024-09-11T22:42:13.782 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:13 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:13.550+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:13.783 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:13 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:13.550+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:13.783 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:13 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:13.550+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:14.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:13 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:13.885+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:14.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:13 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:13.885+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:14.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:13 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:13.885+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:07.213777+0000 front 2024-09-11T22:41:07.213795+0000 (oldest deadline 2024-09-11T22:42:11.913646+0000) 2024-09-11T22:42:15.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:14 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:14.563+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:15.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:14 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:14.563+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:15.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:14 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:14.563+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:15.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:14 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:14.869+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:15.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:14 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:14.869+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:15.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:14 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:14.869+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:07.213777+0000 front 2024-09-11T22:41:07.213795+0000 (oldest deadline 2024-09-11T22:42:11.913646+0000) 2024-09-11T22:42:16.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:15 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:15.542+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:16.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:15 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:15.542+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:16.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:15 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:15.542+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:16.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:15 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:15.902+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:16.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:15 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:15.902+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:16.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:15 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:15.902+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:07.213777+0000 front 2024-09-11T22:41:07.213795+0000 (oldest deadline 2024-09-11T22:42:11.913646+0000) 2024-09-11T22:42:17.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:16 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:16.556+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:17.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:16 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:16.556+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:17.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:16 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:16.556+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:17.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:16 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:16.876+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:49.810694+0000 front 2024-09-11T22:40:49.810712+0000 (oldest deadline 2024-09-11T22:41:55.710642+0000) 2024-09-11T22:42:17.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:16 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:16.876+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:01.412431+0000 front 2024-09-11T22:41:01.412550+0000 (oldest deadline 2024-09-11T22:42:06.112635+0000) 2024-09-11T22:42:17.334 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:16 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10[59679]: 2024-09-11T22:42:16.876+0000 7fc15bac8640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:07.213777+0000 front 2024-09-11T22:41:07.213795+0000 (oldest deadline 2024-09-11T22:42:11.913646+0000) 2024-09-11T22:42:18.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:17 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:17.604+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:18.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:17 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:17.604+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:18.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:17 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:17.604+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:18.108 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:17 smithi146 podman[70433]: 2024-09-11 22:42:17.839138997 +0000 UTC m=+5.552722392 container died bb47f59b03468c20d173cf25eb010f83ddd361451a2e3795ec72dab2536248f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-11T22:42:18.361 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:18 smithi146 podman[70433]: 2024-09-11 22:42:18.357732263 +0000 UTC m=+6.071315659 container cleanup bb47f59b03468c20d173cf25eb010f83ddd361451a2e3795ec72dab2536248f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-11T22:42:18.361 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:18 smithi146 bash[70433]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10 2024-09-11T22:42:18.834 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:18 smithi146 podman[70448]: 2024-09-11 22:42:18.575644857 +0000 UTC m=+0.732461220 container remove bb47f59b03468c20d173cf25eb010f83ddd361451a2e3795ec72dab2536248f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-11T22:42:19.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:18 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:18.571+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:19.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:18 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:18.571+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:19.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:18 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:18.571+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:19.117 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:18 smithi146 podman[70535]: 2024-09-11 22:42:18.891332764 +0000 UTC m=+0.016197879 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:42:19.118 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:19 smithi146 podman[70535]: 2024-09-11 22:42:19.009627729 +0000 UTC m=+0.134492837 container create b062a858b0c29b254c5c95f8f51d25313d678cf256fd87e91f6bfc95bf7020f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True) 2024-09-11T22:42:19.240 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:19 smithi146 podman[70535]: 2024-09-11 22:42:19.236883957 +0000 UTC m=+0.361749061 container init b062a858b0c29b254c5c95f8f51d25313d678cf256fd87e91f6bfc95bf7020f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T22:42:19.584 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:19 smithi146 podman[70535]: 2024-09-11 22:42:19.240138938 +0000 UTC m=+0.365004055 container start b062a858b0c29b254c5c95f8f51d25313d678cf256fd87e91f6bfc95bf7020f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-11T22:42:19.585 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:19 smithi146 podman[70535]: 2024-09-11 22:42:19.370282841 +0000 UTC m=+0.495147969 container attach b062a858b0c29b254c5c95f8f51d25313d678cf256fd87e91f6bfc95bf7020f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-11T22:42:19.585 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:19 smithi146 podman[70535]: 2024-09-11 22:42:19.435672731 +0000 UTC m=+0.560537847 container died b062a858b0c29b254c5c95f8f51d25313d678cf256fd87e91f6bfc95bf7020f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T22:42:19.984 INFO:journalctl@ceph.osd.10.smithi146.stdout:Sep 11 22:42:19 smithi146 podman[70558]: 2024-09-11 22:42:19.981488025 +0000 UTC m=+0.539139947 container remove b062a858b0c29b254c5c95f8f51d25313d678cf256fd87e91f6bfc95bf7020f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-11T22:42:20.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.10.service' 2024-09-11T22:42:20.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:19 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:19.567+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:20.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:19 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:19.567+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:20.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:19 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:19.567+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:20.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:20.050 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-11T22:42:20.050 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-11T22:42:20.050 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.11 2024-09-11T22:42:20.376 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:20 smithi177 systemd[1]: Stopping Ceph osd.11 for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:20.376 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:20 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:20.375+0000 7f13e09d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:20.377 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:20 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:20.375+0000 7f13e09d0640 -1 osd.11 99 *** Got signal Terminated *** 2024-09-11T22:42:20.377 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:20 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:20.375+0000 7f13e09d0640 -1 osd.11 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T22:42:20.782 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:20 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:20.536+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:20.783 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:20 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:20.536+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:20.783 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:20 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:20.536+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:22.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:21 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:21.576+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:22.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:21 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:21.576+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:22.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:21 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:21.576+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:23.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:22 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:22.618+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:23.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:22 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:22.618+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:23.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:22 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:22.618+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:24.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:23 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:23.601+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:24.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:23 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:23.601+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:24.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:23 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:23.601+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:25.032 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:24 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:24.608+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.40:6806 osd.0 since back 2024-09-11T22:40:52.968878+0000 front 2024-09-11T22:40:52.968845+0000 (oldest deadline 2024-09-11T22:41:57.668742+0000) 2024-09-11T22:42:25.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:24 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:24.608+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.146:6804 osd.1 since back 2024-09-11T22:41:00.569858+0000 front 2024-09-11T22:41:00.569920+0000 (oldest deadline 2024-09-11T22:42:03.469757+0000) 2024-09-11T22:42:25.033 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:24 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11[60148]: 2024-09-11T22:42:24.608+0000 7f13dcfe6640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.177:6804 osd.2 since back 2024-09-11T22:41:08.770789+0000 front 2024-09-11T22:41:08.771058+0000 (oldest deadline 2024-09-11T22:42:12.870904+0000) 2024-09-11T22:42:26.118 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:25 smithi177 podman[70400]: 2024-09-11 22:42:25.83875236 +0000 UTC m=+5.585839748 container died 11f556fb7657a799527da2f92d26a502afb005a9e767e6a81ec906253b2b1495 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:42:26.484 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:26 smithi177 podman[70400]: 2024-09-11 22:42:26.23316551 +0000 UTC m=+5.980252903 container cleanup 11f556fb7657a799527da2f92d26a502afb005a9e767e6a81ec906253b2b1495 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-11T22:42:26.484 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:26 smithi177 bash[70400]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11 2024-09-11T22:42:26.782 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:26 smithi177 podman[70415]: 2024-09-11 22:42:26.484333804 +0000 UTC m=+0.643853005 container remove 11f556fb7657a799527da2f92d26a502afb005a9e767e6a81ec906253b2b1495 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-11T22:42:27.104 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:26 smithi177 podman[70513]: 2024-09-11 22:42:26.747367373 +0000 UTC m=+0.015883991 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T22:42:27.104 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:26 smithi177 podman[70513]: 2024-09-11 22:42:26.885225141 +0000 UTC m=+0.153741761 container create becdd7dce73b97275a4539b0d5a4038ac9e4d627286ad1e8c457ee3e83f3bf60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T22:42:27.104 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:27 smithi177 podman[70513]: 2024-09-11 22:42:27.104385292 +0000 UTC m=+0.372901910 container init becdd7dce73b97275a4539b0d5a4038ac9e4d627286ad1e8c457ee3e83f3bf60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T22:42:27.532 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:27 smithi177 podman[70513]: 2024-09-11 22:42:27.107823702 +0000 UTC m=+0.376340323 container start becdd7dce73b97275a4539b0d5a4038ac9e4d627286ad1e8c457ee3e83f3bf60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T22:42:27.533 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:27 smithi177 podman[70513]: 2024-09-11 22:42:27.179422112 +0000 UTC m=+0.447938740 container attach becdd7dce73b97275a4539b0d5a4038ac9e4d627286ad1e8c457ee3e83f3bf60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T22:42:27.533 INFO:journalctl@ceph.osd.11.smithi177.stdout:Sep 11 22:42:27 smithi177 podman[70513]: 2024-09-11 22:42:27.299566885 +0000 UTC m=+0.568083508 container died becdd7dce73b97275a4539b0d5a4038ac9e4d627286ad1e8c457ee3e83f3bf60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T22:42:27.865 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@osd.11.service' 2024-09-11T22:42:27.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:27.903 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-11T22:42:27.903 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-11T22:42:27.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.a 2024-09-11T22:42:28.235 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:42:27 smithi040 systemd[1]: Stopping Ceph mds.a for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:28.734 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:42:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a[69141]: 2024-09-11T22:42:28.333+0000 7f24cee00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:28.735 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:42:28 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a[69141]: 2024-09-11T22:42:28.333+0000 7f24cee00640 -1 mds.a *** got signal Terminated *** 2024-09-11T22:42:29.638 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:42:29 smithi040 podman[88649]: 2024-09-11 22:42:29.3758402 +0000 UTC m=+1.175661486 container died 89711e74356ddaea170b842bb3d32a3ee2cb0f9b89ab09f427ef138d4fe78d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T22:42:29.932 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:42:29 smithi040 podman[88649]: 2024-09-11 22:42:29.755813326 +0000 UTC m=+1.555634612 container cleanup 89711e74356ddaea170b842bb3d32a3ee2cb0f9b89ab09f427ef138d4fe78d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-11T22:42:29.932 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:42:29 smithi040 bash[88649]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a 2024-09-11T22:42:30.185 INFO:journalctl@ceph.mds.a.smithi040.stdout:Sep 11 22:42:29 smithi040 podman[88660]: 2024-09-11 22:42:29.932041541 +0000 UTC m=+0.548184569 container remove 89711e74356ddaea170b842bb3d32a3ee2cb0f9b89ab09f427ef138d4fe78d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T22:42:30.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.a.service' 2024-09-11T22:42:30.262 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:30.262 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-11T22:42:30.262 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-11T22:42:30.262 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.d 2024-09-11T22:42:30.484 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:42:30 smithi040 systemd[1]: Stopping Ceph mds.d for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:30.985 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:42:30 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d[67964]: 2024-09-11T22:42:30.662+0000 7ff5df200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:30.985 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:42:30 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d[67964]: 2024-09-11T22:42:30.662+0000 7ff5df200640 -1 mds.d *** got signal Terminated *** 2024-09-11T22:42:32.735 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:42:32 smithi040 podman[88768]: 2024-09-11 22:42:32.420511804 +0000 UTC m=+1.881330190 container died 836bb32fe9f8d1d60a65a9202ec8ebad7bc734307d69b9f892b01096a3fd5fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:42:33.103 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:42:32 smithi040 podman[88768]: 2024-09-11 22:42:32.918164534 +0000 UTC m=+2.378982919 container cleanup 836bb32fe9f8d1d60a65a9202ec8ebad7bc734307d69b9f892b01096a3fd5fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T22:42:33.103 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:42:32 smithi040 bash[88768]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d 2024-09-11T22:42:33.359 INFO:journalctl@ceph.mds.d.smithi040.stdout:Sep 11 22:42:33 smithi040 podman[88791]: 2024-09-11 22:42:33.102837585 +0000 UTC m=+0.667782683 container remove 836bb32fe9f8d1d60a65a9202ec8ebad7bc734307d69b9f892b01096a3fd5fb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True) 2024-09-11T22:42:33.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.d.service' 2024-09-11T22:42:33.452 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:33.452 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-11T22:42:33.452 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-11T22:42:33.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.g 2024-09-11T22:42:33.735 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:42:33 smithi040 systemd[1]: Stopping Ceph mds.g for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:34.234 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:42:33 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g[68771]: 2024-09-11T22:42:33.842+0000 7f6024c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:34.235 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:42:33 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g[68771]: 2024-09-11T22:42:33.842+0000 7f6024c00640 -1 mds.g *** got signal Terminated *** 2024-09-11T22:42:37.883 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:42:37 smithi040 podman[88897]: 2024-09-11 22:42:37.536243473 +0000 UTC m=+3.802686019 container died 939eed7898349f6390fc654680a82912e056d639ab9ca33bb760db5bba31b32c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-11T22:42:37.883 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:42:37 smithi040 podman[88897]: 2024-09-11 22:42:37.88320862 +0000 UTC m=+4.149651175 container cleanup 939eed7898349f6390fc654680a82912e056d639ab9ca33bb760db5bba31b32c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T22:42:38.235 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:42:37 smithi040 bash[88897]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g 2024-09-11T22:42:38.235 INFO:journalctl@ceph.mds.g.smithi040.stdout:Sep 11 22:42:38 smithi040 podman[88908]: 2024-09-11 22:42:38.115462417 +0000 UTC m=+0.565258032 container remove 939eed7898349f6390fc654680a82912e056d639ab9ca33bb760db5bba31b32c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:42:38.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.g.service' 2024-09-11T22:42:38.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:38.459 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-11T22:42:38.459 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-11T22:42:38.459 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.j 2024-09-11T22:42:38.847 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:42:38 smithi040 systemd[1]: Stopping Ceph mds.j for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:39.234 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:42:38 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j[67550]: 2024-09-11T22:42:38.846+0000 7f5490000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:39.235 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:42:38 smithi040 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j[67550]: 2024-09-11T22:42:38.846+0000 7f5490000640 -1 mds.j *** got signal Terminated *** 2024-09-11T22:42:40.394 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:42:40 smithi040 podman[89014]: 2024-09-11 22:42:40.102120614 +0000 UTC m=+1.368165534 container died f94cfae72b8971a76f64e2b210de10888d776f887d6f0162ba1cb05aa4276408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True) 2024-09-11T22:42:40.727 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:42:40 smithi040 podman[89014]: 2024-09-11 22:42:40.542916003 +0000 UTC m=+1.808960922 container cleanup f94cfae72b8971a76f64e2b210de10888d776f887d6f0162ba1cb05aa4276408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T22:42:40.727 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:42:40 smithi040 bash[89014]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j 2024-09-11T22:42:40.980 INFO:journalctl@ceph.mds.j.smithi040.stdout:Sep 11 22:42:40 smithi040 podman[89028]: 2024-09-11 22:42:40.727356281 +0000 UTC m=+0.602123358 container remove f94cfae72b8971a76f64e2b210de10888d776f887d6f0162ba1cb05aa4276408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-11T22:42:40.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.j.service' 2024-09-11T22:42:41.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:41.059 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-11T22:42:41.059 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-11T22:42:41.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.b 2024-09-11T22:42:41.358 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:42:41 smithi146 systemd[1]: Stopping Ceph mds.b for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:41.620 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:42:41 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b[65343]: 2024-09-11T22:42:41.357+0000 7f32d4f39640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:41.621 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:42:41 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b[65343]: 2024-09-11T22:42:41.357+0000 7f32d4f39640 -1 mds.b *** got signal Terminated *** 2024-09-11T22:42:45.084 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:42:44 smithi146 podman[70636]: 2024-09-11 22:42:44.806318041 +0000 UTC m=+3.553992201 container died 6535afd867851ad362a6ca90005f0dc367e671a5cc5020794e0348fcc7097029 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T22:42:45.449 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:42:45 smithi146 podman[70636]: 2024-09-11 22:42:45.181314664 +0000 UTC m=+3.928988811 container cleanup 6535afd867851ad362a6ca90005f0dc367e671a5cc5020794e0348fcc7097029 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-11T22:42:45.449 INFO:journalctl@ceph.mds.b.smithi146.stdout:Sep 11 22:42:45 smithi146 bash[70636]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-b 2024-09-11T22:42:45.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.b.service' 2024-09-11T22:42:45.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:45.662 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-11T22:42:45.662 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-11T22:42:45.663 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.e 2024-09-11T22:42:45.994 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:42:45 smithi146 systemd[1]: Stopping Ceph mds.e for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:46.334 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:42:45 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e[64727]: 2024-09-11T22:42:45.993+0000 7f65008aa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:46.334 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:42:45 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e[64727]: 2024-09-11T22:42:45.993+0000 7f65008aa640 -1 mds.e *** got signal Terminated *** 2024-09-11T22:42:49.077 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:42:48 smithi146 podman[70769]: 2024-09-11 22:42:48.802080599 +0000 UTC m=+2.920611686 container died e47700b248b4d3265aead56bdcaa3eb88105aa8aa68af3f9ffa6877548f4a187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T22:42:49.334 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:42:49 smithi146 podman[70769]: 2024-09-11 22:42:49.159847989 +0000 UTC m=+3.278379119 container cleanup e47700b248b4d3265aead56bdcaa3eb88105aa8aa68af3f9ffa6877548f4a187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T22:42:49.334 INFO:journalctl@ceph.mds.e.smithi146.stdout:Sep 11 22:42:49 smithi146 bash[70769]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-e 2024-09-11T22:42:49.596 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.e.service' 2024-09-11T22:42:49.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:49.630 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-11T22:42:49.630 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-11T22:42:49.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.h 2024-09-11T22:42:49.955 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:42:49 smithi146 systemd[1]: Stopping Ceph mds.h for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:50.334 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:42:49 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h[65039]: 2024-09-11T22:42:49.955+0000 7f421416c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:50.334 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:42:49 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h[65039]: 2024-09-11T22:42:49.955+0000 7f421416c640 -1 mds.h *** got signal Terminated *** 2024-09-11T22:42:53.084 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:42:52 smithi146 podman[70890]: 2024-09-11 22:42:52.809845144 +0000 UTC m=+2.961862454 container died d022d5eb845ad0859bc02a522619969a48f5e2dd10db642dc8d33a181dc6e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T22:42:53.456 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:42:53 smithi146 podman[70890]: 2024-09-11 22:42:53.171254563 +0000 UTC m=+3.323271875 container cleanup d022d5eb845ad0859bc02a522619969a48f5e2dd10db642dc8d33a181dc6e34f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-11T22:42:53.456 INFO:journalctl@ceph.mds.h.smithi146.stdout:Sep 11 22:42:53 smithi146 bash[70890]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-h 2024-09-11T22:42:53.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.h.service' 2024-09-11T22:42:53.635 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:53.636 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-11T22:42:53.636 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-11T22:42:53.636 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.k 2024-09-11T22:42:54.084 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:42:53 smithi146 systemd[1]: Stopping Ceph mds.k for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:54.084 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:42:53 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-k[64415]: 2024-09-11T22:42:53.949+0000 7f252514f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:54.084 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:42:53 smithi146 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-k[64415]: 2024-09-11T22:42:53.949+0000 7f252514f640 -1 mds.k *** got signal Terminated *** 2024-09-11T22:42:56.242 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:42:55 smithi146 podman[71008]: 2024-09-11 22:42:55.976948263 +0000 UTC m=+2.119019537 container died 6e2864040c287fb51ac715eee047173ec421db7ad7f041e4128c83274a6c3492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-11T22:42:56.584 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:42:56 smithi146 podman[71008]: 2024-09-11 22:42:56.349803865 +0000 UTC m=+2.491875131 container cleanup 6e2864040c287fb51ac715eee047173ec421db7ad7f041e4128c83274a6c3492 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-k, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-11T22:42:56.584 INFO:journalctl@ceph.mds.k.smithi146.stdout:Sep 11 22:42:56 smithi146 bash[71008]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-k 2024-09-11T22:42:56.781 DEBUG:teuthology.orchestra.run.smithi146:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.k.service' 2024-09-11T22:42:56.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:42:56.814 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-11T22:42:56.815 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-11T22:42:56.815 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.c 2024-09-11T22:42:57.116 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:42:56 smithi177 systemd[1]: Stopping Ceph mds.c for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:42:57.374 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:42:57 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c[65070]: 2024-09-11T22:42:57.115+0000 7fe7470bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:42:57.374 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:42:57 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c[65070]: 2024-09-11T22:42:57.115+0000 7fe7470bb640 -1 mds.c *** got signal Terminated *** 2024-09-11T22:43:01.033 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:43:00 smithi177 podman[70619]: 2024-09-11 22:43:00.778531298 +0000 UTC m=+3.767354647 container died 3a8cf4e394555f7be117105533b0d4d763ac7a541810bf803cbd8711fc82f3a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T22:43:01.441 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:43:01 smithi177 podman[70619]: 2024-09-11 22:43:01.148221698 +0000 UTC m=+4.137045034 container cleanup 3a8cf4e394555f7be117105533b0d4d763ac7a541810bf803cbd8711fc82f3a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-11T22:43:01.441 INFO:journalctl@ceph.mds.c.smithi177.stdout:Sep 11 22:43:01 smithi177 bash[70619]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-c 2024-09-11T22:43:01.576 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.c.service' 2024-09-11T22:43:01.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:43:01.614 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-11T22:43:01.614 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-11T22:43:01.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.f 2024-09-11T22:43:01.961 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:43:01 smithi177 systemd[1]: Stopping Ceph mds.f for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:43:02.282 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:43:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f[64770]: 2024-09-11T22:43:01.959+0000 7f95487e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:43:02.283 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:43:01 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f[64770]: 2024-09-11T22:43:01.959+0000 7f95487e0640 -1 mds.f *** got signal Terminated *** 2024-09-11T22:43:05.060 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:43:04 smithi177 podman[70749]: 2024-09-11 22:43:04.785774631 +0000 UTC m=+2.952899466 container died 3b1966b007ed83dae580cb064d60d8eb0540126eb3cc20084c485aed625359d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T22:43:05.419 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:43:05 smithi177 podman[70749]: 2024-09-11 22:43:05.143023187 +0000 UTC m=+3.310148011 container cleanup 3b1966b007ed83dae580cb064d60d8eb0540126eb3cc20084c485aed625359d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True) 2024-09-11T22:43:05.419 INFO:journalctl@ceph.mds.f.smithi177.stdout:Sep 11 22:43:05 smithi177 bash[70749]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-f 2024-09-11T22:43:05.542 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.f.service' 2024-09-11T22:43:05.576 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:43:05.576 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-11T22:43:05.576 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-11T22:43:05.576 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.i 2024-09-11T22:43:05.782 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:43:05 smithi177 systemd[1]: Stopping Ceph mds.i for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:43:06.282 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:43:05 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i[65372]: 2024-09-11T22:43:05.888+0000 7ff0a8a8a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:43:06.283 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:43:05 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i[65372]: 2024-09-11T22:43:05.888+0000 7ff0a8a8a640 -1 mds.i *** got signal Terminated *** 2024-09-11T22:43:09.105 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:43:08 smithi177 podman[70870]: 2024-09-11 22:43:08.7863634 +0000 UTC m=+2.996307947 container died 30220e6a438cdbbb151b833ff9e64c028aaafd14f69f75fb2cc605e545320e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T22:43:09.105 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:43:09 smithi177 podman[70870]: 2024-09-11 22:43:09.104879555 +0000 UTC m=+3.314824091 container cleanup 30220e6a438cdbbb151b833ff9e64c028aaafd14f69f75fb2cc605e545320e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-11T22:43:09.511 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:43:09 smithi177 bash[70870]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i 2024-09-11T22:43:09.511 INFO:journalctl@ceph.mds.i.smithi177.stdout:Sep 11 22:43:09 smithi177 podman[70882]: 2024-09-11 22:43:09.314794654 +0000 UTC m=+0.530349079 container remove 30220e6a438cdbbb151b833ff9e64c028aaafd14f69f75fb2cc605e545320e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T22:43:09.536 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.i.service' 2024-09-11T22:43:09.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:43:09.570 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-11T22:43:09.570 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-11T22:43:09.570 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.l 2024-09-11T22:43:09.782 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 11 22:43:09 smithi177 systemd[1]: Stopping Ceph mds.l for c836ee3e-708b-11ef-bcea-c7b262605968... 2024-09-11T22:43:10.282 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 11 22:43:09 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-l[64467]: 2024-09-11T22:43:09.884+0000 7fb8773f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T22:43:10.282 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 11 22:43:09 smithi177 ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-l[64467]: 2024-09-11T22:43:09.884+0000 7fb8773f2640 -1 mds.l *** got signal Terminated *** 2024-09-11T22:43:13.526 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 11 22:43:13 smithi177 podman[70991]: 2024-09-11 22:43:13.244139544 +0000 UTC m=+3.461492074 container died 987ae185b57c73bbd1afbbbaa8432d72b8aa88ee6da76d42fae04172bb2a1000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T22:43:13.782 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 11 22:43:13 smithi177 podman[70991]: 2024-09-11 22:43:13.625322096 +0000 UTC m=+3.842674627 container cleanup 987ae185b57c73bbd1afbbbaa8432d72b8aa88ee6da76d42fae04172bb2a1000 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T22:43:13.783 INFO:journalctl@ceph.mds.l.smithi177.stdout:Sep 11 22:43:13 smithi177 bash[70991]: ceph-c836ee3e-708b-11ef-bcea-c7b262605968-mds-l 2024-09-11T22:43:14.036 DEBUG:teuthology.orchestra.run.smithi177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c836ee3e-708b-11ef-bcea-c7b262605968@mds.l.service' 2024-09-11T22:43:14.068 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T22:43:14.069 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-11T22:43:14.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c836ee3e-708b-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T22:43:14.356 INFO:teuthology.orchestra.run.smithi040.stdout:Deleting cluster with fsid: c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:43:18.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c836ee3e-708b-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T22:43:18.489 INFO:teuthology.orchestra.run.smithi146.stdout:Deleting cluster with fsid: c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:43:21.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c836ee3e-708b-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T22:43:21.236 INFO:teuthology.orchestra.run.smithi177.stdout:Deleting cluster with fsid: c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T22:43:23.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:43:23.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:43:23.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T22:43:23.779 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T22:43:23.781 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417/remote/smithi040/crash 2024-09-11T22:43:23.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/crash -- . 2024-09-11T22:43:23.851 INFO:teuthology.orchestra.run.smithi040.stderr:tar: /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T22:43:23.851 INFO:teuthology.orchestra.run.smithi040.stderr:tar: Error is not recoverable: exiting now 2024-09-11T22:43:23.854 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417/remote/smithi146/crash 2024-09-11T22:43:23.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/crash -- . 2024-09-11T22:43:23.897 INFO:teuthology.orchestra.run.smithi146.stderr:tar: /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T22:43:23.897 INFO:teuthology.orchestra.run.smithi146.stderr:tar: Error is not recoverable: exiting now 2024-09-11T22:43:23.899 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417/remote/smithi177/crash 2024-09-11T22:43:23.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/crash -- . 2024-09-11T22:43:23.937 INFO:teuthology.orchestra.run.smithi177.stderr:tar: /var/lib/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T22:43:23.938 INFO:teuthology.orchestra.run.smithi177.stderr:tar: Error is not recoverable: exiting now 2024-09-11T22:43:23.939 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T22:43:23.939 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T22:43:24.080 INFO:teuthology.orchestra.run.smithi040.stdout:2024-09-11T22:34:33.419467+0000 mon.a (mon.0) 1171 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T22:43:24.081 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-11T22:43:24.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[SEC\]' /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T22:43:24.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]' /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T22:43:24.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[WRN\]' /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T22:43:24.330 INFO:teuthology.orchestra.run.smithi040.stdout:2024-09-11T22:34:33.419467+0000 mon.a (mon.0) 1171 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T22:43:24.331 INFO:tasks.cephadm:Compressing logs... 2024-09-11T22:43:24.331 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:43:24.335 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:43:24.338 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:43:24.371 INFO:teuthology.orchestra.run.smithi146.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-11T22:43:24.371 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-11T22:43:24.373 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T22:43:24.373 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T22:43:24.373 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T22:43:24.373 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-11T22:43:24.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-11T22:43:24.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T22:43:24.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T22:43:24.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T22:43:24.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T22:43:24.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log 2024-09-11T22:43:24.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-11T22:43:24.377 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T22:43:24.377 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-11T22:43:24.377 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T22:43:24.378 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-11T22:43:24.378 INFO:teuthology.orchestra.run.smithi177.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-volume.log: No such file or directory 2024-09-11T22:43:24.379 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-11T22:43:24.379 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T22:43:24.379 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-11T22:43:24.379 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T22:43:24.382 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T22:43:24.382 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-11T22:43:24.382 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T22:43:24.382 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T22:43:24.382 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log 2024-09-11T22:43:24.382 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-11T22:43:24.383 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-11T22:43:24.383 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-11T22:43:24.383 INFO:teuthology.orchestra.run.smithi177.stderr:gzip/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.8.log: -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-11T22:43:24.383 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-11T22:43:24.383 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T22:43:24.383 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-11T22:43:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2024-09-11T22:43:24.401 INFO:teuthology.orchestra.run.smithi040.stderr: --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-11T22:43:24.405 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T22:43:24.406 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-11T22:43:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T22:43:24.407 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T22:43:24.408 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-11T22:43:24.409 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T22:43:24.410 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T22:43:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-11T22:43:24.411 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T22:43:24.412 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log 2024-09-11T22:43:24.413 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-11T22:43:24.413 INFO:teuthology.orchestra.run.smithi040.stderr: 94.3% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-11T22:43:24.414 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T22:43:24.415 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-11T22:43:24.416 INFO:teuthology.orchestra.run.smithi040.stderr: 94.5% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-11T22:43:24.416 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mgr.x.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-11T22:43:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.3.log 86.8% 2024-09-11T22:43:24.417 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T22:43:24.417 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T22:43:24.419 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.3.log: 94.5% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-11T22:43:24.420 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-11T22:43:24.432 INFO:teuthology.orchestra.run.smithi040.stderr: 90.3% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T22:43:24.443 INFO:teuthology.orchestra.run.smithi040.stderr: 82.3% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T22:43:24.447 INFO:teuthology.orchestra.run.smithi146.stderr: 92.8% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T22:43:24.460 INFO:teuthology.orchestra.run.smithi177.stderr: 82.2% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T22:43:24.538 INFO:teuthology.orchestra.run.smithi177.stderr: 92.9% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-11T22:43:24.558 INFO:teuthology.orchestra.run.smithi177.stderr: 90.4% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T22:43:24.568 INFO:teuthology.orchestra.run.smithi146.stderr: 82.3% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T22:43:24.568 INFO:teuthology.orchestra.run.smithi177.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T22:43:24.587 INFO:teuthology.orchestra.run.smithi146.stderr: 86.8% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T22:43:24.588 INFO:teuthology.orchestra.run.smithi177.stderr: 86.8% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T22:43:24.603 INFO:teuthology.orchestra.run.smithi146.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T22:43:24.635 INFO:teuthology.orchestra.run.smithi146.stderr: 90.4% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T22:43:24.635 INFO:teuthology.orchestra.run.smithi177.stderr: 91.0% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T22:43:24.644 INFO:teuthology.orchestra.run.smithi040.stderr: 91.0% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T22:43:24.672 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T22:43:24.702 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T22:43:25.274 INFO:teuthology.orchestra.run.smithi177.stderr: 95.7% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-11T22:43:25.879 INFO:teuthology.orchestra.run.smithi040.stderr: 90.3% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T22:43:27.750 INFO:teuthology.orchestra.run.smithi146.stderr: 91.8% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T22:43:28.612 INFO:teuthology.orchestra.run.smithi146.stderr: 95.6% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-11T22:43:30.415 INFO:teuthology.orchestra.run.smithi177.stderr: 91.7% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T22:43:31.012 INFO:teuthology.orchestra.run.smithi146.stderr: 96.0% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-11T22:43:32.150 INFO:teuthology.orchestra.run.smithi040.stderr: 90.4% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T22:43:32.316 INFO:teuthology.orchestra.run.smithi177.stderr: 95.5% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-11T22:43:52.687 INFO:teuthology.orchestra.run.smithi177.stderr: 94.8% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-11T22:44:24.973 INFO:teuthology.orchestra.run.smithi146.stderr: 94.3% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-11T22:58:41.553 INFO:teuthology.orchestra.run.smithi146.stderr: 92.6% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-11T22:58:48.282 INFO:teuthology.orchestra.run.smithi177.stderr: 92.5% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-11T22:59:00.029 INFO:teuthology.orchestra.run.smithi177.stderr: 92.1% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-11T23:01:48.596 INFO:teuthology.orchestra.run.smithi146.stderr: 92.6% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T23:04:45.449 INFO:teuthology.orchestra.run.smithi177.stderr: 92.2% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T23:04:51.272 INFO:teuthology.orchestra.run.smithi146.stderr: 92.5% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T23:05:26.936 INFO:teuthology.orchestra.run.smithi146.stderr: 91.7% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T23:05:26.976 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-11T23:05:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:real 22m2.623s 2024-09-11T23:05:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:user 8m19.255s 2024-09-11T23:05:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m23.082s 2024-09-11T23:05:29.051 INFO:teuthology.orchestra.run.smithi040.stderr: 92.2% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T23:06:03.369 INFO:teuthology.orchestra.run.smithi177.stderr: 91.8% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T23:06:03.371 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-09-11T23:06:03.371 INFO:teuthology.orchestra.run.smithi177.stderr:real 22m39.018s 2024-09-11T23:06:03.371 INFO:teuthology.orchestra.run.smithi177.stderr:user 8m59.207s 2024-09-11T23:06:03.371 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m24.083s 2024-09-11T23:07:19.304 INFO:teuthology.orchestra.run.smithi040.stderr: 92.3% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T23:08:07.528 INFO:teuthology.orchestra.run.smithi040.stderr: 92.4% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T23:09:31.299 INFO:teuthology.orchestra.run.smithi040.stderr: 91.5% -- replaced with /var/log/ceph/c836ee3e-708b-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-11T23:09:31.302 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-09-11T23:09:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:real 26m6.938s 2024-09-11T23:09:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:user 10m48.330s 2024-09-11T23:09:31.302 INFO:teuthology.orchestra.run.smithi040.stderr:sys 1m22.362s 2024-09-11T23:09:31.304 INFO:tasks.cephadm:Archiving logs... 2024-09-11T23:09:31.305 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417/remote/smithi040/log 2024-09-11T23:09:31.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:11:11.295 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417/remote/smithi146/log 2024-09-11T23:11:11.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:12:30.382 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417/remote/smithi177/log 2024-09-11T23:12:30.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:14:00.265 INFO:tasks.cephadm:Removing cluster... 2024-09-11T23:14:00.266 DEBUG:teuthology.orchestra.run.smithi040:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c836ee3e-708b-11ef-bcea-c7b262605968 --force 2024-09-11T23:14:00.817 INFO:teuthology.orchestra.run.smithi040.stdout:Deleting cluster with fsid: c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T23:14:03.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c836ee3e-708b-11ef-bcea-c7b262605968 --force 2024-09-11T23:14:03.507 INFO:teuthology.orchestra.run.smithi146.stdout:Deleting cluster with fsid: c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T23:14:04.339 DEBUG:teuthology.orchestra.run.smithi177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c836ee3e-708b-11ef-bcea-c7b262605968 --force 2024-09-11T23:14:04.836 INFO:teuthology.orchestra.run.smithi177.stdout:Deleting cluster with fsid: c836ee3e-708b-11ef-bcea-c7b262605968 2024-09-11T23:14:05.687 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T23:14:05.688 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T23:14:05.739 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T23:14:05.759 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T23:14:05.775 INFO:tasks.cephadm:Teardown complete 2024-09-11T23:14:05.776 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T23:14:05.794 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T23:14:05.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:14:05.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:14:05.804 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:14:06.031 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T23:14:06.041 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T23:14:06.041 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:14:06.046 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:14:06.049 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:14:06.063 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:14:06.063 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:14:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:14:06.102 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:14:06.102 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-09-11T23:14:06.102 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +1722us[+1745us] +/- 54ms 2024-09-11T23:14:06.103 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 -1098us[-1075us] +/- 58ms 2024-09-11T23:14:06.103 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -1230us[-1207us] +/- 82ms 2024-09-11T23:14:06.103 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:06.155 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:14:06.155 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-11T23:14:06.156 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +1716us[+1722us] +/- 54ms 2024-09-11T23:14:06.156 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 -1093us[-1093us] +/- 58ms 2024-09-11T23:14:06.156 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -1251us[-1251us] +/- 82ms 2024-09-11T23:14:06.156 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:06.212 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:14:06.212 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-09-11T23:14:06.212 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 +1713us[+1691us] +/- 54ms 2024-09-11T23:14:06.212 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 -1120us[-1120us] +/- 58ms 2024-09-11T23:14:06.213 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -1258us[-1258us] +/- 82ms 2024-09-11T23:14:06.213 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:06.214 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T23:14:06.224 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T23:14:06.225 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T23:14:06.245 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:14:06.488 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:14:06.619 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:14:06.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:14:06.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:06.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:14:06.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:06.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:14:06.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:06.873 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T23:14:06.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T23:14:06.900 INFO:teuthology.task.internal:Duration was 3732.768435 seconds 2024-09-11T23:14:06.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T23:14:06.914 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T23:14:06.914 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:14:06.919 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:14:06.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:14:06.971 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:14:06.983 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:14:07.036 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:14:07.441 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T23:14:07.441 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-09-11T23:14:07.441 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:14:07.494 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-09-11T23:14:07.494 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:14:07.524 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-09-11T23:14:07.524 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:14:07.559 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T23:14:07.559 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:14:07.563 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:14:07.566 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:14:07.625 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T23:14:07.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:14:07.633 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:14:07.636 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:14:08.188 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T23:14:08.199 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T23:14:08.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:14:08.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:14:08.326 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:14:08.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T23:14:08.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:14:08.367 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:14:08.369 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:14:08.399 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-09-11T23:14:08.435 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-09-11T23:14:08.453 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-09-11T23:14:08.493 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:14:08.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:08.527 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:14:08.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:08.542 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:14:08.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:14:08.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T23:14:08.567 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T23:14:08.569 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417/remote/smithi040 2024-09-11T23:14:08.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:14:08.646 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417/remote/smithi146 2024-09-11T23:14:08.646 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:14:08.686 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901417/remote/smithi177 2024-09-11T23:14:08.686 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:14:08.725 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T23:14:08.725 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:14:08.730 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:14:08.733 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:14:08.772 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T23:14:08.784 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T23:14:08.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T23:14:08.797 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T23:14:08.797 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:14:08.805 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:14:08.808 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:14:08.820 INFO:teuthology.orchestra.run.smithi146.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:14 /home/ubuntu/cephtest 2024-09-11T23:14:08.826 INFO:teuthology.orchestra.run.smithi177.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:14 /home/ubuntu/cephtest 2024-09-11T23:14:08.836 INFO:teuthology.orchestra.run.smithi040.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:14 /home/ubuntu/cephtest 2024-09-11T23:14:08.838 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T23:14:08.851 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T23:14:08.888 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} duration: 3732.7684347629547 failure_reason: '"2024-09-11T22:34:33.419467+0000 mon.a (mon.0) 1171 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-09-11T23:14:08.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:14:08.984 INFO:teuthology.run:FAIL